--- BVT pytest attempt 2026-07-07T05:27:19.231706+00:00 (/.local/bin/uv --directory /home/odh/opendatahub-tests...) --- 2026-07-07T05:27:21.194474Z [info ] Writing tests log to /home/odh/opendatahub-tests/results/pytest-tests.log [conftest] 2026-07-07T05:27:21.194915Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( 2026-07-07T05:27:21.315435Z [info ] kind: DataScienceCluster api version: datasciencecluster.opendatahub.io/v2 [ocp_resources.resource] /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( 2026-07-07T05:27:21.384458Z [info ] kind: DSCInitialization api version: dscinitialization.opendatahub.io/v2 [ocp_resources.resource] /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( ============================= test session starts ============================== platform linux -- Python 3.14.5, pytest-9.0.3, pluggy-1.6.0 -- /home/odh/opendatahub-tests/.venv/bin/python3 cachedir: .pytest_cache metadata: {'Python': '3.14.5', 'Platform': 'Linux-5.14.0-570.120.1.el9_6.x86_64-x86_64-with-glibc2.42', 'Packages': {'pytest': '9.0.3', 'pluggy': '1.6.0'}, 'Plugins': {'anyio': '4.13.0', 'langsmith': '0.8.5', 'asyncio': '1.3.0', 'dependency': '0.6.1', 'html': '4.2.0', 'metadata': '3.1.1', 'order': '1.4.0', 'progress': '1.4.0', 'testconfig': '0.2.0', 'xdist': '3.8.0', 'syrupy': '5.2.0'}} rootdir: /home/odh/opendatahub-tests configfile: pytest.ini plugins: anyio-4.13.0, langsmith-0.8.5, asyncio-1.3.0, dependency-0.6.1, html-4.2.0, metadata-3.1.1, order-1.4.0, progress-1.4.0, testconfig-0.2.0, xdist-3.8.0, syrupy-5.2.0 asyncio: mode=Mode.STRICT, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function collecting ... collected 129 items / 127 deselected / 2 selected tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::TestAuthPolicyApiKeyValidation::test_auth_policy_callback_url_uses_correct_namespace  --------------------------------- test_auth_policy_callback_url_uses_correct_namespace --------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-07-07T05:27:21.710598Z [info ] Executing session fixture: event_loop_policy [conftest] 2026-07-07T05:27:21.711960Z [info ] Executing session fixture: _syrupy_apply_ide_patches [conftest] 2026-07-07T05:27:21.712172Z [info ] Executing session fixture: admin_client [conftest] 2026-07-07T05:27:21.712313Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] 2026-07-07T05:27:21.712432Z [info ] Executing session fixture: dsc_resource [conftest] 2026-07-07T05:27:21.712553Z [info ] kind: DataScienceCluster api version: datasciencecluster.opendatahub.io/v2 [ocp_resources.resource] 2026-07-07T05:27:21.786742Z [info ] Executing session fixture: tmp_path_factory [conftest] 2026-07-07T05:27:21.787122Z [info ] Executing session fixture: tests_tmp_dir [conftest] 2026-07-07T05:27:21.787887Z [info ] Executing session fixture: os_path_environment [conftest] 2026-07-07T05:27:21.788440Z [info ] Executing session fixture: tmpdir_factory [conftest] 2026-07-07T05:27:21.789627Z [info ] Executing session fixture: bin_directory [conftest] 2026-07-07T05:27:21.789923Z [info ] Executing session fixture: oc_binary_path [conftest] 2026-07-07T05:27:21.806608Z [info ] kind: ConsoleCLIDownload api version: console.openshift.io/v1 [ocp_resources.resource] 2026-07-07T05:27:21.849311Z [info ] All oc console cli download links: ['https://downloads-openshift-console.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com/amd64/linux/oc.tar'] [utilities.infra] name=utilities.infra 2026-07-07T05:27:21.849446Z [info ] Downloading archive using: url=https://downloads-openshift-console.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com/amd64/linux/oc.tar [utilities.infra] name=utilities.infra 2026-07-07T05:27:22.566152Z [info ] Extract the downloaded archive. [utilities.infra] name=utilities.infra 2026-07-07T05:27:22.673686Z [info ] Downloaded file: ['oc']  [utilities.infra] name=utilities.infra 2026-07-07T05:27:22.692970Z [info ] Executing session fixture: bin_directory_to_os_path [conftest] 2026-07-07T05:27:22.691966Z [info ] OC binary path: /tmp/pytest-VREPCLdQDZUB6aquvz97S9/bin0/oc [tests.conftest] name=tests.conftest 2026-07-07T05:27:22.692023Z [info ] Adding /tmp/pytest-VREPCLdQDZUB6aquvz97S9/bin0 to $PATH [tests.conftest] name=tests.conftest 2026-07-07T05:27:22.693506Z [info ] Executing session fixture: nodes [conftest] 2026-07-07T05:27:23.921409Z [info ] Executing session fixture: dsci_resource [conftest] 2026-07-07T05:27:23.921556Z [info ] kind: DSCInitialization api version: dscinitialization.opendatahub.io/v2 [ocp_resources.resource] 2026-07-07T05:27:23.942399Z [info ] Executing session fixture: record_testsuite_property [conftest] 2026-07-07T05:27:23.942560Z [info ] Executing session fixture: junitxml_plugin [conftest] 2026-07-07T05:27:23.942696Z [info ] Executing session fixture: cluster_sanity_scope_session [conftest] 2026-07-07T05:27:23.941717Z [info ] Check cluster sanity.  [utilities.infra] name=utilities.infra 2026-07-07T05:27:23.942960Z [info ] Verify all nodes are in a healthy condition. [ocp_utilities.infra] 2026-07-07T05:27:23.997635Z [info ] Verify all nodes are schedulable. [ocp_utilities.infra] 2026-07-07T05:27:24.052735Z [warning ] Skipping RHOAI resource checks, got --cluster-sanity-skip-rhoai-check [utilities.infra] name=utilities.infra 2026-07-07T05:27:24.054003Z [info ] Executing session fixture: autouse_fixtures [conftest] 2026-07-07T05:27:24.054156Z [info ] Executing session fixture: maas_gateway_api_hostname [conftest] 2026-07-07T05:27:24.054284Z [info ] kind: Ingress api version: config.openshift.io/v1 [ocp_resources.resource] 2026-07-07T05:27:24.090899Z [info ] Executing session fixture: maas_gateway_api [conftest] 2026-07-07T05:27:24.118629Z [info ] kind: Gateway api version: gateway.networking.k8s.io/v1 [ocp_resources.resource] 2026-07-07T05:27:24.137485Z [info ] Reusing existing gateway openshift-ingress/maas-default-gateway [conftest] name=conftest 2026-07-07T05:27:24.138257Z [info ] Wait for Gateway/maas-default-gateway's 'Programmed' condition to be 'True' [ocp_resources Gateway] 2026-07-07T05:27:24.138415Z [info ] Wait until Gateway maas-default-gateway is created [ocp_resources Gateway] 2026-07-07T05:27:24.138547Z [info ] Waiting for 300 seconds [0:05:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-07T05:27:24.157261Z [info ] Elapsed time: 4.315376281738281e-05 [0:00:00.000043] [timeout_sampler] 2026-07-07T05:27:24.157428Z [info ] Waiting for 299.980783700943 seconds [0:04:59.980784], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-07T05:27:24.176882Z [info ] Elapsed time: 4.220008850097656e-05 [0:00:00.000042] [timeout_sampler] 2026-07-07T05:27:24.177039Z [info ] ResourceEdit: Backing up old data [ocp_resources.resource] 2026-07-07T05:27:24.198726Z [info ] ResourceEdits: Updating data for resource Gateway maas-default-gateway [ocp_resources.resource] 2026-07-07T05:27:24.198896Z [info ] Update Gateway maas-default-gateway: {'metadata': {'annotations': {'security.opendatahub.io/authorino-tls-bootstrap': 'true'}, 'name': 'maas-default-gateway'}} [ocp_resources Gateway] 2026-07-07T05:27:24.227567Z [info ] Executing session fixture: pytestconfig [conftest] 2026-07-07T05:27:24.227701Z [info ] Executing session fixture: use_unprivileged_client [conftest] 2026-07-07T05:27:24.227822Z [info ] Executing session fixture: kubconfig_filepath [conftest] 2026-07-07T05:27:24.227939Z [info ] Executing session fixture: cluster_authentication [conftest] 2026-07-07T05:27:24.228063Z [info ] kind: Authentication api version: config.openshift.io/v1 [ocp_resources.resource] 2026-07-07T05:27:24.245374Z [info ] Executing session fixture: is_byoidc [conftest] 2026-07-07T05:27:24.264257Z [info ] Executing session fixture: non_admin_user_password [conftest] 2026-07-07T05:27:24.299611Z [info ] Executing session fixture: unprivileged_client [conftest] 2026-07-07T05:27:24.299816Z [info ] Running oc whoami command  [pyhelper_utils.shell] 2026-07-07T05:27:24.428827Z [info ] Running Hide By User command  [pyhelper_utils.shell] 2026-07-07T05:27:25.238661Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] 2026-07-07T05:27:25.504648Z [info ] Executing session fixture: maas_subscription_namespace [conftest] 2026-07-07T05:27:25.521981Z [info ] Namespace models-as-a-service already exists, reusing it [conftest] name=conftest 2026-07-07T05:27:25.523270Z [info ] Executing session fixture: maas_subscription_controller_enabled_latest [conftest] 2026-07-07T05:27:25.523408Z [info ] ResourceEdit: Backing up old data [ocp_resources.resource] 2026-07-07T05:27:25.543674Z [info ] ResourceEdits: Updating data for resource DataScienceCluster default-dsc [ocp_resources.resource] 2026-07-07T05:27:25.543818Z [info ] Update DataScienceCluster default-dsc: {'spec': {'components': {'kserve': {'modelsAsService': {'managementState': 'Managed'}}}}, 'metadata': {'name': 'default-dsc'}} [ocp_resources DataScienceCluster] 2026-07-07T05:27:25.624943Z [info ] Wait for DataScienceCluster/default-dsc's 'ModelsAsServiceReady' condition to be 'True' [ocp_resources DataScienceCluster] 2026-07-07T05:27:25.625275Z [info ] Wait until DataScienceCluster default-dsc is created [ocp_resources DataScienceCluster] 2026-07-07T05:27:25.625396Z [info ] Waiting for 900 seconds [0:15:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-07T05:27:25.643998Z [info ] Elapsed time: 4.363059997558594e-05 [0:00:00.000044] [timeout_sampler] 2026-07-07T05:27:25.644229Z [info ] Waiting for 899.9806327819824 seconds [0:14:59.980633], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-07T05:27:25.665277Z [info ] Elapsed time: 3.218650817871094e-05 [0:00:00.000032] [timeout_sampler] 2026-07-07T05:27:25.665421Z [info ] Wait for DataScienceCluster/default-dsc's 'Ready' condition to be 'True' [ocp_resources DataScienceCluster] 2026-07-07T05:27:25.665540Z [info ] Wait until DataScienceCluster default-dsc is created [ocp_resources DataScienceCluster] 2026-07-07T05:27:25.665664Z [info ] Waiting for 600 seconds [0:10:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-07T05:27:25.685225Z [info ] Elapsed time: 2.765655517578125e-05 [0:00:00.000028] [timeout_sampler] 2026-07-07T05:27:25.685372Z [info ] Waiting for 599.9800198078156 seconds [0:09:59.980020], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-07T05:27:25.705607Z [info ] Elapsed time: 3.218650817871094e-05 [0:00:00.000032] [timeout_sampler] 2026-07-07T05:27:25.705778Z [info ] Executing session fixture: request_session_http [conftest] 2026-07-07T05:27:25.705930Z [info ] Executing session fixture: authorino_tls_configured [conftest] 2026-07-07T05:27:25.706083Z [info ] kind: Deployment api version: apps/v1 [ocp_resources.resource] 2026-07-07T05:27:25.742920Z [info ] authorino_tls_configured: configuring TLS in kuadrant-system [conftest] name=conftest 2026-07-07T05:27:25.789645Z [info ] kind: Authorino api version: operator.authorino.kuadrant.io/v1beta1 --- [DuplicateFilter: Last log `kind: Deployment api version: apps/v1` repeated 2 times] [ocp_resources.resource] 2026-07-07T05:27:25.789845Z [info ] ResourceEdit: Backing up old data [ocp_resources.resource] 2026-07-07T05:27:25.845206Z [info ] ResourceEdits: Updating data for resource Service authorino-authorino-authorization [ocp_resources.resource] 2026-07-07T05:27:25.845369Z [info ] Update Service authorino-authorino-authorization: {'metadata': {'annotations': {'service.beta.openshift.io/serving-cert-secret-name': 'authorino-server-cert'}, 'name': 'authorino-authorino-authorization'}} [ocp_resources Service] 2026-07-07T05:27:25.868631Z [info ] ResourceEdits: Updating data for resource Deployment authorino [ocp_resources.resource] 2026-07-07T05:27:25.868798Z [info ] Update Deployment authorino: {'spec': {'template': {'spec': {'containers': [{'name': 'authorino', 'image': 'registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a', 'env': [{'name': 'SSL_CERT_FILE', 'value': '/etc/ssl/certs/openshift-service-ca/service-ca-bundle.crt'}, {'name': 'REQUESTS_CA_BUNDLE', 'value': '/etc/ssl/certs/openshift-service-ca/service-ca-bundle.crt'}]}]}}}, 'metadata': {'name': 'authorino'}} [ocp_resources Deployment] 2026-07-07T05:27:25.896152Z [info ] ResourceEdits: Updating data for resource Authorino authorino [ocp_resources.resource] 2026-07-07T05:27:25.896346Z [info ] Update Authorino authorino: {'spec': {'listener': {'tls': {'enabled': True, 'certSecretRef': {'name': 'authorino-server-cert'}}}}, 'metadata': {'name': 'authorino'}} [ocp_resources Authorino] 2026-07-07T05:27:25.919903Z [info ] Wait for Deployment/authorino's 'Available' condition to be 'True' [ocp_resources Deployment] 2026-07-07T05:27:25.920099Z [info ] Wait until Deployment authorino is created [ocp_resources Deployment] 2026-07-07T05:27:25.920328Z [info ] Waiting for 120 seconds [0:02:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-07T05:27:25.938227Z [info ] Elapsed time: 4.696846008300781e-05 [0:00:00.000047] [timeout_sampler] 2026-07-07T05:27:25.938403Z [info ] Waiting for 119.98173022270203 seconds [0:01:59.981730], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-07T05:27:25.956856Z [info ] Elapsed time: 3.528594970703125e-05 [0:00:00.000035] [timeout_sampler] 2026-07-07T05:27:25.955418Z [info ] authorino_tls_configured: TLS configuration applied, rollout complete [conftest] name=conftest 2026-07-07T05:27:25.957101Z [info ] Executing class fixture: maas_unprivileged_model_namespace [conftest] 2026-07-07T05:27:25.957248Z [info ] kind: ProjectRequest api version: project.openshift.io/v1 [ocp_resources.resource] 2026-07-07T05:27:25.957357Z [info ] Create ProjectRequest llm  [ocp_resources ProjectRequest] 2026-07-07T05:27:25.957462Z [info ] Posting {'apiVersion': 'project.openshift.io/v1', 'kind': 'ProjectRequest', 'metadata': {'name': 'llm'}} [ocp_resources ProjectRequest] 2026-07-07T05:27:26.230567Z [info ] kind: Project api version: project.openshift.io/v1 [ocp_resources.resource] 2026-07-07T05:27:26.230799Z [info ] Wait for Project llm status to be Active [ocp_resources Project] 2026-07-07T05:27:26.230938Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_status.lambda: self.exists) [timeout_sampler] 2026-07-07T05:27:26.288493Z [info ] Status of Project llm is Active [ocp_resources Project] 2026-07-07T05:27:26.288647Z [info ] Elapsed time: 3.933906555175781e-05 [0:00:00.000039] [timeout_sampler] 2026-07-07T05:27:26.288783Z [info ] Executing class fixture: maas_scheme [conftest] 2026-07-07T05:27:26.345681Z [info ] kind: LLMInferenceService api version: serving.kserve.io/v1alpha2 [ocp_resources.resource] 2026-07-07T05:27:26.375815Z [info ] Executing class fixture: maas_host [conftest] 2026-07-07T05:27:26.376024Z [info ] kind: Ingress api version: config.openshift.io/v1 [ocp_resources.resource] 2026-07-07T05:27:26.421867Z [info ] Executing class fixture: base_url [conftest] 2026-07-07T05:27:26.422391Z [info ] Executing class fixture: maas_api_deployment_available [conftest] 2026-07-07T05:27:26.422523Z [info ] kind: Deployment api version: apps/v1 [ocp_resources.resource] 2026-07-07T05:27:26.443584Z [info ] Wait for Deployment/maas-api's 'Available' condition to be 'True' [ocp_resources Deployment] 2026-07-07T05:27:26.443733Z [info ] Wait until Deployment maas-api is created [ocp_resources Deployment] 2026-07-07T05:27:26.443886Z [info ] Waiting for 600 seconds [0:10:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-07T05:27:26.462263Z [info ] Elapsed time: 9.441375732421875e-05 [0:00:00.000094] [timeout_sampler] 2026-07-07T05:27:26.462394Z [info ] Waiting for 599.9811799526215 seconds [0:09:59.981180], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-07T05:27:26.482233Z [info ] Elapsed time: 3.170967102050781e-05 [0:00:00.000032] [timeout_sampler] 2026-07-07T05:27:26.482386Z [info ] Executing class fixture: maas_api_endpoints_ready [conftest] 2026-07-07T05:27:26.482528Z [info ] Waiting for 300 seconds [0:05:00], retry every 5 seconds. (Function: tests.model_serving.maas_billing.utils.endpoints_have_ready_addresses Kwargs: {'admin_client': , 'namespace': 'redhat-ods-applications', 'name': 'maas-api'}) [timeout_sampler] 2026-07-07T05:27:26.524136Z [info ] Elapsed time: 3.266334533691406e-05 [0:00:00.000033] [timeout_sampler] 2026-07-07T05:27:26.524299Z [info ] Executing class fixture: maas_api_gateway_reachable [conftest] 2026-07-07T05:27:26.524432Z [info ] Waiting for 300 seconds [0:05:00], retry every 5 seconds. (Function: tests.model_serving.maas_billing.utils.gateway_probe_reaches_maas_api Kwargs: {'http_session': , 'probe_url': 'https://maas.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com/maas-api/v1/models', 'request_timeout_seconds': 30}) [timeout_sampler] 2026-07-07T05:27:26.649332Z [info ] Received 401 response from https://maas.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com/maas-api/v1/models,  [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-07-07T05:27:26.650356Z [info ] Elapsed time: 8.153915405273438e-05 [0:00:00.000082] [timeout_sampler] 2026-07-07T05:27:26.650468Z [info ] Executing class fixture: minimal_subscription_for_free_user [conftest] 2026-07-07T05:27:26.678335Z [info ] kind: MaaSModelRef api version: maas.opendatahub.io/v1alpha1 [ocp_resources.resource] 2026-07-07T05:27:26.678507Z [info ] Create MaaSModelRef e2e-authz-model-45f60359 [ocp_resources MaaSModelRef] 2026-07-07T05:27:26.678712Z [info ] Posting {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'kind': 'MaaSModelRef', 'metadata': {'name': 'e2e-authz-model-45f60359', 'namespace': 'llm'}, 'spec': {'modelRef': {'name': 'e2e-authz-model-45f60359', 'namespace': 'llm', 'kind': 'LLMInferenceService'}}} [ocp_resources MaaSModelRef] 2026-07-07T05:27:26.720412Z [info ] Wait until MaaSModelRef e2e-authz-model-45f60359 is created [ocp_resources MaaSModelRef] 2026-07-07T05:27:26.720557Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-07T05:27:26.738745Z [info ] Elapsed time: 7.200241088867188e-05 [0:00:00.000072] [timeout_sampler] 2026-07-07T05:27:26.738896Z [info ] kind: MaaSSubscription api version: maas.opendatahub.io/v1alpha1 [ocp_resources.resource] 2026-07-07T05:27:26.739054Z [info ] Create MaaSSubscription e2e-authz-free-sub-04031d1a [ocp_resources MaaSSubscription] 2026-07-07T05:27:26.739275Z [info ] Posting {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'kind': 'MaaSSubscription', 'metadata': {'name': 'e2e-authz-free-sub-04031d1a', 'namespace': 'models-as-a-service'}, 'spec': {'modelRefs': [{'name': 'e2e-authz-model-45f60359', 'namespace': 'llm', 'tokenRateLimits': [{'limit': 1000, 'window': '1m'}]}], 'owner': {'groups': [{'name': 'system:authenticated'}]}, 'priority': 0}} [ocp_resources MaaSSubscription] 2026-07-07T05:27:26.777863Z [info ] Wait until MaaSSubscription e2e-authz-free-sub-04031d1a is created [ocp_resources MaaSSubscription] 2026-07-07T05:27:26.778035Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-07T05:27:26.798693Z [info ] Elapsed time: 3.409385681152344e-05 [0:00:00.000034] [timeout_sampler] --------------------------------------------------------- CALL --------------------------------------------------------- 2026-07-07T05:27:26.840354Z [info ] kind: AuthPolicy api version: kuadrant.io/v1 [ocp_resources.resource] PASSED2026-07-07T05:27:26.877629Z [info ] get_auth_policy_callback_url: policy='maas-api-auth-policy' url='https://maas-api.redhat-ods-applications.svc.cluster.local:8443/internal/v1/api-keys/validate' [tests.model_serving.maas_billing.maas_api_key.utils] name=tests.model_serving.maas_billing.maas_api_key.utils 2026-07-07T05:27:26.877695Z [info ] AuthPolicy callback URL correctly uses namespace 'redhat-ods-applications': https://maas-api.redhat-ods-applications.svc.cluster.local:8443/internal/v1/api-keys/validate [_pytest.compat] name=maas_api_key.test_api_key_auth_policy_validation  TEST: TestAuthPolicyApiKeyValidation.test_auth_policy_callback_url_uses_correct_namespace STATUS: PASSED ------------------------------------------------------- TEARDOWN ------------------------------------------------------- 2026-07-07T05:27:26.883305Z [info ] Delete MaaSSubscription e2e-authz-free-sub-04031d1a [ocp_resources MaaSSubscription] 2026-07-07T05:27:26.922555Z [info ] Deleting {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'kind': 'MaaSSubscription', 'metadata': {'creationTimestamp': '2026-07-07T05:27:26Z', 'finalizers': ['maas.opendatahub.io/subscription-cleanup'], 'generation': 1, 'managedFields': [{'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'.': {}, 'f:modelRefs': {}, 'f:owner': {'.': {}, 'f:groups': {}}, 'f:priority': {}}}, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': '2026-07-07T05:27:26Z'}, {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:finalizers': {'.': {}, 'v:"maas.opendatahub.io/subscription-cleanup"': {}}}}, 'manager': 'manager', 'operation': 'Update', 'time': '2026-07-07T05:27:26Z'}, {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'.': {}, 'f:conditions': {}, 'f:modelRefStatuses': {}, 'f:phase': {}, 'f:tokenRateLimitStatuses': {}}}, 'manager': 'manager', 'operation': 'Update', 'subresource': 'status', 'time': '2026-07-07T05:27:26Z'}], 'name': 'e2e-authz-free-sub-04031d1a', 'namespace': 'models-as-a-service', 'resourceVersion': '18303852', 'uid': '34517221-4602-4199-aefa-3e4ceb548a88'}, 'spec': {'modelRefs': [{'name': 'e2e-authz-model-45f60359', 'namespace': 'llm', 'tokenRateLimits': [{'limit': 1000, 'window': '1m'}]}], 'owner': {'groups': [{'name': 'system:authenticated'}]}, 'priority': 0}, 'status': {'conditions': [{'lastTransitionTime': '2026-07-07T05:27:26Z', 'message': 'all 1 model references are invalid or unavailable', 'observedGeneration': 1, 'reason': 'ReconcileFailed', 'status': 'False', 'type': 'Ready'}], 'modelRefStatuses': [{'message': 'HTTPRoute not found yet; TokenRateLimitPolicy cannot be created: HTTPRoute not found yet: for LLMInferenceService e2e-authz-model-45f60359 in namespace llm', 'name': 'e2e-authz-model-45f60359', 'namespace': 'llm', 'ready': False, 'reason': 'NotFound'}], 'phase': 'Failed', 'tokenRateLimitStatuses': [{'message': 'HTTPRoute not found yet; TokenRateLimitPolicy cannot be created: HTTPRoute not found yet: for LLMInferenceService e2e-authz-model-45f60359 in namespace llm', 'model': 'e2e-authz-model-45f60359', 'name': 'maas-trlp-e2e-authz-model-45f60359', 'namespace': 'llm', 'ready': False, 'reason': 'BackendNotReady'}]}} [ocp_resources MaaSSubscription] 2026-07-07T05:27:26.948044Z [info ] Wait until MaaSSubscription e2e-authz-free-sub-04031d1a is deleted [ocp_resources MaaSSubscription] 2026-07-07T05:27:26.948227Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-07-07T05:27:27.992593Z [info ] Elapsed time: 1.0223441123962402 [0:00:01.022344] [timeout_sampler] 2026-07-07T05:27:27.992818Z [info ] Delete MaaSModelRef e2e-authz-model-45f60359 [ocp_resources MaaSModelRef] 2026-07-07T05:27:28.034238Z [info ] Deleting {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'kind': 'MaaSModelRef', 'metadata': {'creationTimestamp': '2026-07-07T05:27:26Z', 'finalizers': ['maas.opendatahub.io/model-cleanup'], 'generation': 1, 'managedFields': [{'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'.': {}, 'f:modelRef': {'.': {}, 'f:kind': {}, 'f:name': {}}}}, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': '2026-07-07T05:27:26Z'}, {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:finalizers': {'.': {}, 'v:"maas.opendatahub.io/model-cleanup"': {}}}}, 'manager': 'manager', 'operation': 'Update', 'time': '2026-07-07T05:27:26Z'}, {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'.': {}, 'f:conditions': {}, 'f:phase': {}}}, 'manager': 'manager', 'operation': 'Update', 'subresource': 'status', 'time': '2026-07-07T05:27:26Z'}], 'name': 'e2e-authz-model-45f60359', 'namespace': 'llm', 'resourceVersion': '18303847', 'uid': 'db44be79-aef2-4165-adce-cf3f3be450fe'}, 'spec': {'modelRef': {'kind': 'LLMInferenceService', 'name': 'e2e-authz-model-45f60359'}}, 'status': {'conditions': [{'lastTransitionTime': '2026-07-07T05:27:26Z', 'message': 'Waiting for HTTPRoute to be created', 'observedGeneration': 1, 'reason': 'BackendNotReady', 'status': 'False', 'type': 'Ready'}], 'phase': 'Pending'}} [ocp_resources MaaSModelRef] 2026-07-07T05:27:28.057888Z [info ] Wait until MaaSModelRef e2e-authz-model-45f60359 is deleted [ocp_resources MaaSModelRef] 2026-07-07T05:27:28.058063Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-07-07T05:27:29.098688Z [info ] Elapsed time: 1.0181961059570312 [0:00:01.018196] [timeout_sampler] 2026-07-07T05:27:29.117684Z [info ] Delete Project llm  [ocp_resources Project] 2026-07-07T05:27:29.167237Z [info ] Deleting {'kind': 'Project', 'apiVersion': 'project.openshift.io/v1', 'metadata': {'name': 'llm', 'uid': '03de3c0b-69cc-4b4a-9a1b-38a596b458ae', 'resourceVersion': '18303805', 'creationTimestamp': '2026-07-07T05:27:26Z', 'labels': {'kubernetes.io/metadata.name': 'llm', 'pod-security.kubernetes.io/audit': 'restricted', 'pod-security.kubernetes.io/audit-version': 'latest', 'pod-security.kubernetes.io/warn': 'restricted', 'pod-security.kubernetes.io/warn-version': 'latest'}, 'annotations': {'openshift.io/description': '', 'openshift.io/display-name': '', 'openshift.io/requester': 'htpasswd-cluster-admin-user', 'openshift.io/sa.scc.mcs': 's0:c33,c7', 'openshift.io/sa.scc.supplemental-groups': '1001070000/10000', 'openshift.io/sa.scc.uid-range': '1001070000/10000', 'security.openshift.io/MinimallySufficientPodSecurityStandard': 'restricted'}, 'managedFields': [{'manager': 'cluster-policy-controller', 'operation': 'Apply', 'apiVersion': 'v1', 'time': '2026-07-07T05:27:26Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:openshift.io/sa.scc.mcs': {}, 'f:openshift.io/sa.scc.supplemental-groups': {}, 'f:openshift.io/sa.scc.uid-range': {}}}}}, {'manager': 'pod-security-admission-label-synchronization-controller', 'operation': 'Apply', 'apiVersion': 'v1', 'time': '2026-07-07T05:27:26Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:security.openshift.io/MinimallySufficientPodSecurityStandard': {}}, 'f:labels': {'f:pod-security.kubernetes.io/audit': {}, 'f:pod-security.kubernetes.io/audit-version': {}, 'f:pod-security.kubernetes.io/warn': {}, 'f:pod-security.kubernetes.io/warn-version': {}}}}}, {'manager': 'openshift-apiserver', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-07T05:27:26Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:openshift.io/description': {}, 'f:openshift.io/display-name': {}, 'f:openshift.io/requester': {}}, 'f:labels': {'.': {}, 'f:kubernetes.io/metadata.name': {}}}}}, {'manager': 'openshift-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-07T05:27:26Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'f:finalizers': {}}}, 'subresource': 'finalize'}]}, 'spec': {'finalizers': ['kubernetes']}, 'status': {'phase': 'Active'}} [ocp_resources Project] 2026-07-07T05:27:29.208925Z [info ] Wait until Project llm is deleted [ocp_resources Project] 2026-07-07T05:27:29.209095Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] _ 1 of 2 completed, 1 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _ tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py::TestOIDCTokenFlow::test_oidc_token_creates_api_key 2026-07-07T05:27:38.488365Z [info ] Elapsed time: 9.225249767303467 [0:00:09.225250] [timeout_sampler]  ------------------------------------------- test_oidc_token_creates_api_key ------------------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-07-07T05:27:38.490932Z [info ] Executing class fixture: maas_unprivileged_model_namespace [conftest] 2026-07-07T05:27:38.491079Z [info ] kind: ProjectRequest api version: project.openshift.io/v1 [ocp_resources.resource] 2026-07-07T05:27:38.491250Z [info ] Create ProjectRequest llm  [ocp_resources ProjectRequest] 2026-07-07T05:27:38.491360Z [info ] Posting {'apiVersion': 'project.openshift.io/v1', 'kind': 'ProjectRequest', 'metadata': {'name': 'llm'}} [ocp_resources ProjectRequest] 2026-07-07T05:27:38.849257Z [info ] kind: Project api version: project.openshift.io/v1 [ocp_resources.resource] 2026-07-07T05:27:38.849406Z [info ] Wait for Project llm status to be Active [ocp_resources Project] 2026-07-07T05:27:38.850035Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_status.lambda: self.exists) [timeout_sampler] 2026-07-07T05:27:38.901636Z [info ] Status of Project llm is Active [ocp_resources Project] 2026-07-07T05:27:38.901795Z [info ] Elapsed time: 3.552436828613281e-05 [0:00:00.000036] [timeout_sampler] 2026-07-07T05:27:38.901941Z [info ] Executing class fixture: oidc_subscription [conftest] 2026-07-07T05:27:38.902083Z [info ] kind: MaaSModelRef api version: maas.opendatahub.io/v1alpha1 [ocp_resources.resource] 2026-07-07T05:27:38.902263Z [info ] Create MaaSModelRef e2e-authz-model-c94500e8 [ocp_resources MaaSModelRef] 2026-07-07T05:27:38.902386Z [info ] Posting {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'kind': 'MaaSModelRef', 'metadata': {'name': 'e2e-authz-model-c94500e8', 'namespace': 'llm'}, 'spec': {'modelRef': {'name': 'e2e-authz-model-c94500e8', 'namespace': 'llm', 'kind': 'LLMInferenceService'}}} [ocp_resources MaaSModelRef] 2026-07-07T05:27:38.996800Z [info ] Wait until MaaSModelRef e2e-authz-model-c94500e8 is created [ocp_resources MaaSModelRef] 2026-07-07T05:27:38.996960Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-07T05:27:39.014869Z [info ] Elapsed time: 4.553794860839844e-05 [0:00:00.000046] [timeout_sampler] 2026-07-07T05:27:39.015028Z [info ] kind: MaaSSubscription api version: maas.opendatahub.io/v1alpha1 [ocp_resources.resource] 2026-07-07T05:27:39.015228Z [info ] Create MaaSSubscription e2e-oidc-sub-61dff175 [ocp_resources MaaSSubscription] 2026-07-07T05:27:39.015426Z [info ] Posting {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'kind': 'MaaSSubscription', 'metadata': {'name': 'e2e-oidc-sub-61dff175', 'namespace': 'models-as-a-service'}, 'spec': {'modelRefs': [{'name': 'e2e-authz-model-c94500e8', 'namespace': 'llm', 'tokenRateLimits': [{'limit': 1000, 'window': '1m'}]}], 'owner': {'groups': [{'name': 'maas-users'}]}, 'priority': 0}} [ocp_resources MaaSSubscription] 2026-07-07T05:27:39.059636Z [info ] Wait until MaaSSubscription e2e-oidc-sub-61dff175 is created [ocp_resources MaaSSubscription] 2026-07-07T05:27:39.059793Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-07T05:27:39.084078Z [info ] Elapsed time: 5.7697296142578125e-05 [0:00:00.000058] [timeout_sampler] 2026-07-07T05:27:39.084257Z [info ] Executing class fixture: maas_scheme [conftest] 2026-07-07T05:27:39.107658Z [info ] Executing class fixture: maas_host [conftest] 2026-07-07T05:27:39.107808Z [info ] kind: Ingress api version: config.openshift.io/v1 [ocp_resources.resource] 2026-07-07T05:27:39.147760Z [info ] Executing class fixture: base_url [conftest] 2026-07-07T05:27:39.147918Z [info ] Executing class fixture: maas_api_deployment_available [conftest] 2026-07-07T05:27:39.148136Z [info ] kind: Deployment api version: apps/v1 [ocp_resources.resource] 2026-07-07T05:27:39.170689Z [info ] Wait for Deployment/maas-api's 'Available' condition to be 'True' [ocp_resources Deployment] 2026-07-07T05:27:39.170855Z [info ] Wait until Deployment maas-api is created [ocp_resources Deployment] 2026-07-07T05:27:39.170997Z [info ] Waiting for 600 seconds [0:10:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-07T05:27:39.190090Z [info ] Elapsed time: 2.9802322387695312e-05 [0:00:00.000030] [timeout_sampler] 2026-07-07T05:27:39.190325Z [info ] Waiting for 599.9805870056152 seconds [0:09:59.980587], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-07T05:27:39.222207Z [info ] Elapsed time: 4.220008850097656e-05 [0:00:00.000042] [timeout_sampler] 2026-07-07T05:27:39.222344Z [info ] Executing class fixture: maas_api_endpoints_ready [conftest] 2026-07-07T05:27:39.222460Z [info ] Waiting for 300 seconds [0:05:00], retry every 5 seconds. (Function: tests.model_serving.maas_billing.utils.endpoints_have_ready_addresses Kwargs: {'admin_client': , 'namespace': 'redhat-ods-applications', 'name': 'maas-api'}) [timeout_sampler] 2026-07-07T05:27:39.264184Z [info ] Elapsed time: 3.0040740966796875e-05 [0:00:00.000030] [timeout_sampler] 2026-07-07T05:27:39.264333Z [info ] Executing class fixture: maas_api_gateway_reachable [conftest] 2026-07-07T05:27:39.264456Z [info ] Waiting for 300 seconds [0:05:00], retry every 5 seconds. (Function: tests.model_serving.maas_billing.utils.gateway_probe_reaches_maas_api Kwargs: {'http_session': , 'probe_url': 'https://maas.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com/maas-api/v1/models', 'request_timeout_seconds': 30}) [timeout_sampler] 2026-07-07T05:27:39.284807Z [info ] Received 401 response from https://maas.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com/maas-api/v1/models,  [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-07-07T05:27:39.285995Z [info ] Elapsed time: 4.506111145019531e-05 [0:00:00.000045] [timeout_sampler] SKIPPED2026-07-07T05:27:39.287328Z [info ] Executing class fixture: oidc_auth_policy_patched [conftest]  TEST: TestOIDCTokenFlow.test_oidc_token_creates_api_key STATUS: SKIPPED ------------------------------------------------------- TEARDOWN ------------------------------------------------------- 2026-07-07T05:27:39.287711Z [info ] Delete MaaSSubscription e2e-oidc-sub-61dff175 [ocp_resources MaaSSubscription] 2026-07-07T05:27:39.327839Z [info ] Deleting {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'kind': 'MaaSSubscription', 'metadata': {'creationTimestamp': '2026-07-07T05:27:39Z', 'finalizers': ['maas.opendatahub.io/subscription-cleanup'], 'generation': 1, 'managedFields': [{'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'.': {}, 'f:modelRefs': {}, 'f:owner': {'.': {}, 'f:groups': {}}, 'f:priority': {}}}, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': '2026-07-07T05:27:39Z'}, {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:finalizers': {'.': {}, 'v:"maas.opendatahub.io/subscription-cleanup"': {}}}}, 'manager': 'manager', 'operation': 'Update', 'time': '2026-07-07T05:27:39Z'}, {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'.': {}, 'f:conditions': {}, 'f:modelRefStatuses': {}, 'f:phase': {}, 'f:tokenRateLimitStatuses': {}}}, 'manager': 'manager', 'operation': 'Update', 'subresource': 'status', 'time': '2026-07-07T05:27:39Z'}], 'name': 'e2e-oidc-sub-61dff175', 'namespace': 'models-as-a-service', 'resourceVersion': '18304149', 'uid': 'c3e45f34-40b1-440b-a2f1-ff973b38439c'}, 'spec': {'modelRefs': [{'name': 'e2e-authz-model-c94500e8', 'namespace': 'llm', 'tokenRateLimits': [{'limit': 1000, 'window': '1m'}]}], 'owner': {'groups': [{'name': 'maas-users'}]}, 'priority': 0}, 'status': {'conditions': [{'lastTransitionTime': '2026-07-07T05:27:39Z', 'message': '', 'observedGeneration': 1, 'reason': 'NoDuplicatePeers', 'status': 'False', 'type': 'SpecPriorityDuplicate'}, {'lastTransitionTime': '2026-07-07T05:27:39Z', 'message': 'all 1 model references are invalid or unavailable', 'observedGeneration': 1, 'reason': 'ReconcileFailed', 'status': 'False', 'type': 'Ready'}], 'modelRefStatuses': [{'message': 'HTTPRoute not found yet; TokenRateLimitPolicy cannot be created: HTTPRoute not found yet: for LLMInferenceService e2e-authz-model-c94500e8 in namespace llm', 'name': 'e2e-authz-model-c94500e8', 'namespace': 'llm', 'ready': False, 'reason': 'NotFound'}], 'phase': 'Failed', 'tokenRateLimitStatuses': [{'message': 'HTTPRoute not found yet; TokenRateLimitPolicy cannot be created: HTTPRoute not found yet: for LLMInferenceService e2e-authz-model-c94500e8 in namespace llm', 'model': 'e2e-authz-model-c94500e8', 'name': 'maas-trlp-e2e-authz-model-c94500e8', 'namespace': 'llm', 'ready': False, 'reason': 'BackendNotReady'}]}} [ocp_resources MaaSSubscription] 2026-07-07T05:27:39.353697Z [info ] Wait until MaaSSubscription e2e-oidc-sub-61dff175 is deleted [ocp_resources MaaSSubscription] 2026-07-07T05:27:39.353847Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-07-07T05:27:40.415427Z [info ] Elapsed time: 1.0196809768676758 [0:00:01.019681] [timeout_sampler] 2026-07-07T05:27:40.415575Z [info ] Delete MaaSModelRef e2e-authz-model-c94500e8 [ocp_resources MaaSModelRef] 2026-07-07T05:27:40.534841Z [info ] Deleting {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'kind': 'MaaSModelRef', 'metadata': {'creationTimestamp': '2026-07-07T05:27:38Z', 'finalizers': ['maas.opendatahub.io/model-cleanup'], 'generation': 1, 'managedFields': [{'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'.': {}, 'f:modelRef': {'.': {}, 'f:kind': {}, 'f:name': {}}}}, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': '2026-07-07T05:27:38Z'}, {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:finalizers': {'.': {}, 'v:"maas.opendatahub.io/model-cleanup"': {}}}}, 'manager': 'manager', 'operation': 'Update', 'time': '2026-07-07T05:27:38Z'}, {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'.': {}, 'f:conditions': {}, 'f:phase': {}}}, 'manager': 'manager', 'operation': 'Update', 'subresource': 'status', 'time': '2026-07-07T05:27:38Z'}], 'name': 'e2e-authz-model-c94500e8', 'namespace': 'llm', 'resourceVersion': '18304136', 'uid': 'f8304e44-205e-4a3f-9f0f-8c562dfe8933'}, 'spec': {'modelRef': {'kind': 'LLMInferenceService', 'name': 'e2e-authz-model-c94500e8'}}, 'status': {'conditions': [{'lastTransitionTime': '2026-07-07T05:27:38Z', 'message': 'Waiting for HTTPRoute to be created', 'observedGeneration': 1, 'reason': 'BackendNotReady', 'status': 'False', 'type': 'Ready'}], 'phase': 'Pending'}} [ocp_resources MaaSModelRef] 2026-07-07T05:27:40.606808Z [info ] Wait until MaaSModelRef e2e-authz-model-c94500e8 is deleted [ocp_resources MaaSModelRef] 2026-07-07T05:27:40.606980Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-07-07T05:27:41.755697Z [info ] Elapsed time: 1.107635259628296 [0:00:01.107635] [timeout_sampler] 2026-07-07T05:27:41.801797Z [info ] Delete Project llm  [ocp_resources Project] 2026-07-07T05:27:41.905030Z [info ] Deleting {'kind': 'Project', 'apiVersion': 'project.openshift.io/v1', 'metadata': {'name': 'llm', 'uid': '83a8ff34-b8c3-4b36-a58b-3af7f1dbe03b', 'resourceVersion': '18304122', 'creationTimestamp': '2026-07-07T05:27:38Z', 'labels': {'kubernetes.io/metadata.name': 'llm', 'pod-security.kubernetes.io/audit': 'restricted', 'pod-security.kubernetes.io/audit-version': 'latest', 'pod-security.kubernetes.io/warn': 'restricted', 'pod-security.kubernetes.io/warn-version': 'latest'}, 'annotations': {'openshift.io/description': '', 'openshift.io/display-name': '', 'openshift.io/requester': 'htpasswd-cluster-admin-user', 'openshift.io/sa.scc.mcs': 's0:c33,c17', 'openshift.io/sa.scc.supplemental-groups': '1001090000/10000', 'openshift.io/sa.scc.uid-range': '1001090000/10000', 'security.openshift.io/MinimallySufficientPodSecurityStandard': 'restricted'}, 'managedFields': [{'manager': 'cluster-policy-controller', 'operation': 'Apply', 'apiVersion': 'v1', 'time': '2026-07-07T05:27:38Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:openshift.io/sa.scc.mcs': {}, 'f:openshift.io/sa.scc.supplemental-groups': {}, 'f:openshift.io/sa.scc.uid-range': {}}}}}, {'manager': 'pod-security-admission-label-synchronization-controller', 'operation': 'Apply', 'apiVersion': 'v1', 'time': '2026-07-07T05:27:38Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:security.openshift.io/MinimallySufficientPodSecurityStandard': {}}, 'f:labels': {'f:pod-security.kubernetes.io/audit': {}, 'f:pod-security.kubernetes.io/audit-version': {}, 'f:pod-security.kubernetes.io/warn': {}, 'f:pod-security.kubernetes.io/warn-version': {}}}}}, {'manager': 'openshift-apiserver', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-07T05:27:38Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:openshift.io/description': {}, 'f:openshift.io/display-name': {}, 'f:openshift.io/requester': {}}, 'f:labels': {'.': {}, 'f:kubernetes.io/metadata.name': {}}}}}, {'manager': 'openshift-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-07T05:27:38Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'f:finalizers': {}}}, 'subresource': 'finalize'}]}, 'spec': {'finalizers': ['kubernetes']}, 'status': {'phase': 'Active'}} [ocp_resources Project] 2026-07-07T05:27:41.998800Z [info ] Wait until Project llm is deleted [ocp_resources Project] 2026-07-07T05:27:41.998971Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-07-07T05:27:47.186614Z [info ] Elapsed time: 5.158359050750732 [0:00:05.158359] [timeout_sampler] 2026-07-07T05:27:47.186856Z [info ] ResourceEdits: Restoring data for resource Service authorino-authorino-authorization [ocp_resources.resource] 2026-07-07T05:27:47.186998Z [info ] Update Service authorino-authorino-authorization: {'metadata': {'annotations': {}, 'name': 'authorino-authorino-authorization'}} [ocp_resources Service] 2026-07-07T05:27:47.212400Z [info ] ResourceEdits: Restoring data for resource Deployment authorino [ocp_resources.resource] 2026-07-07T05:27:47.212568Z [info ] Update Deployment authorino: {'spec': {'template': {'spec': {'containers': [{'name': 'authorino', 'image': 'registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a', 'args': ['--allow-superseding-host-subsets', '--tls-cert=/etc/ssl/certs/tls.crt', '--tls-cert-key=/etc/ssl/private/tls.key'], 'env': [{'name': 'SSL_CERT_FILE', 'value': '/etc/ssl/certs/openshift-service-ca/service-ca-bundle.crt'}, {'name': 'REQUESTS_CA_BUNDLE', 'value': '/etc/ssl/certs/openshift-service-ca/service-ca-bundle.crt'}], 'resources': {}, 'volumeMounts': [{'name': 'tls-cert', 'readOnly': True, 'mountPath': '/etc/ssl/certs/tls.crt', 'subPath': 'tls.crt'}, {'name': 'tls-cert', 'readOnly': True, 'mountPath': '/etc/ssl/private/tls.key', 'subPath': 'tls.key'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}]}}}, 'metadata': {'name': 'authorino'}} [ocp_resources Deployment] 2026-07-07T05:27:47.240370Z [info ] ResourceEdits: Restoring data for resource Authorino authorino [ocp_resources.resource] 2026-07-07T05:27:47.240536Z [info ] Update Authorino authorino: {'spec': {'listener': {'tls': {'certSecretRef': {}}}}, 'metadata': {'name': 'authorino'}} [ocp_resources Authorino] 2026-07-07T05:27:47.264037Z [info ] Wait for Deployment/authorino's 'Available' condition to be 'True' [ocp_resources Deployment] 2026-07-07T05:27:47.264202Z [info ] Wait until Deployment authorino is created [ocp_resources Deployment] 2026-07-07T05:27:47.264332Z [info ] Waiting for 120 seconds [0:02:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-07T05:27:47.283429Z [info ] Elapsed time: 5.0067901611328125e-05 [0:00:00.000050] [timeout_sampler] 2026-07-07T05:27:47.283588Z [info ] Waiting for 119.98037576675415 seconds [0:01:59.980376], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-07T05:27:47.307661Z [info ] Elapsed time: 3.0994415283203125e-05 [0:00:00.000031] [timeout_sampler] 2026-07-07T05:27:47.305030Z [info ] authorino_tls_configured: TLS configuration removed, rollout complete [conftest] name=conftest 2026-07-07T05:27:47.308099Z [info ] ResourceEdits: Restoring data for resource DataScienceCluster default-dsc [ocp_resources.resource] 2026-07-07T05:27:47.308262Z [info ] Update DataScienceCluster default-dsc: {'spec': {'components': {'kserve': {'modelsAsService': {}}}}, 'metadata': {'name': 'default-dsc'}} [ocp_resources DataScienceCluster] 2026-07-07T05:27:47.374621Z [info ] Wait for DataScienceCluster/default-dsc's 'Ready' condition to be 'True' [ocp_resources DataScienceCluster] 2026-07-07T05:27:47.374778Z [info ] Wait until DataScienceCluster default-dsc is created [ocp_resources DataScienceCluster] 2026-07-07T05:27:47.374915Z [info ] Waiting for 600 seconds [0:10:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-07T05:27:47.397858Z [info ] Elapsed time: 3.123283386230469e-05 [0:00:00.000031] [timeout_sampler] 2026-07-07T05:27:47.398001Z [info ] Waiting for 599.9766590595245 seconds [0:09:59.976659], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-07T05:27:47.420677Z [info ] Elapsed time: 3.170967102050781e-05 [0:00:00.000032] [timeout_sampler] 2026-07-07T05:27:47.420826Z [info ] ResourceEdits: Restoring data for resource Gateway maas-default-gateway [ocp_resources.resource] 2026-07-07T05:27:47.420981Z [info ] Update Gateway maas-default-gateway: {'metadata': {'annotations': {}, 'name': 'maas-default-gateway'}} [ocp_resources Gateway] _ 2 of 2 completed, 1 Pass, 0 Fail, 1 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _ ========== 1 passed, 1 skipped, 127 deselected, 50 warnings in 26.05s ========== =============================== warnings summary =============================== tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py: 4 warnings tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py: 46 warnings /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: /workspace/tests-shared/tests-payload/results/maas_billing-smoke.xml - ========== 1 passed, 1 skipped, 127 deselected, 50 warnings in 26.05s ==========