--- BVT pytest attempt 2026-06-15T07:10:19.816305+00:00 (/.local/bin/uv run pytest...) --- 2026-06-15T07:10:21.718589Z [info ] Writing tests log to /home/odh/opendatahub-tests/results/pytest-tests.log [conftest] 2026-06-15T07:10:21.727762Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:10:21.728667Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:10:21.728810Z [info ] PRAGMA main.table_info("OpenDataHubTestTable") [sqlalchemy.engine.Engine] 2026-06-15T07:10:21.728923Z [info ] PRAGMA main.table_info("OpenDataHubTestTable") [sqlalchemy.engine.Engine] 2026-06-15T07:10:21.729062Z [info ] [raw sql] ()  [sqlalchemy.engine.Engine] 2026-06-15T07:10:21.729192Z [info ] [raw sql] ()  [sqlalchemy.engine.Engine] 2026-06-15T07:10:21.729348Z [info ] PRAGMA temp.table_info("OpenDataHubTestTable") [sqlalchemy.engine.Engine] 2026-06-15T07:10:21.729468Z [info ] PRAGMA temp.table_info("OpenDataHubTestTable") [sqlalchemy.engine.Engine] 2026-06-15T07:10:21.729599Z [info ] [raw sql] ()  [sqlalchemy.engine.Engine] 2026-06-15T07:10:21.729723Z [info ] [raw sql] ()  [sqlalchemy.engine.Engine] 2026-06-15T07:10:21.729839Z [info ]  CREATE TABLE "OpenDataHubTestTable" ( id INTEGER NOT NULL, test_name VARCHAR(500) NOT NULL, start_time INTEGER NOT NULL, PRIMARY KEY (id) )  [sqlalchemy.engine.Engine] 2026-06-15T07:10:21.730117Z [info ]  CREATE TABLE "OpenDataHubTestTable" ( id INTEGER NOT NULL, test_name VARCHAR(500) NOT NULL, start_time INTEGER NOT NULL, PRIMARY KEY (id) )  [sqlalchemy.engine.Engine] 2026-06-15T07:10:21.730498Z [info ] [no key 0.00005s] ()  [sqlalchemy.engine.Engine] 2026-06-15T07:10:21.730645Z [info ] [no key 0.00005s] ()  [sqlalchemy.engine.Engine] 2026-06-15T07:10:21.730764Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:10:21.730872Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:10:21.730984Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-23.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-23.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-23.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-23.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-23.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( 2026-06-15T07:10:21.857845Z [info ] kind: DataScienceCluster api version: datasciencecluster.opendatahub.io/v2 [ocp_resources.resource] /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-23.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-23.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-23.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-23.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( 2026-06-15T07:10:21.906138Z [info ] kind: DSCInitialization api version: dscinitialization.opendatahub.io/v2 [ocp_resources.resource] /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-23.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( ============================= test session starts ============================== platform linux -- Python 3.14.5, pytest-9.0.3, pluggy-1.6.0 -- /home/odh/opendatahub-tests/.venv/bin/python cachedir: .pytest_cache metadata: {'Python': '3.14.5', 'Platform': 'Linux-5.14.0-427.115.1.el9_4.x86_64-x86_64-with-glibc2.42', 'Packages': {'pytest': '9.0.3', 'pluggy': '1.6.0'}, 'Plugins': {'anyio': '4.13.0', 'langsmith': '0.8.9', 'asyncio': '1.4.0', 'dependency': '0.6.1', 'html': '4.2.0', 'metadata': '3.1.1', 'order': '1.4.0', 'progress': '1.4.0', 'testconfig': '0.2.0', 'xdist': '3.8.0', 'syrupy': '5.3.1'}} rootdir: /home/odh/opendatahub-tests configfile: pytest.ini plugins: anyio-4.13.0, langsmith-0.8.9, asyncio-1.4.0, dependency-0.6.1, html-4.2.0, metadata-3.1.1, order-1.4.0, progress-1.4.0, testconfig-0.2.0, xdist-3.8.0, syrupy-5.3.1 asyncio: mode=Mode.STRICT, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function collecting ... collected 176 items / 161 deselected / 15 selected tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::TestBBRSetup::test_bbr_pre_processing_deployment_ready  --------------------------------------- test_bbr_pre_processing_deployment_ready --------------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-06-15T07:10:22.279418Z [info ] (OpenDataHubTestTable|OpenDataHubTestTable) _post_configure_properties() started [sqlalchemy.orm.mapper.Mapper] 2026-06-15T07:10:22.279596Z [info ] (OpenDataHubTestTable|OpenDataHubTestTable) initialize prop id [sqlalchemy.orm.mapper.Mapper] 2026-06-15T07:10:22.279737Z [info ] (OpenDataHubTestTable|OpenDataHubTestTable) initialize prop test_name [sqlalchemy.orm.mapper.Mapper] 2026-06-15T07:10:22.280241Z [info ] (OpenDataHubTestTable|OpenDataHubTestTable) initialize prop start_time [sqlalchemy.orm.mapper.Mapper] 2026-06-15T07:10:22.280390Z [info ] (OpenDataHubTestTable|OpenDataHubTestTable) _post_configure_properties() complete [sqlalchemy.orm.mapper.Mapper] 2026-06-15T07:10:22.280508Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:10:22.280618Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:10:22.280729Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:10:22.280840Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:10:22.281344Z [info ] [generated in 0.00012s] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::test_bbr_pre_processing_deployment_ready', 1781507422) [sqlalchemy.engine.Engine] 2026-06-15T07:10:22.281514Z [info ] [generated in 0.00012s] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::test_bbr_pre_processing_deployment_ready', 1781507422) [sqlalchemy.engine.Engine] 2026-06-15T07:10:22.281639Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:10:22.281750Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:10:22.282953Z [info ] Executing session fixture: event_loop_policy [conftest] 2026-06-15T07:10:22.283081Z [info ] Executing session fixture: _syrupy_apply_ide_patches [conftest] 2026-06-15T07:10:22.283199Z [info ] Executing session fixture: admin_client [conftest] 2026-06-15T07:10:22.283399Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] 2026-06-15T07:10:22.286354Z [info ] Executing session fixture: dsc_resource [conftest] 2026-06-15T07:10:22.286497Z [info ] kind: DataScienceCluster api version: datasciencecluster.opendatahub.io/v2 [ocp_resources.resource] 2026-06-15T07:10:22.342285Z [info ] Executing session fixture: tmp_path_factory [conftest] 2026-06-15T07:10:22.342504Z [info ] Executing session fixture: tests_tmp_dir [conftest] 2026-06-15T07:10:22.343426Z [info ] Executing session fixture: os_path_environment [conftest] 2026-06-15T07:10:22.343589Z [info ] Executing session fixture: tmpdir_factory [conftest] 2026-06-15T07:10:22.343729Z [info ] Executing session fixture: bin_directory [conftest] 2026-06-15T07:10:22.344573Z [info ] Executing session fixture: oc_binary_path [conftest] 2026-06-15T07:10:22.358198Z [info ] kind: ConsoleCLIDownload api version: console.openshift.io/v1 [ocp_resources.resource] 2026-06-15T07:10:22.381441Z [info ] All oc console cli download links: ['https://downloads-openshift-console.apps.ods-qe-psi-23.osp.rh-ods.com/amd64/linux/oc.tar'] [utilities.infra] name=utilities.infra 2026-06-15T07:10:22.381580Z [info ] Downloading archive using: url=https://downloads-openshift-console.apps.ods-qe-psi-23.osp.rh-ods.com/amd64/linux/oc.tar [utilities.infra] name=utilities.infra 2026-06-15T07:10:53.109778Z [info ] Extract the downloaded archive. [utilities.infra] name=utilities.infra 2026-06-15T07:10:53.227390Z [info ] Downloaded file: ['oc']  [utilities.infra] name=utilities.infra 2026-06-15T07:10:53.250867Z [info ] Executing session fixture: bin_directory_to_os_path [conftest] 2026-06-15T07:10:53.249239Z [info ] OC binary path: /tmp/pytest-Nv5sw3zuuwErAHe5qJHwjT/bin0/oc [tests.conftest] name=tests.conftest 2026-06-15T07:10:53.249315Z [info ] Adding /tmp/pytest-Nv5sw3zuuwErAHe5qJHwjT/bin0 to $PATH [tests.conftest] name=tests.conftest 2026-06-15T07:10:53.251323Z [info ] Executing session fixture: nodes [conftest] 2026-06-15T07:10:54.136333Z [info ] Executing session fixture: dsci_resource [conftest] 2026-06-15T07:10:54.136514Z [info ] kind: DSCInitialization api version: dscinitialization.opendatahub.io/v2 [ocp_resources.resource] 2026-06-15T07:10:54.148983Z [info ] Executing session fixture: record_testsuite_property [conftest] 2026-06-15T07:10:54.149381Z [info ] Executing session fixture: junitxml_plugin [conftest] 2026-06-15T07:10:54.149500Z [info ] Executing session fixture: cluster_sanity_scope_session [conftest] 2026-06-15T07:10:54.148114Z [info ] Check cluster sanity.  [utilities.infra] name=utilities.infra 2026-06-15T07:10:54.149723Z [info ] Verify all nodes are in a healthy condition. [ocp_utilities.infra] 2026-06-15T07:10:54.218034Z [info ] Verify all nodes are schedulable. [ocp_utilities.infra] 2026-06-15T07:10:54.289759Z [info ] Waiting for 120 seconds [0:02:00], retry every 5 seconds. (Function: utilities.infra.wait_for_dsci_status_ready Kwargs: {'dsci_resource': }) [timeout_sampler] 2026-06-15T07:10:54.289149Z [info ] Wait for DSCI default-dsci to be in Ready status. [utilities.infra] name=utilities.infra 2026-06-15T07:10:54.290059Z [info ] Get DSCInitialization default-dsci status [ocp_resources DSCInitialization] 2026-06-15T07:10:54.300796Z [info ] Elapsed time: 0.00017642974853515625 [0:00:00.000176] [timeout_sampler] 2026-06-15T07:10:54.301024Z [info ] Waiting for 120 seconds [0:02:00], retry every 5 seconds. (Function: utilities.infra.wait_for_dsc_status_ready Kwargs: {'dsc_resource': }) [timeout_sampler] 2026-06-15T07:10:54.300106Z [info ] Wait for DSC default-dsc are Ready. [utilities.infra] name=utilities.infra 2026-06-15T07:10:54.301389Z [info ] Get DataScienceCluster default-dsc status [ocp_resources DataScienceCluster] 2026-06-15T07:10:54.313065Z [info ] Elapsed time: 5.3882598876953125e-05 [0:00:00.000054] [timeout_sampler] 2026-06-15T07:10:54.313342Z [info ] Executing session fixture: autouse_fixtures [conftest] 2026-06-15T07:10:54.313470Z [info ] Executing session fixture: maas_gateway_api_hostname [conftest] 2026-06-15T07:10:54.343015Z [info ] kind: Ingress api version: config.openshift.io/v1 [ocp_resources.resource] 2026-06-15T07:10:54.364229Z [info ] Executing session fixture: maas_gateway_api [conftest] 2026-06-15T07:10:54.385831Z [info ] kind: Gateway api version: gateway.networking.k8s.io/v1 [ocp_resources.resource] 2026-06-15T07:10:54.398870Z [info ] Reusing existing gateway openshift-ingress/maas-default-gateway [conftest] name=conftest 2026-06-15T07:10:54.399788Z [info ] Wait for Gateway/maas-default-gateway's 'Programmed' condition to be 'True' [ocp_resources Gateway] 2026-06-15T07:10:54.399911Z [info ] Wait until Gateway maas-default-gateway is created [ocp_resources Gateway] 2026-06-15T07:10:54.400038Z [info ] Waiting for 300 seconds [0:05:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-06-15T07:10:54.412738Z [info ] Elapsed time: 4.220008850097656e-05 [0:00:00.000042] [timeout_sampler] 2026-06-15T07:10:54.413048Z [info ] Waiting for 299.98717522621155 seconds [0:04:59.987175], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-06-15T07:10:54.425248Z [info ] Elapsed time: 4.267692565917969e-05 [0:00:00.000043] [timeout_sampler] 2026-06-15T07:10:54.425464Z [info ] ResourceEdit: Backing up old data [ocp_resources.resource] 2026-06-15T07:10:54.439687Z [info ] ResourceEdits: Updating data for resource Gateway maas-default-gateway [ocp_resources.resource] 2026-06-15T07:10:54.440143Z [info ] Update Gateway maas-default-gateway: {'metadata': {'annotations': {'security.opendatahub.io/authorino-tls-bootstrap': 'true'}, 'name': 'maas-default-gateway'}} [ocp_resources Gateway] 2026-06-15T07:10:54.463345Z [info ] Executing session fixture: pytestconfig [conftest] 2026-06-15T07:10:54.463492Z [info ] Executing session fixture: use_unprivileged_client [conftest] 2026-06-15T07:10:54.463615Z [info ] Executing session fixture: kubconfig_filepath [conftest] 2026-06-15T07:10:54.463730Z [info ] Executing session fixture: cluster_authentication [conftest] 2026-06-15T07:10:54.463841Z [info ] kind: Authentication api version: config.openshift.io/v1 [ocp_resources.resource] 2026-06-15T07:10:54.474691Z [info ] Executing session fixture: is_byoidc [conftest] 2026-06-15T07:10:54.487650Z [info ] Executing session fixture: non_admin_user_password [conftest] 2026-06-15T07:10:54.511291Z [info ] Executing session fixture: unprivileged_client [conftest] 2026-06-15T07:10:54.786014Z [info ] Requesting token for user odh-user1 from https://keycloak.qe.rh-ods.com/realms/openshift/protocol/openid-connect/token [utilities.user_utils] 2026-06-15T07:10:55.102115Z [info ] Executing session fixture: maas_subscription_namespace [conftest] 2026-06-15T07:10:55.117437Z [info ] Namespace models-as-a-service already exists, reusing it [conftest] name=conftest 2026-06-15T07:10:55.118510Z [info ] Executing session fixture: maas_subscription_controller_enabled_latest [conftest] 2026-06-15T07:10:55.118663Z [info ] ResourceEdit: Backing up old data --- [DuplicateFilter: Last log `kind: Authentication api version: config.openshift.io/v1` repeated 3 times] [ocp_resources.resource] 2026-06-15T07:10:55.133420Z [info ] ResourceEdits: Updating data for resource DataScienceCluster default-dsc [ocp_resources.resource] 2026-06-15T07:10:55.133587Z [info ] Update DataScienceCluster default-dsc: {'spec': {'components': {'kserve': {'modelsAsService': {'managementState': 'Managed'}}}}, 'metadata': {'name': 'default-dsc'}} [ocp_resources DataScienceCluster] 2026-06-15T07:10:55.165186Z [info ] Wait for DataScienceCluster/default-dsc's 'ModelsAsServiceReady' condition to be 'True' [ocp_resources DataScienceCluster] 2026-06-15T07:10:55.165394Z [info ] Wait until DataScienceCluster default-dsc is created [ocp_resources DataScienceCluster] 2026-06-15T07:10:55.165514Z [info ] Waiting for 900 seconds [0:15:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-06-15T07:10:55.177086Z [info ] Elapsed time: 3.933906555175781e-05 [0:00:00.000039] [timeout_sampler] 2026-06-15T07:10:55.177293Z [info ] Waiting for 899.9879286289215 seconds [0:14:59.987929], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-06-15T07:10:55.188961Z [info ] Elapsed time: 3.2901763916015625e-05 [0:00:00.000033] [timeout_sampler] 2026-06-15T07:10:55.189130Z [info ] Wait for DataScienceCluster/default-dsc's 'Ready' condition to be 'True' [ocp_resources DataScienceCluster] 2026-06-15T07:10:55.189379Z [info ] Wait until DataScienceCluster default-dsc is created [ocp_resources DataScienceCluster] 2026-06-15T07:10:55.189510Z [info ] Waiting for 600 seconds [0:10:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-06-15T07:10:55.201809Z [info ] Elapsed time: 2.7179718017578125e-05 [0:00:00.000027] [timeout_sampler] 2026-06-15T07:10:55.202121Z [info ] Waiting for 599.987545967102 seconds [0:09:59.987546], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-06-15T07:10:55.215211Z [info ] Elapsed time: 4.00543212890625e-05 [0:00:00.000040] [timeout_sampler] 2026-06-15T07:10:55.215378Z [info ] Executing session fixture: bbr_gateway_namespace [conftest] --------------------------------------------------------- CALL --------------------------------------------------------- 2026-06-15T07:10:55.229405Z [info ] kind: Deployment api version: apps/v1 [ocp_resources.resource] FAILED TEST: TestBBRSetup.test_bbr_pre_processing_deployment_ready STATUS: FAILED 2026-06-15T07:10:55.264833Z [error ] Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 179, in pytest_runtest_call item.runtest() ~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1720, in runtest self.ihook.pytest_pyfunc_call(pyfuncitem=self) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 166, in pytest_pyfunc_call result = testfunction(**testargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py", line 24, in test_bbr_pre_processing_deployment_ready verify_bbr_pre_processing_deployment_ready( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ admin_client=admin_client, ^^^^^^^^^^^^^^^^^^^^^^^^^^ gateway_namespace=bbr_gateway_namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/utils.py", line 29, in verify_bbr_pre_processing_deployment_ready assert deployment.exists, ( ^^^^^^^^^^^^^^^^^ AssertionError: Deployment 'openshift-ingress/payload-pre-processing' not found — payload-pre-processing must be deployed by the controller after PR #948 is merged [conftest] 2026-06-15T07:10:55.265063Z [info ] Must-gather collection is enabled for /home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::test_bbr_pre_processing_deployment_ready. [conftest] 2026-06-15T07:10:55.265195Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:10:55.265352Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:10:55.265482Z [info ] SELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" FROM "OpenDataHubTestTable" WHERE "OpenDataHubTestTable".test_name = ? LIMIT ? OFFSET ? [sqlalchemy.engine.Engine] 2026-06-15T07:10:55.265607Z [info ] SELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" FROM "OpenDataHubTestTable" WHERE "OpenDataHubTestTable".test_name = ? LIMIT ? OFFSET ? [sqlalchemy.engine.Engine] 2026-06-15T07:10:55.265779Z [info ] [generated in 0.00044s] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::test_bbr_pre_processing_deployment_ready', 1, 0) [sqlalchemy.engine.Engine] 2026-06-15T07:10:55.265927Z [info ] [generated in 0.00044s] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::test_bbr_pre_processing_deployment_ready', 1, 0) [sqlalchemy.engine.Engine] 2026-06-15T07:10:55.269687Z [info ] ROLLBACK  [sqlalchemy.engine.Engine] 2026-06-15T07:10:55.270100Z [info ] ROLLBACK  [sqlalchemy.engine.Engine] 2026-06-15T07:10:55.274355Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] 2026-06-15T07:10:55.359563Z [info ] kind: Subscription api version: operators.coreos.com/v1alpha1 [ocp_resources.resource] 2026-06-15T07:10:55.375738Z [info ] Checking subscription rhods-operator [utilities.infra] name=utilities.infra 2026-06-15T07:10:55.404412Z [info ] Expected CSV: rhods-operator.3.4.0 [utilities.infra] name=utilities.infra 2026-06-15T07:10:55.412309Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] 2026-06-15T07:10:55.414425Z [info ] kind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1 [ocp_resources.resource] 2026-06-15T07:10:55.558467Z [info ] Running oc adm must-gather --dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_deployment_ready/pytest_exception_interact --since=300s --image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 command [pyhelper_utils.shell] 2026-06-15T07:11:06.216703Z [info ] Running must-gather-clean: must-gather-clean -c /home/odh/opendatahub-tests/utilities/manifests/must_gather_clean/must-gather-clean-config.yaml -i /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_deployment_ready/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 -o /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_deployment_ready/pytest_exception_interact/must-gather-cleaned [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:11:06.217960Z [info ] Running must-gather-clean -c /home/odh/opendatahub-tests/utilities/manifests/must_gather_clean/must-gather-clean-config.yaml -i /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_deployment_ready/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 -o /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_deployment_ready/pytest_exception_interact/must-gather-cleaned command [pyhelper_utils.shell] 2026-06-15T07:11:06.222287Z [info ] must-gather-clean output:  [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:11:06.222933Z [info ] Removed original must-gather output: /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_deployment_ready/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:11:06.225112Z [info ] /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_deployment_ready/pytest_exception_interact/mg-1781507422.zip is collected successfully [utilities.must_gather_collector] name=utilities.must_gather_collector ------------------------------------------------------- TEARDOWN ------------------------------------------------------- ____________ TestBBRSetup.test_bbr_pre_processing_deployment_ready _____________ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 179, in pytest_runtest_call item.runtest() ~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1720, in runtest self.ihook.pytest_pyfunc_call(pyfuncitem=self) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 166, in pytest_pyfunc_call result = testfunction(**testargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py", line 24, in test_bbr_pre_processing_deployment_ready verify_bbr_pre_processing_deployment_ready( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ admin_client=admin_client, ^^^^^^^^^^^^^^^^^^^^^^^^^^ gateway_namespace=bbr_gateway_namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/utils.py", line 29, in verify_bbr_pre_processing_deployment_ready assert deployment.exists, ( ^^^^^^^^^^^^^^^^^ AssertionError: Deployment 'openshift-ingress/payload-pre-processing' not found — payload-pre-processing must be deployed by the controller after PR #948 is merged _ 1 of 15 completed, 0 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _ tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::TestBBRSetup::test_bbr_pre_processing_service_exposes_port_9004  ---------------------------------- test_bbr_pre_processing_service_exposes_port_9004 ---------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-06-15T07:11:06.229741Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:11:06.229882Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:11:06.230009Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:11:06.230134Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:11:06.230325Z [info ] [cached since 43.95s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::test_bbr_pre_processing_service_exposes_port_9004', 1781507466) [sqlalchemy.engine.Engine] 2026-06-15T07:11:06.230472Z [info ] [cached since 43.95s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::test_bbr_pre_processing_service_exposes_port_9004', 1781507466) [sqlalchemy.engine.Engine] 2026-06-15T07:11:06.231373Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:11:06.231506Z [info ] COMMIT  [sqlalchemy.engine.Engine] --------------------------------------------------------- CALL --------------------------------------------------------- FAILED TEST: TestBBRSetup.test_bbr_pre_processing_service_exposes_port_9004 STATUS: FAILED 2026-06-15T07:11:06.249732Z [error ] Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 179, in pytest_runtest_call item.runtest() ~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1720, in runtest self.ihook.pytest_pyfunc_call(pyfuncitem=self) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 166, in pytest_pyfunc_call result = testfunction(**testargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py", line 36, in test_bbr_pre_processing_service_exposes_port_9004 verify_bbr_pre_processing_service_port( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ admin_client=admin_client, ^^^^^^^^^^^^^^^^^^^^^^^^^^ gateway_namespace=bbr_gateway_namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/utils.py", line 55, in verify_bbr_pre_processing_service_port assert service.exists, f"Service '{gateway_namespace}/{BBR_PRE_PROCESSING_SERVICE_NAME}' not found" ^^^^^^^^^^^^^^ AssertionError: Service 'openshift-ingress/payload-pre-processing' not found [conftest] 2026-06-15T07:11:06.249876Z [info ] Must-gather collection is enabled for /home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::test_bbr_pre_processing_service_exposes_port_9004. [conftest] 2026-06-15T07:11:06.250002Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:11:06.250121Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:11:06.252108Z [info ] SELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" FROM "OpenDataHubTestTable" WHERE "OpenDataHubTestTable".test_name = ? LIMIT ? OFFSET ? [sqlalchemy.engine.Engine] 2026-06-15T07:11:06.252567Z [info ] SELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" FROM "OpenDataHubTestTable" WHERE "OpenDataHubTestTable".test_name = ? LIMIT ? OFFSET ? [sqlalchemy.engine.Engine] 2026-06-15T07:11:06.256936Z [info ] [cached since 10.98s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::test_bbr_pre_processing_service_exposes_port_9004', 1, 0) [sqlalchemy.engine.Engine] 2026-06-15T07:11:06.257243Z [info ] [cached since 10.98s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::test_bbr_pre_processing_service_exposes_port_9004', 1, 0) [sqlalchemy.engine.Engine] 2026-06-15T07:11:06.257392Z [info ] ROLLBACK  [sqlalchemy.engine.Engine] 2026-06-15T07:11:06.257501Z [info ] ROLLBACK  [sqlalchemy.engine.Engine] 2026-06-15T07:11:06.257607Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] 2026-06-15T07:11:06.303301Z [info ] Checking subscription rhods-operator [utilities.infra] name=utilities.infra 2026-06-15T07:11:06.315048Z [info ] Expected CSV: rhods-operator.3.4.0 [utilities.infra] name=utilities.infra 2026-06-15T07:11:06.321636Z [info ] kind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1 [ocp_resources.resource] 2026-06-15T07:11:06.460456Z [info ] Running oc adm must-gather --dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_service_exposes_port_9004/pytest_exception_interact --since=300s --image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 command [pyhelper_utils.shell] 2026-06-15T07:15:40.131398Z [info ] Running must-gather-clean: must-gather-clean -c /home/odh/opendatahub-tests/utilities/manifests/must_gather_clean/must-gather-clean-config.yaml -i /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_service_exposes_port_9004/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 -o /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_service_exposes_port_9004/pytest_exception_interact/must-gather-cleaned [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:15:40.132565Z [info ] Running must-gather-clean -c /home/odh/opendatahub-tests/utilities/manifests/must_gather_clean/must-gather-clean-config.yaml -i /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_service_exposes_port_9004/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 -o /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_service_exposes_port_9004/pytest_exception_interact/must-gather-cleaned command [pyhelper_utils.shell] 2026-06-15T07:15:41.050105Z [info ] must-gather-clean output:  [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:15:41.098184Z [info ] Removed original must-gather output: /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_service_exposes_port_9004/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:15:41.332051Z [info ] /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_service_exposes_port_9004/pytest_exception_interact/mg-1781507466.zip is collected successfully [utilities.must_gather_collector] name=utilities.must_gather_collector ________ TestBBRSetup.test_bbr_pre_processing_service_exposes_port_9004 ________ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 179, in pytest_runtest_call item.runtest() ~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1720, in runtest self.ihook.pytest_pyfunc_call(pyfuncitem=self) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 166, in pytest_pyfunc_call result = testfunction(**testargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py", line 36, in test_bbr_pre_processing_service_exposes_port_9004 verify_bbr_pre_processing_service_port( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ admin_client=admin_client, ^^^^^^^^^^^^^^^^^^^^^^^^^^ gateway_namespace=bbr_gateway_namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/utils.py", line 55, in verify_bbr_pre_processing_service_port assert service.exists, f"Service '{gateway_namespace}/{BBR_PRE_PROCESSING_SERVICE_NAME}' not found" ^^^^^^^^^^^^^^ AssertionError: Service 'openshift-ingress/payload-pre-processing' not found _ 2 of 15 completed, 0 Pass, 2 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _ tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::TestBBRSetup::test_bbr_pre_processing_destination_rule_exists ------------------------------------------------------- TEARDOWN -------------------------------------------------------  ----------------------------------- test_bbr_pre_processing_destination_rule_exists ----------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-06-15T07:15:41.334837Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:15:41.334990Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:15:41.335415Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:15:41.335539Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:15:41.335690Z [info ] [cached since 319.1s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::test_bbr_pre_processing_destination_rule_exists', 1781507741) [sqlalchemy.engine.Engine] 2026-06-15T07:15:41.335825Z [info ] [cached since 319.1s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::test_bbr_pre_processing_destination_rule_exists', 1781507741) [sqlalchemy.engine.Engine] 2026-06-15T07:15:41.335949Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:15:41.336067Z [info ] COMMIT  [sqlalchemy.engine.Engine] --------------------------------------------------------- CALL --------------------------------------------------------- 2026-06-15T07:15:41.427073Z [info ] kind: DestinationRule api version: networking.istio.io/v1 [ocp_resources.resource] FAILED TEST: TestBBRSetup.test_bbr_pre_processing_destination_rule_exists STATUS: FAILED 2026-06-15T07:15:41.443828Z [error ] Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 179, in pytest_runtest_call item.runtest() ~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1720, in runtest self.ihook.pytest_pyfunc_call(pyfuncitem=self) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 166, in pytest_pyfunc_call result = testfunction(**testargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py", line 48, in test_bbr_pre_processing_destination_rule_exists verify_bbr_pre_processing_destination_rule_exists( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ admin_client=admin_client, ^^^^^^^^^^^^^^^^^^^^^^^^^^ gateway_namespace=bbr_gateway_namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/utils.py", line 78, in verify_bbr_pre_processing_destination_rule_exists assert destination_rule.exists, ( ^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: DestinationRule 'openshift-ingress/payload-pre-processing' not found — expected to be created by the controller after reconciliation [conftest] 2026-06-15T07:15:41.443996Z [info ] Must-gather collection is enabled for /home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::test_bbr_pre_processing_destination_rule_exists. [conftest] 2026-06-15T07:15:41.444121Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:15:41.444240Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:15:41.444393Z [info ] SELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" FROM "OpenDataHubTestTable" WHERE "OpenDataHubTestTable".test_name = ? LIMIT ? OFFSET ? [sqlalchemy.engine.Engine] 2026-06-15T07:15:41.444516Z [info ] SELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" FROM "OpenDataHubTestTable" WHERE "OpenDataHubTestTable".test_name = ? LIMIT ? OFFSET ? [sqlalchemy.engine.Engine] 2026-06-15T07:15:41.444663Z [info ] [cached since 286.2s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::test_bbr_pre_processing_destination_rule_exists', 1, 0) [sqlalchemy.engine.Engine] 2026-06-15T07:15:41.444805Z [info ] [cached since 286.2s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::test_bbr_pre_processing_destination_rule_exists', 1, 0) [sqlalchemy.engine.Engine] 2026-06-15T07:15:41.444931Z [info ] ROLLBACK  [sqlalchemy.engine.Engine] 2026-06-15T07:15:41.445049Z [info ] ROLLBACK  [sqlalchemy.engine.Engine] 2026-06-15T07:15:41.445172Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] 2026-06-15T07:15:41.538387Z [info ] Checking subscription rhods-operator [utilities.infra] name=utilities.infra 2026-06-15T07:15:41.553454Z [info ] Expected CSV: rhods-operator.3.4.0 [utilities.infra] name=utilities.infra 2026-06-15T07:15:41.807645Z [info ] kind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1 [ocp_resources.resource] 2026-06-15T07:15:41.894686Z [info ] Running oc adm must-gather --dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_destination_rule_exists/pytest_exception_interact --since=300s --image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 command [pyhelper_utils.shell] 2026-06-15T07:15:52.635933Z [info ] Running must-gather-clean: must-gather-clean -c /home/odh/opendatahub-tests/utilities/manifests/must_gather_clean/must-gather-clean-config.yaml -i /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_destination_rule_exists/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 -o /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_destination_rule_exists/pytest_exception_interact/must-gather-cleaned [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:15:52.637435Z [info ] Running must-gather-clean -c /home/odh/opendatahub-tests/utilities/manifests/must_gather_clean/must-gather-clean-config.yaml -i /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_destination_rule_exists/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 -o /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_destination_rule_exists/pytest_exception_interact/must-gather-cleaned command [pyhelper_utils.shell] 2026-06-15T07:15:52.643178Z [info ] must-gather-clean output:  [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:15:52.643997Z [info ] Removed original must-gather output: /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_destination_rule_exists/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 [utilities.must_gather_collector] name=utilities.must_gather_collector _________ TestBBRSetup.test_bbr_pre_processing_destination_rule_exists _________ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 179, in pytest_runtest_call item.runtest() ~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1720, in runtest self.ihook.pytest_pyfunc_call(pyfuncitem=self) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 166, in pytest_pyfunc_call result = testfunction(**testargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py", line 48, in test_bbr_pre_processing_destination_rule_exists verify_bbr_pre_processing_destination_rule_exists( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ admin_client=admin_client, ^^^^^^^^^^^^^^^^^^^^^^^^^^ gateway_namespace=bbr_gateway_namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/utils.py", line 78, in verify_bbr_pre_processing_destination_rule_exists assert destination_rule.exists, ( ^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: DestinationRule 'openshift-ingress/payload-pre-processing' not found — expected to be created by the controller after reconciliation _ 3 of 15 completed, 0 Pass, 3 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _ tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::TestAuthPolicyApiKeyValidation::test_auth_policy_callback_url_uses_correct_namespace 2026-06-15T07:15:52.646082Z [info ] /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup/TestBBRSetup/test_bbr_pre_processing_destination_rule_exists/pytest_exception_interact/mg-1781507741.zip is collected successfully [utilities.must_gather_collector] name=utilities.must_gather_collector ------------------------------------------------------- TEARDOWN -------------------------------------------------------  --------------------------------- test_auth_policy_callback_url_uses_correct_namespace --------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-06-15T07:15:52.652644Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:15:52.652950Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:15:52.653798Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:15:52.653938Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:15:52.654151Z [info ] [cached since 330.4s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::test_auth_policy_callback_url_uses_correct_namespace', 1781507752) [sqlalchemy.engine.Engine] 2026-06-15T07:15:52.654326Z [info ] [cached since 330.4s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::test_auth_policy_callback_url_uses_correct_namespace', 1781507752) [sqlalchemy.engine.Engine] 2026-06-15T07:15:52.654470Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:15:52.654602Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:15:52.657777Z [info ] Executing session fixture: request_session_http [conftest] 2026-06-15T07:15:52.658091Z [info ] Executing session fixture: authorino_tls_configured [conftest] 2026-06-15T07:15:52.658222Z [info ] kind: Deployment api version: apps/v1 [ocp_resources.resource] 2026-06-15T07:15:52.685069Z [info ] authorino_tls_configured: configuring TLS in kuadrant-system [conftest] name=conftest 2026-06-15T07:15:52.725046Z [info ] kind: Authorino api version: operator.authorino.kuadrant.io/v1beta1 --- [DuplicateFilter: Last log `kind: Deployment api version: apps/v1` repeated 2 times] [ocp_resources.resource] 2026-06-15T07:15:52.725196Z [info ] ResourceEdit: Backing up old data [ocp_resources.resource] 2026-06-15T07:15:52.763081Z [info ] ResourceEdits: Updating data for resource Service authorino-authorino-authorization [ocp_resources.resource] 2026-06-15T07:15:52.763282Z [info ] Update Service authorino-authorino-authorization: {'metadata': {'annotations': {'service.beta.openshift.io/serving-cert-secret-name': 'authorino-server-cert'}, 'name': 'authorino-authorino-authorization'}} [ocp_resources Service] 2026-06-15T07:15:52.779220Z [info ] ResourceEdits: Updating data for resource Deployment authorino [ocp_resources.resource] 2026-06-15T07:15:52.779444Z [info ] Update Deployment authorino: {'spec': {'template': {'spec': {'containers': [{'name': 'authorino', 'image': 'registry.redhat.io/rhcl-1/authorino-rhel9@sha256:b9e3aec873834dab0e8461e76931799ccd2538f1157a1626be233f8ede268c45', 'env': [{'name': 'SSL_CERT_FILE', 'value': '/etc/ssl/certs/openshift-service-ca/service-ca-bundle.crt'}, {'name': 'REQUESTS_CA_BUNDLE', 'value': '/etc/ssl/certs/openshift-service-ca/service-ca-bundle.crt'}]}]}}}, 'metadata': {'name': 'authorino'}} [ocp_resources Deployment] 2026-06-15T07:15:52.799956Z [info ] ResourceEdits: Updating data for resource Authorino authorino [ocp_resources.resource] 2026-06-15T07:15:52.800198Z [info ] Update Authorino authorino: {'spec': {'listener': {'tls': {'enabled': True, 'certSecretRef': {'name': 'authorino-server-cert'}}}}, 'metadata': {'name': 'authorino'}} [ocp_resources Authorino] 2026-06-15T07:15:52.815705Z [info ] Wait for Deployment/authorino's 'Available' condition to be 'True' [ocp_resources Deployment] 2026-06-15T07:15:52.815852Z [info ] Wait until Deployment authorino is created [ocp_resources Deployment] 2026-06-15T07:15:52.815979Z [info ] Waiting for 120 seconds [0:02:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-06-15T07:15:52.831758Z [info ] Elapsed time: 6.628036499023438e-05 [0:00:00.000066] [timeout_sampler] 2026-06-15T07:15:52.831889Z [info ] Waiting for 119.98388695716858 seconds [0:01:59.983887], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-06-15T07:15:52.848745Z [info ] Elapsed time: 3.9577484130859375e-05 [0:00:00.000040] [timeout_sampler] 2026-06-15T07:15:52.847084Z [info ] authorino_tls_configured: TLS configuration applied, rollout complete [conftest] name=conftest 2026-06-15T07:15:52.849067Z [info ] Executing class fixture: maas_unprivileged_model_namespace [conftest] 2026-06-15T07:15:52.849192Z [info ] kind: ProjectRequest api version: project.openshift.io/v1 [ocp_resources.resource] 2026-06-15T07:15:52.849343Z [info ] Create ProjectRequest llm  [ocp_resources ProjectRequest] 2026-06-15T07:15:52.849458Z [info ] Posting {'apiVersion': 'project.openshift.io/v1', 'kind': 'ProjectRequest', 'metadata': {'name': 'llm'}} [ocp_resources ProjectRequest] 2026-06-15T07:15:53.003202Z [info ] kind: Project api version: project.openshift.io/v1 [ocp_resources.resource] 2026-06-15T07:15:53.003391Z [info ] Wait for Project llm status to be Active [ocp_resources Project] 2026-06-15T07:15:53.003516Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_status.lambda: self.exists) [timeout_sampler] 2026-06-15T07:15:53.026137Z [info ] Status of Project llm is Active [ocp_resources Project] 2026-06-15T07:15:53.026326Z [info ] Elapsed time: 3.504753112792969e-05 [0:00:00.000035] [timeout_sampler] 2026-06-15T07:15:53.026485Z [info ] Executing class fixture: maas_scheme [conftest] 2026-06-15T07:15:53.076162Z [info ] kind: LLMInferenceService api version: serving.kserve.io/v1alpha2 [ocp_resources.resource] 2026-06-15T07:15:53.090728Z [info ] Executing class fixture: maas_host [conftest] 2026-06-15T07:15:53.090898Z [info ] kind: Ingress api version: config.openshift.io/v1 [ocp_resources.resource] 2026-06-15T07:15:53.120348Z [info ] Executing class fixture: base_url [conftest] 2026-06-15T07:15:53.120485Z [info ] Executing class fixture: maas_api_deployment_available [conftest] 2026-06-15T07:15:53.120605Z [info ] kind: Deployment api version: apps/v1 [ocp_resources.resource] 2026-06-15T07:15:53.132338Z [info ] Wait for Deployment/maas-api's 'Available' condition to be 'True' [ocp_resources Deployment] 2026-06-15T07:15:53.132488Z [info ] Wait until Deployment maas-api is created [ocp_resources Deployment] 2026-06-15T07:15:53.132640Z [info ] Waiting for 600 seconds [0:10:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-06-15T07:15:53.148214Z [info ] Elapsed time: 4.220008850097656e-05 [0:00:00.000042] [timeout_sampler] 2026-06-15T07:15:53.148427Z [info ] Waiting for 599.9841635227203 seconds [0:09:59.984164], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-06-15T07:15:53.161489Z [info ] Elapsed time: 3.814697265625e-05 [0:00:00.000038] [timeout_sampler] 2026-06-15T07:15:53.161635Z [info ] Executing class fixture: maas_api_endpoints_ready [conftest] 2026-06-15T07:15:53.161824Z [info ] Waiting for 300 seconds [0:05:00], retry every 5 seconds. (Function: tests.model_serving.maas_billing.utils.endpoints_have_ready_addresses Kwargs: {'admin_client': , 'namespace': 'redhat-ods-applications', 'name': 'maas-api'}) [timeout_sampler] 2026-06-15T07:15:53.188704Z [info ] Elapsed time: 3.600120544433594e-05 [0:00:00.000036] [timeout_sampler] 2026-06-15T07:15:53.189089Z [info ] Executing class fixture: maas_api_gateway_reachable [conftest] 2026-06-15T07:15:53.189212Z [info ] Waiting for 300 seconds [0:05:00], retry every 5 seconds. (Function: tests.model_serving.maas_billing.utils.gateway_probe_reaches_maas_api Kwargs: {'http_session': , 'probe_url': 'https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models', 'request_timeout_seconds': 30}) [timeout_sampler] 2026-06-15T07:15:53.247777Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:15:53.248405Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:15:58.293986Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:15:58.294705Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:16:03.339752Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:16:03.340363Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:16:08.395781Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:16:08.396829Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:16:13.435047Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:16:13.436096Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:16:18.485363Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:16:18.486162Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:16:23.529446Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:16:23.530073Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:16:28.568810Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:16:28.569679Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:16:33.607424Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:16:33.608112Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:16:38.659221Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:16:38.659811Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:16:43.717697Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:16:43.718476Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:16:48.761737Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:16:48.763219Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:16:53.808214Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:16:53.808835Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:16:58.844440Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:16:58.845098Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:17:03.884473Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:17:03.885178Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:17:08.925653Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:17:08.926210Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:17:13.971577Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:17:13.972195Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:17:19.007646Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:17:19.008620Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:17:24.049525Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:17:24.050206Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:17:29.112963Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:17:29.113685Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:17:34.153343Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:17:34.153904Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:17:39.199527Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:17:39.200117Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:17:44.244729Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:17:44.245346Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:17:49.284323Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:17:49.285030Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:17:54.360607Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:17:54.361174Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:17:59.423906Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:17:59.424760Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:18:04.462223Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:18:04.462986Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:18:09.503976Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:18:09.504683Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:18:14.546113Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:18:14.546712Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:18:19.589001Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:18:19.589626Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:18:24.645666Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:18:24.646338Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:18:29.690096Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:18:29.690839Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:18:34.733447Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:18:34.734011Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:18:39.781617Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:18:39.782221Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:18:44.858473Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:18:44.859247Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:18:49.918638Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:18:49.919198Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:18:54.960574Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:18:54.961206Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:19:00.000129Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:19:00.000714Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:19:05.042412Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:19:05.042979Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:19:10.080892Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:19:10.081470Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:19:15.126038Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:19:15.126667Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:19:20.167854Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:19:20.168437Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:19:25.214339Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:19:25.215138Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:19:30.253180Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:19:30.253774Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:19:35.293663Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:19:35.294299Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:19:40.339244Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:19:40.340575Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:19:45.376672Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:19:45.377230Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:19:50.417199Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:19:50.417775Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:19:55.456110Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:19:55.456707Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:20:00.497410Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:20:00.497988Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:20:05.536601Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:20:05.537189Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:20:10.588699Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:20:10.589528Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:20:15.631768Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:20:15.632381Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:20:20.673126Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:20:20.673759Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:20:25.724546Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:20:25.725206Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:20:30.768216Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:20:30.769169Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:20:35.818244Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:20:35.818940Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:20:40.857539Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:20:40.858196Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:20:45.912692Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:20:45.913239Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:20:50.959049Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:20:50.959722Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest ERROR TEST: TestAuthPolicyApiKeyValidation.test_auth_policy_callback_url_uses_correct_namespace [setup] STATUS: ERROR 2026-06-15T07:20:55.974421Z [error ] Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1110, in execute result: FixtureValue = ihook.pytest_fixture_setup( ~~~~~~~~~~~~~~~~~~~~~~~~~~^ fixturedef=self, request=request ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pytest_asyncio/plugin.py", line 924, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/setuponly.py", line 36, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 915, in call_fixture_func fixture_result = fixturefunc(**kwargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 903, in maas_api_gateway_reachable for gateway_reachable, _status_code, _response_text in TimeoutSampler( ~~~~~~~~~~~~~~^ wait_timeout=300, ^^^^^^^^^^^^^^^^^ ...<4 lines>... request_timeout_seconds=30, ^^^^^^^^^^^^^^^^^^^^^^^^^^^ ): ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__ raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp) timeout_sampler.TimeoutExpiredError: Timed Out: 300 Function: tests.model_serving.maas_billing.utils.gateway_probe_reaches_maas_api Kwargs: {'http_session': , 'probe_url': 'https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models', 'request_timeout_seconds': 30} Last exception: N/A. [conftest] 2026-06-15T07:20:55.974697Z [info ] Must-gather collection is enabled for /home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::test_auth_policy_callback_url_uses_correct_namespace. [conftest] 2026-06-15T07:20:55.974879Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:20:55.975040Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:20:55.975208Z [info ] SELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" FROM "OpenDataHubTestTable" WHERE "OpenDataHubTestTable".test_name = ? LIMIT ? OFFSET ? [sqlalchemy.engine.Engine] 2026-06-15T07:20:55.975347Z [info ] SELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" FROM "OpenDataHubTestTable" WHERE "OpenDataHubTestTable".test_name = ? LIMIT ? OFFSET ? [sqlalchemy.engine.Engine] 2026-06-15T07:20:55.975491Z [info ] [cached since 600.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::test_auth_policy_callback_url_uses_correct_namespace', 1, 0) [sqlalchemy.engine.Engine] 2026-06-15T07:20:55.975619Z [info ] [cached since 600.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::test_auth_policy_callback_url_uses_correct_namespace', 1, 0) [sqlalchemy.engine.Engine] 2026-06-15T07:20:55.975726Z [info ] ROLLBACK  [sqlalchemy.engine.Engine] 2026-06-15T07:20:55.975829Z [info ] ROLLBACK  [sqlalchemy.engine.Engine] 2026-06-15T07:20:55.975931Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] 2026-06-15T07:20:56.059663Z [info ] Checking subscription rhods-operator [utilities.infra] name=utilities.infra 2026-06-15T07:20:56.074469Z [info ] Expected CSV: rhods-operator.3.4.0 [utilities.infra] name=utilities.infra 2026-06-15T07:20:56.150880Z [info ] kind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1 [ocp_resources.resource] 2026-06-15T07:20:56.245428Z [info ] Running oc adm must-gather --dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation/TestAuthPolicyApiKeyValidation/test_auth_policy_callback_url_uses_correct_namespace/pytest_exception_interact --since=303s --image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 command [pyhelper_utils.shell] 2026-06-15T07:21:07.743997Z [info ] Running must-gather-clean: must-gather-clean -c /home/odh/opendatahub-tests/utilities/manifests/must_gather_clean/must-gather-clean-config.yaml -i /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation/TestAuthPolicyApiKeyValidation/test_auth_policy_callback_url_uses_correct_namespace/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 -o /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation/TestAuthPolicyApiKeyValidation/test_auth_policy_callback_url_uses_correct_namespace/pytest_exception_interact/must-gather-cleaned [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:21:07.745352Z [info ] Running must-gather-clean -c /home/odh/opendatahub-tests/utilities/manifests/must_gather_clean/must-gather-clean-config.yaml -i /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation/TestAuthPolicyApiKeyValidation/test_auth_policy_callback_url_uses_correct_namespace/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 -o /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation/TestAuthPolicyApiKeyValidation/test_auth_policy_callback_url_uses_correct_namespace/pytest_exception_interact/must-gather-cleaned command [pyhelper_utils.shell] 2026-06-15T07:21:07.750403Z [info ] must-gather-clean output:  [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:21:07.751139Z [info ] Removed original must-gather output: /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation/TestAuthPolicyApiKeyValidation/test_auth_policy_callback_url_uses_correct_namespace/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:21:07.752895Z [info ] /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation/TestAuthPolicyApiKeyValidation/test_auth_policy_callback_url_uses_correct_namespace/pytest_exception_interact/mg-1781507752.zip is collected successfully [utilities.must_gather_collector] name=utilities.must_gather_collector _ ERROR at setup of TestAuthPolicyApiKeyValidation.test_auth_policy_callback_url_uses_correct_namespace _ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1110, in execute result: FixtureValue = ihook.pytest_fixture_setup( ~~~~~~~~~~~~~~~~~~~~~~~~~~^ fixturedef=self, request=request ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pytest_asyncio/plugin.py", line 924, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/setuponly.py", line 36, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 915, in call_fixture_func fixture_result = fixturefunc(**kwargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 903, in maas_api_gateway_reachable for gateway_reachable, _status_code, _response_text in TimeoutSampler( ~~~~~~~~~~~~~~^ wait_timeout=300, ^^^^^^^^^^^^^^^^^ ...<4 lines>... request_timeout_seconds=30, ^^^^^^^^^^^^^^^^^^^^^^^^^^^ ): ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__ raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp) timeout_sampler.TimeoutExpiredError: Timed Out: 300 Function: tests.model_serving.maas_billing.utils.gateway_probe_reaches_maas_api Kwargs: {'http_session': , 'probe_url': 'https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models', 'request_timeout_seconds': 30} Last exception: N/A. _ 4 of 15 completed, 0 Pass, 3 Fail, 0 Skip, 0 XPass, 0 XFail, 1 Error, 0 ReRun _ tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::TestAuthPolicyApiKeyValidation::test_api_key_can_list_models[ocp_token_for_actor0] ------------------------------------------------------- TEARDOWN -------------------------------------------------------  ---------------------------------- test_api_key_can_list_models[ocp_token_for_actor0] ---------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-06-15T07:21:07.756705Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:07.758192Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:07.758667Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:21:07.758958Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:21:07.759159Z [info ] [cached since 645.5s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::test_api_key_can_list_models[ocp_token_for_actor0]', 1781508067) [sqlalchemy.engine.Engine] 2026-06-15T07:21:07.759316Z [info ] [cached since 645.5s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::test_api_key_can_list_models[ocp_token_for_actor0]', 1781508067) [sqlalchemy.engine.Engine] 2026-06-15T07:21:07.759429Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:21:07.759534Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:21:07.759639Z [info ] Executing session fixture: aws_access_key_id [conftest] 2026-06-15T07:21:07.759742Z [info ] Executing session fixture: aws_secret_access_key [conftest] 2026-06-15T07:21:07.759844Z [info ] Executing session fixture: models_s3_bucket_name [conftest] 2026-06-15T07:21:07.759944Z [info ] Executing session fixture: models_s3_bucket_region [conftest] 2026-06-15T07:21:07.760066Z [info ] Executing session fixture: models_s3_bucket_endpoint [conftest] 2026-06-15T07:21:07.760172Z [info ] Executing session fixture: original_user [conftest] 2026-06-15T07:21:07.760295Z [info ] Running oc whoami command  [pyhelper_utils.shell] 2026-06-15T07:21:08.131410Z [info ] Original user: odh-admin1  [tests.conftest] name=tests.conftest 2026-06-15T07:21:08.133374Z [info ] Executing session fixture: maas_api_server_url [conftest] 2026-06-15T07:21:08.133493Z [info ] kind: Infrastructure api version: config.openshift.io/v1 [ocp_resources.resource] 2026-06-15T07:21:08.192408Z [info ] Executing session fixture: maas_user_credentials_both [conftest] 2026-06-15T07:21:08.192534Z [info ] Executing session fixture: maas_htpasswd_files [conftest] SKIPPED2026-06-15T07:21:08.682957Z [info ] Executing session fixture: maas_htpasswd_oauth_idp [conftest]  TEST: TestAuthPolicyApiKeyValidation.test_api_key_can_list_models[ocp_token_for_actor0] STATUS: SKIPPED ------------------------------------------------------- TEARDOWN ------------------------------------------------------- 2026-06-15T07:21:08.721885Z [info ] Delete Project llm  [ocp_resources Project] 2026-06-15T07:21:08.757670Z [info ] Deleting {'kind': 'Project', 'apiVersion': 'project.openshift.io/v1', 'metadata': {'name': 'llm', 'uid': '6ddbaa68-8f05-40fc-961f-f460361089f2', 'resourceVersion': '184677256', 'creationTimestamp': '2026-06-15T07:15:52Z', 'labels': {'kubernetes.io/metadata.name': 'llm', 'pod-security.kubernetes.io/audit': 'restricted', 'pod-security.kubernetes.io/audit-version': 'latest', 'pod-security.kubernetes.io/enforce': 'restricted', 'pod-security.kubernetes.io/enforce-version': 'latest', 'pod-security.kubernetes.io/warn': 'restricted', 'pod-security.kubernetes.io/warn-version': 'latest'}, 'annotations': {'openshift.io/description': '', 'openshift.io/display-name': '', 'openshift.io/requester': 'odh-user1', 'openshift.io/sa.scc.mcs': 's0:c30,c0', 'openshift.io/sa.scc.supplemental-groups': '1000870000/10000', 'openshift.io/sa.scc.uid-range': '1000870000/10000', 'security.openshift.io/MinimallySufficientPodSecurityStandard': 'restricted'}, 'managedFields': [{'manager': 'pod-security-admission-label-synchronization-controller', 'operation': 'Apply', 'apiVersion': 'v1', 'time': '2026-06-15T07:15:52Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:security.openshift.io/MinimallySufficientPodSecurityStandard': {}}, 'f:labels': {'f:pod-security.kubernetes.io/audit': {}, 'f:pod-security.kubernetes.io/audit-version': {}, 'f:pod-security.kubernetes.io/enforce': {}, 'f:pod-security.kubernetes.io/enforce-version': {}, 'f:pod-security.kubernetes.io/warn': {}, 'f:pod-security.kubernetes.io/warn-version': {}}}}}, {'manager': 'cluster-policy-controller', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-15T07:15:52Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:openshift.io/sa.scc.mcs': {}, 'f:openshift.io/sa.scc.supplemental-groups': {}, 'f:openshift.io/sa.scc.uid-range': {}}}}}, {'manager': 'openshift-apiserver', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-15T07:15:52Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:openshift.io/description': {}, 'f:openshift.io/display-name': {}, 'f:openshift.io/requester': {}}, 'f:labels': {'.': {}, 'f:kubernetes.io/metadata.name': {}}}}}, {'manager': 'openshift-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-15T07:15:52Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'f:finalizers': {}}}, 'subresource': 'finalize'}]}, 'spec': {'finalizers': ['kubernetes']}, 'status': {'phase': 'Active'}} [ocp_resources Project] 2026-06-15T07:21:08.777573Z [info ] Wait until Project llm is deleted [ocp_resources Project] 2026-06-15T07:21:08.777977Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] _ 5 of 15 completed, 0 Pass, 3 Fail, 1 Skip, 0 XPass, 0 XFail, 1 Error, 0 ReRun _ tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py::TestAPIKeyCRUD::test_create_api_key[ocp_token_for_actor0] 2026-06-15T07:21:16.947322Z [info ] Elapsed time: 8.135029077529907 [0:00:08.135029] [timeout_sampler]  -------------------------------------- test_create_api_key[ocp_token_for_actor0] -------------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-06-15T07:21:16.949737Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.949856Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.949977Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.950093Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.950307Z [info ] [cached since 654.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py::test_create_api_key[ocp_token_for_actor0]', 1781508076) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.950468Z [info ] [cached since 654.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py::test_create_api_key[ocp_token_for_actor0]', 1781508076) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.951018Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.951158Z [info ] COMMIT  [sqlalchemy.engine.Engine] SKIPPED _ 6 of 15 completed, 0 Pass, 3 Fail, 2 Skip, 0 XPass, 0 XFail, 1 Error, 0 ReRun _ tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py::TestAPIKeyCRUD::test_revoke_api_key[ocp_token_for_actor0]  TEST: TestAPIKeyCRUD.test_create_api_key[ocp_token_for_actor0] STATUS: SKIPPED SKIPPED _ 7 of 15 completed, 0 Pass, 3 Fail, 3 Skip, 0 XPass, 0 XFail, 1 Error, 0 ReRun _ tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::TestMaaSAuthPolicyEnforcementTinyLlama::test_authorized_user_gets_200[ocp_token_for_actor0] ------------------------------------------------------- TEARDOWN -------------------------------------------------------  -------------------------------------- test_revoke_api_key[ocp_token_for_actor0] -------------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-06-15T07:21:16.956903Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.957033Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.957174Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.958102Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.958305Z [info ] [cached since 654.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py::test_revoke_api_key[ocp_token_for_actor0]', 1781508076) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.958455Z [info ] [cached since 654.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py::test_revoke_api_key[ocp_token_for_actor0]', 1781508076) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.958605Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.958729Z [info ] COMMIT  [sqlalchemy.engine.Engine]  TEST: TestAPIKeyCRUD.test_revoke_api_key[ocp_token_for_actor0] STATUS: SKIPPED ------------------------------------------------------- TEARDOWN -------------------------------------------------------  --------------------------------- test_authorized_user_gets_200[ocp_token_for_actor0] --------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-06-15T07:21:16.959310Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.959425Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.959536Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.959645Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.959776Z [info ] [cached since 654.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_authorized_user_gets_200[ocp_token_for_actor0]', 1781508076) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.959905Z [info ] [cached since 654.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_authorized_user_gets_200[ocp_token_for_actor0]', 1781508076) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.960019Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.960129Z [info ] COMMIT  [sqlalchemy.engine.Engine] SKIPPED _ 8 of 15 completed, 0 Pass, 3 Fail, 4 Skip, 0 XPass, 0 XFail, 1 Error, 0 ReRun _ tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::TestMaaSAuthPolicyEnforcementTinyLlama::test_no_auth_header_gets_401  TEST: TestMaaSAuthPolicyEnforcementTinyLlama.test_authorized_user_gets_200[ocp_token_for_actor0] STATUS: SKIPPED SKIPPED _ 9 of 15 completed, 0 Pass, 3 Fail, 5 Skip, 0 XPass, 0 XFail, 1 Error, 0 ReRun _ tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::TestMaaSAuthPolicyEnforcementTinyLlama::test_invalid_token_gets_401 ------------------------------------------------------- TEARDOWN -------------------------------------------------------  --------------------------------------------- test_no_auth_header_gets_401 --------------------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- SKIPPED _ 10 of 15 completed, 0 Pass, 3 Fail, 6 Skip, 0 XPass, 0 XFail, 1 Error, 0 ReRun _ tests/model_serving/maas_billing/maas_subscription/test_maas_sub_enforcement.py::TestSubscriptionEnforcementTinyLlama::test_subscribed_user_gets_200[ocp_token_for_actor0] 2026-06-15T07:21:16.966714Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.966918Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.967051Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.967177Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.967342Z [info ] [cached since 654.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_no_auth_header_gets_401', 1781508076) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.967493Z [info ] [cached since 654.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_no_auth_header_gets_401', 1781508076) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.967616Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.967751Z [info ] COMMIT  [sqlalchemy.engine.Engine]  TEST: TestMaaSAuthPolicyEnforcementTinyLlama.test_no_auth_header_gets_401 STATUS: SKIPPED ------------------------------------------------------- TEARDOWN -------------------------------------------------------  --------------------------------------------- test_invalid_token_gets_401 --------------------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-06-15T07:21:16.968840Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.968956Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.969071Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.969184Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.969371Z [info ] [cached since 654.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_invalid_token_gets_401', 1781508076) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.969513Z [info ] [cached since 654.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_invalid_token_gets_401', 1781508076) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.969631Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.969748Z [info ] COMMIT  [sqlalchemy.engine.Engine]  TEST: TestMaaSAuthPolicyEnforcementTinyLlama.test_invalid_token_gets_401 STATUS: SKIPPED ------------------------------------------------------- TEARDOWN -------------------------------------------------------  --------------------------------- test_subscribed_user_gets_200[ocp_token_for_actor0] --------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-06-15T07:21:16.970895Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] SKIPPED _ 11 of 15 completed, 0 Pass, 3 Fail, 7 Skip, 0 XPass, 0 XFail, 1 Error, 0 ReRun _ tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::TestAIGatewayTenantSetup::test_aigateway_crd_exists 2026-06-15T07:21:16.972302Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.972450Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.972570Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.972706Z [info ] [cached since 654.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_sub_enforcement.py::test_subscribed_user_gets_200[ocp_token_for_actor0]', 1781508076) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.972838Z [info ] [cached since 654.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_sub_enforcement.py::test_subscribed_user_gets_200[ocp_token_for_actor0]', 1781508076) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.972957Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.973067Z [info ] COMMIT  [sqlalchemy.engine.Engine]  TEST: TestSubscriptionEnforcementTinyLlama.test_subscribed_user_gets_200[ocp_token_for_actor0] STATUS: SKIPPED ------------------------------------------------------- TEARDOWN -------------------------------------------------------  ---------------------------------------------- test_aigateway_crd_exists ---------------------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-06-15T07:21:16.974700Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.974833Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.974951Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.975064Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.975196Z [info ] [cached since 654.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::test_aigateway_crd_exists', 1781508076) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.975352Z [info ] [cached since 654.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::test_aigateway_crd_exists', 1781508076) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.975485Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.975598Z [info ] COMMIT  [sqlalchemy.engine.Engine] --------------------------------------------------------- CALL --------------------------------------------------------- 2026-06-15T07:21:16.978063Z [info ] kind: CustomResourceDefinition api version: apiextensions.k8s.io/v1 [ocp_resources.resource] FAILED TEST: TestAIGatewayTenantSetup.test_aigateway_crd_exists STATUS: FAILED 2026-06-15T07:21:16.996089Z [error ] Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 179, in pytest_runtest_call item.runtest() ~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1720, in runtest self.ihook.pytest_pyfunc_call(pyfuncitem=self) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 166, in pytest_pyfunc_call result = testfunction(**testargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py", line 25, in test_aigateway_crd_exists crd = CustomResourceDefinition( client=admin_client, name=AIGATEWAY_CRD_NAME, ensure_exists=True, ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 706, in __init__ self._ensure_exists() ~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 717, in _ensure_exists raise ResourceNotFoundError(f"Resource `{self.kind}` `{_name_for_raise}` does not exist") kubernetes.dynamic.exceptions.ResourceNotFoundError: Resource `CustomResourceDefinition` `aigateways.maas.opendatahub.io` does not exist [conftest] 2026-06-15T07:21:16.996240Z [info ] Must-gather collection is enabled for /home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::test_aigateway_crd_exists. [conftest] 2026-06-15T07:21:16.996393Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.996513Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.996635Z [info ] SELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" FROM "OpenDataHubTestTable" WHERE "OpenDataHubTestTable".test_name = ? LIMIT ? OFFSET ? [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.996757Z [info ] SELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" FROM "OpenDataHubTestTable" WHERE "OpenDataHubTestTable".test_name = ? LIMIT ? OFFSET ? [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.996894Z [info ] [cached since 621.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::test_aigateway_crd_exists', 1, 0) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.997028Z [info ] [cached since 621.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::test_aigateway_crd_exists', 1, 0) [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.997149Z [info ] ROLLBACK  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.997283Z [info ] ROLLBACK  [sqlalchemy.engine.Engine] 2026-06-15T07:21:16.999343Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] 2026-06-15T07:21:17.080050Z [info ] Checking subscription rhods-operator [utilities.infra] name=utilities.infra 2026-06-15T07:21:17.094656Z [info ] Expected CSV: rhods-operator.3.4.0 [utilities.infra] name=utilities.infra 2026-06-15T07:21:17.104355Z [info ] kind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1 [ocp_resources.resource] 2026-06-15T07:21:17.275931Z [info ] Running oc adm must-gather --dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_crd_exists/pytest_exception_interact --since=300s --image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 command [pyhelper_utils.shell] 2026-06-15T07:21:29.198281Z [info ] Running must-gather-clean: must-gather-clean -c /home/odh/opendatahub-tests/utilities/manifests/must_gather_clean/must-gather-clean-config.yaml -i /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_crd_exists/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 -o /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_crd_exists/pytest_exception_interact/must-gather-cleaned [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:21:29.199688Z [info ] Running must-gather-clean -c /home/odh/opendatahub-tests/utilities/manifests/must_gather_clean/must-gather-clean-config.yaml -i /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_crd_exists/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 -o /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_crd_exists/pytest_exception_interact/must-gather-cleaned command [pyhelper_utils.shell] 2026-06-15T07:21:29.205207Z [info ] must-gather-clean output:  [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:21:29.205698Z [info ] Removed original must-gather output: /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_crd_exists/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:21:29.207379Z [info ] /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_crd_exists/pytest_exception_interact/mg-1781508076.zip is collected successfully [utilities.must_gather_collector] name=utilities.must_gather_collector ______________ TestAIGatewayTenantSetup.test_aigateway_crd_exists ______________ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 179, in pytest_runtest_call item.runtest() ~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1720, in runtest self.ihook.pytest_pyfunc_call(pyfuncitem=self) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 166, in pytest_pyfunc_call result = testfunction(**testargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py", line 25, in test_aigateway_crd_exists crd = CustomResourceDefinition( client=admin_client, name=AIGATEWAY_CRD_NAME, ensure_exists=True, ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 706, in __init__ self._ensure_exists() ~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 717, in _ensure_exists raise ResourceNotFoundError(f"Resource `{self.kind}` `{_name_for_raise}` does not exist") kubernetes.dynamic.exceptions.ResourceNotFoundError: Resource `CustomResourceDefinition` `aigateways.maas.opendatahub.io` does not exist _ 12 of 15 completed, 0 Pass, 4 Fail, 7 Skip, 0 XPass, 0 XFail, 1 Error, 0 ReRun _ tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::TestAIGatewayTenantSetup::test_aigateway_bootstrap_creates_tenant_environment ------------------------------------------------------- TEARDOWN -------------------------------------------------------  --------------------------------- test_aigateway_bootstrap_creates_tenant_environment --------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-06-15T07:21:29.209951Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:29.210098Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:29.210243Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:21:29.210720Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:21:29.210889Z [info ] [cached since 666.9s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::test_aigateway_bootstrap_creates_tenant_environment', 1781508089) [sqlalchemy.engine.Engine] 2026-06-15T07:21:29.212407Z [info ] [cached since 666.9s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::test_aigateway_bootstrap_creates_tenant_environment', 1781508089) [sqlalchemy.engine.Engine] 2026-06-15T07:21:29.212739Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:21:29.212970Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:21:29.213181Z [info ] Executing session fixture: aigateway_infra_namespace [conftest] ERROR TEST: TestAIGatewayTenantSetup.test_aigateway_bootstrap_creates_tenant_environment [setup] STATUS: ERROR 2026-06-15T07:21:29.229494Z [error ] Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1110, in execute result: FixtureValue = ihook.pytest_fixture_setup( ~~~~~~~~~~~~~~~~~~~~~~~~~~^ fixturedef=self, request=request ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pytest_asyncio/plugin.py", line 924, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/setuponly.py", line 36, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 915, in call_fixture_func fixture_result = fixturefunc(**kwargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/conftest.py", line 34, in aigateway_infra_namespace assert infra_namespace.exists, ( f"Infra namespace '{AIGATEWAY_INFRA_NAMESPACE}' not found — required for AIGateway multitenancy tests" ) AssertionError: Infra namespace 'ai-gateway-system' not found — required for AIGateway multitenancy tests assert None + where None = .exists [conftest] 2026-06-15T07:21:29.229744Z [info ] Must-gather collection is enabled for /home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::test_aigateway_bootstrap_creates_tenant_environment. [conftest] 2026-06-15T07:21:29.229901Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:29.231872Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:21:29.232093Z [info ] SELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" FROM "OpenDataHubTestTable" WHERE "OpenDataHubTestTable".test_name = ? LIMIT ? OFFSET ? [sqlalchemy.engine.Engine] 2026-06-15T07:21:29.232268Z [info ] SELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" FROM "OpenDataHubTestTable" WHERE "OpenDataHubTestTable".test_name = ? LIMIT ? OFFSET ? [sqlalchemy.engine.Engine] 2026-06-15T07:21:29.236711Z [info ] [cached since 634s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::test_aigateway_bootstrap_creates_tenant_environment', 1, 0) [sqlalchemy.engine.Engine] 2026-06-15T07:21:29.237058Z [info ] [cached since 634s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::test_aigateway_bootstrap_creates_tenant_environment', 1, 0) [sqlalchemy.engine.Engine] 2026-06-15T07:21:29.237408Z [info ] ROLLBACK  [sqlalchemy.engine.Engine] 2026-06-15T07:21:29.237599Z [info ] ROLLBACK  [sqlalchemy.engine.Engine] 2026-06-15T07:21:29.237711Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] 2026-06-15T07:21:29.504595Z [info ] Checking subscription rhods-operator [utilities.infra] name=utilities.infra 2026-06-15T07:21:29.517608Z [info ] Expected CSV: rhods-operator.3.4.0 [utilities.infra] name=utilities.infra 2026-06-15T07:21:29.524349Z [info ] kind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1 [ocp_resources.resource] 2026-06-15T07:21:30.323727Z [info ] Running oc adm must-gather --dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_bootstrap_creates_tenant_environment/pytest_exception_interact --since=300s --image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 command [pyhelper_utils.shell] 2026-06-15T07:26:04.753124Z [info ] Running must-gather-clean: must-gather-clean -c /home/odh/opendatahub-tests/utilities/manifests/must_gather_clean/must-gather-clean-config.yaml -i /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_bootstrap_creates_tenant_environment/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 -o /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_bootstrap_creates_tenant_environment/pytest_exception_interact/must-gather-cleaned [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:26:04.754730Z [info ] Running must-gather-clean -c /home/odh/opendatahub-tests/utilities/manifests/must_gather_clean/must-gather-clean-config.yaml -i /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_bootstrap_creates_tenant_environment/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 -o /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_bootstrap_creates_tenant_environment/pytest_exception_interact/must-gather-cleaned command [pyhelper_utils.shell] 2026-06-15T07:26:05.668609Z [info ] must-gather-clean output:  [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:26:05.714985Z [info ] Removed original must-gather output: /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_bootstrap_creates_tenant_environment/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:26:05.947377Z [info ] /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_bootstrap_creates_tenant_environment/pytest_exception_interact/mg-1781508089.zip is collected successfully [utilities.must_gather_collector] name=utilities.must_gather_collector ------------------------------------------------------- TEARDOWN ------------------------------------------------------- _ ERROR at setup of TestAIGatewayTenantSetup.test_aigateway_bootstrap_creates_tenant_environment _ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1110, in execute result: FixtureValue = ihook.pytest_fixture_setup( ~~~~~~~~~~~~~~~~~~~~~~~~~~^ fixturedef=self, request=request ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pytest_asyncio/plugin.py", line 924, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/setuponly.py", line 36, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 915, in call_fixture_func fixture_result = fixturefunc(**kwargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/conftest.py", line 34, in aigateway_infra_namespace assert infra_namespace.exists, ( f"Infra namespace '{AIGATEWAY_INFRA_NAMESPACE}' not found — required for AIGateway multitenancy tests" ) AssertionError: Infra namespace 'ai-gateway-system' not found — required for AIGateway multitenancy tests assert None + where None = .exists _ 13 of 15 completed, 0 Pass, 4 Fail, 7 Skip, 0 XPass, 0 XFail, 2 Error, 0 ReRun _ tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::TestAIGatewayTenantSetup::test_aigateway_bootstrap_does_not_break_default_tenant  -------------------------------- test_aigateway_bootstrap_does_not_break_default_tenant -------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-06-15T07:26:05.950216Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:26:05.950409Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:26:05.950546Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:26:05.950678Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:26:05.950829Z [info ] [cached since 943.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::test_aigateway_bootstrap_does_not_break_default_tenant', 1781508365) [sqlalchemy.engine.Engine] 2026-06-15T07:26:05.950964Z [info ] [cached since 943.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::test_aigateway_bootstrap_does_not_break_default_tenant', 1781508365) [sqlalchemy.engine.Engine] 2026-06-15T07:26:05.951402Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:26:05.951513Z [info ] COMMIT  [sqlalchemy.engine.Engine] ERROR TEST: TestAIGatewayTenantSetup.test_aigateway_bootstrap_does_not_break_default_tenant [setup] STATUS: ERROR 2026-06-15T07:26:05.955834Z [error ] Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute raise exc.with_traceback(exc_tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 915, in call_fixture_func fixture_result = fixturefunc(**kwargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/conftest.py", line 34, in aigateway_infra_namespace assert infra_namespace.exists, ( f"Infra namespace '{AIGATEWAY_INFRA_NAMESPACE}' not found — required for AIGateway multitenancy tests" ) AssertionError: Infra namespace 'ai-gateway-system' not found — required for AIGateway multitenancy tests assert None + where None = .exists [conftest] 2026-06-15T07:26:05.955989Z [info ] Must-gather collection is enabled for /home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::test_aigateway_bootstrap_does_not_break_default_tenant. [conftest] 2026-06-15T07:26:05.956112Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:26:05.956233Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:26:05.956405Z [info ] SELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" FROM "OpenDataHubTestTable" WHERE "OpenDataHubTestTable".test_name = ? LIMIT ? OFFSET ? [sqlalchemy.engine.Engine] 2026-06-15T07:26:05.956551Z [info ] SELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" FROM "OpenDataHubTestTable" WHERE "OpenDataHubTestTable".test_name = ? LIMIT ? OFFSET ? [sqlalchemy.engine.Engine] 2026-06-15T07:26:05.956777Z [info ] [cached since 910.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::test_aigateway_bootstrap_does_not_break_default_tenant', 1, 0) [sqlalchemy.engine.Engine] 2026-06-15T07:26:05.956913Z [info ] [cached since 910.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::test_aigateway_bootstrap_does_not_break_default_tenant', 1, 0) [sqlalchemy.engine.Engine] 2026-06-15T07:26:05.958930Z [info ] ROLLBACK  [sqlalchemy.engine.Engine] 2026-06-15T07:26:05.963348Z [info ] ROLLBACK  [sqlalchemy.engine.Engine] 2026-06-15T07:26:05.967424Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] 2026-06-15T07:26:06.037374Z [info ] Checking subscription rhods-operator [utilities.infra] name=utilities.infra 2026-06-15T07:26:06.050068Z [info ] Expected CSV: rhods-operator.3.4.0 [utilities.infra] name=utilities.infra 2026-06-15T07:26:06.057142Z [info ] kind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1 [ocp_resources.resource] 2026-06-15T07:26:06.189688Z [info ] Running oc adm must-gather --dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_bootstrap_does_not_break_default_tenant/pytest_exception_interact --since=300s --image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 command [pyhelper_utils.shell] 2026-06-15T07:26:16.919783Z [info ] Running must-gather-clean: must-gather-clean -c /home/odh/opendatahub-tests/utilities/manifests/must_gather_clean/must-gather-clean-config.yaml -i /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_bootstrap_does_not_break_default_tenant/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 -o /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_bootstrap_does_not_break_default_tenant/pytest_exception_interact/must-gather-cleaned [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:26:16.920959Z [info ] Running must-gather-clean -c /home/odh/opendatahub-tests/utilities/manifests/must_gather_clean/must-gather-clean-config.yaml -i /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_bootstrap_does_not_break_default_tenant/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 -o /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_bootstrap_does_not_break_default_tenant/pytest_exception_interact/must-gather-cleaned command [pyhelper_utils.shell] 2026-06-15T07:26:16.926136Z [info ] must-gather-clean output:  [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:26:16.926613Z [info ] Removed original must-gather output: /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_bootstrap_does_not_break_default_tenant/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:26:16.928385Z [info ] /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup/TestAIGatewayTenantSetup/test_aigateway_bootstrap_does_not_break_default_tenant/pytest_exception_interact/mg-1781508365.zip is collected successfully [utilities.must_gather_collector] name=utilities.must_gather_collector _ ERROR at setup of TestAIGatewayTenantSetup.test_aigateway_bootstrap_does_not_break_default_tenant _ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute raise exc.with_traceback(exc_tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 915, in call_fixture_func fixture_result = fixturefunc(**kwargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/conftest.py", line 34, in aigateway_infra_namespace assert infra_namespace.exists, ( f"Infra namespace '{AIGATEWAY_INFRA_NAMESPACE}' not found — required for AIGateway multitenancy tests" ) AssertionError: Infra namespace 'ai-gateway-system' not found — required for AIGateway multitenancy tests assert None + where None = .exists _ 14 of 15 completed, 0 Pass, 4 Fail, 7 Skip, 0 XPass, 0 XFail, 3 Error, 0 ReRun _ tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py::TestOIDCTokenFlow::test_oidc_token_creates_api_key ------------------------------------------------------- TEARDOWN -------------------------------------------------------  ------------------------------------------- test_oidc_token_creates_api_key ------------------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-06-15T07:26:16.931447Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:26:16.931591Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:26:16.931733Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:26:16.931869Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-15T07:26:16.932042Z [info ] [cached since 954.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py::test_oidc_token_creates_api_key', 1781508376) [sqlalchemy.engine.Engine] 2026-06-15T07:26:16.932205Z [info ] [cached since 954.7s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py::test_oidc_token_creates_api_key', 1781508376) [sqlalchemy.engine.Engine] 2026-06-15T07:26:16.933042Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:26:16.935294Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-15T07:26:16.935544Z [info ] Executing class fixture: maas_unprivileged_model_namespace [conftest] 2026-06-15T07:26:16.935665Z [info ] kind: ProjectRequest api version: project.openshift.io/v1 [ocp_resources.resource] 2026-06-15T07:26:16.935785Z [info ] Create ProjectRequest llm  [ocp_resources ProjectRequest] 2026-06-15T07:26:16.935896Z [info ] Posting {'apiVersion': 'project.openshift.io/v1', 'kind': 'ProjectRequest', 'metadata': {'name': 'llm'}} [ocp_resources ProjectRequest] 2026-06-15T07:26:17.346604Z [info ] kind: Project api version: project.openshift.io/v1 [ocp_resources.resource] 2026-06-15T07:26:17.346774Z [info ] Wait for Project llm status to be Active [ocp_resources Project] 2026-06-15T07:26:17.346893Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_status.lambda: self.exists) [timeout_sampler] 2026-06-15T07:26:17.364552Z [info ] Status of Project llm is Active [ocp_resources Project] 2026-06-15T07:26:17.364707Z [info ] Elapsed time: 4.029273986816406e-05 [0:00:00.000040] [timeout_sampler] 2026-06-15T07:26:17.364823Z [info ] Executing class fixture: oidc_subscription [conftest] 2026-06-15T07:26:17.426569Z [info ] kind: MaaSModelRef api version: maas.opendatahub.io/v1alpha1 [ocp_resources.resource] 2026-06-15T07:26:17.426729Z [info ] Create MaaSModelRef e2e-authz-model-feab77ff [ocp_resources MaaSModelRef] 2026-06-15T07:26:17.426900Z [info ] Posting {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'kind': 'MaaSModelRef', 'metadata': {'name': 'e2e-authz-model-feab77ff', 'namespace': 'llm'}, 'spec': {'modelRef': {'name': 'e2e-authz-model-feab77ff', 'namespace': 'llm', 'kind': 'LLMInferenceService'}}} [ocp_resources MaaSModelRef] 2026-06-15T07:26:17.456622Z [info ] Wait until MaaSModelRef e2e-authz-model-feab77ff is created [ocp_resources MaaSModelRef] 2026-06-15T07:26:17.456757Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-06-15T07:26:17.469115Z [info ] Elapsed time: 4.410743713378906e-05 [0:00:00.000044] [timeout_sampler] 2026-06-15T07:26:17.469557Z [info ] kind: MaaSSubscription api version: maas.opendatahub.io/v1alpha1 [ocp_resources.resource] 2026-06-15T07:26:17.469723Z [info ] Create MaaSSubscription e2e-oidc-sub-298b4431 [ocp_resources MaaSSubscription] 2026-06-15T07:26:17.469843Z [info ] Posting {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'kind': 'MaaSSubscription', 'metadata': {'name': 'e2e-oidc-sub-298b4431', 'namespace': 'models-as-a-service'}, 'spec': {'modelRefs': [{'name': 'e2e-authz-model-feab77ff', 'namespace': 'llm', 'tokenRateLimits': [{'limit': 1000, 'window': '1m'}]}], 'owner': {'groups': [{'name': 'maas-users'}]}, 'priority': 0}} [ocp_resources MaaSSubscription] 2026-06-15T07:26:17.499216Z [info ] Wait until MaaSSubscription e2e-oidc-sub-298b4431 is created [ocp_resources MaaSSubscription] 2026-06-15T07:26:17.499611Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-06-15T07:26:17.511383Z [info ] Elapsed time: 4.291534423828125e-05 [0:00:00.000043] [timeout_sampler] 2026-06-15T07:26:17.511648Z [info ] Executing class fixture: maas_scheme [conftest] 2026-06-15T07:26:17.525353Z [info ] Executing class fixture: maas_host [conftest] 2026-06-15T07:26:17.525580Z [info ] kind: Ingress api version: config.openshift.io/v1 [ocp_resources.resource] 2026-06-15T07:26:17.550348Z [info ] Executing class fixture: base_url [conftest] 2026-06-15T07:26:17.550643Z [info ] Executing class fixture: maas_api_deployment_available [conftest] 2026-06-15T07:26:17.550754Z [info ] kind: Deployment api version: apps/v1 [ocp_resources.resource] 2026-06-15T07:26:17.563362Z [info ] Wait for Deployment/maas-api's 'Available' condition to be 'True' [ocp_resources Deployment] 2026-06-15T07:26:17.563614Z [info ] Wait until Deployment maas-api is created [ocp_resources Deployment] 2026-06-15T07:26:17.563724Z [info ] Waiting for 600 seconds [0:10:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-06-15T07:26:17.575358Z [info ] Elapsed time: 3.266334533691406e-05 [0:00:00.000033] [timeout_sampler] 2026-06-15T07:26:17.575630Z [info ] Waiting for 599.9879491329193 seconds [0:09:59.987949], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-06-15T07:26:17.587602Z [info ] Elapsed time: 3.266334533691406e-05 [0:00:00.000033] [timeout_sampler] 2026-06-15T07:26:17.587725Z [info ] Executing class fixture: maas_api_endpoints_ready [conftest] 2026-06-15T07:26:17.587834Z [info ] Waiting for 300 seconds [0:05:00], retry every 5 seconds. (Function: tests.model_serving.maas_billing.utils.endpoints_have_ready_addresses Kwargs: {'admin_client': , 'namespace': 'redhat-ods-applications', 'name': 'maas-api'}) [timeout_sampler] 2026-06-15T07:26:17.613400Z [info ] Elapsed time: 3.2901763916015625e-05 [0:00:00.000033] [timeout_sampler] 2026-06-15T07:26:17.613639Z [info ] Executing class fixture: maas_api_gateway_reachable [conftest] 2026-06-15T07:26:17.613748Z [info ] Waiting for 300 seconds [0:05:00], retry every 5 seconds. (Function: tests.model_serving.maas_billing.utils.gateway_probe_reaches_maas_api Kwargs: {'http_session': , 'probe_url': 'https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models', 'request_timeout_seconds': 30}) [timeout_sampler] 2026-06-15T07:26:17.657633Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:26:17.658185Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:26:22.725665Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:26:22.726440Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:26:27.768227Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:26:27.768899Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:26:32.832617Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:26:32.833212Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:26:37.876167Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:26:37.876760Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:26:42.919019Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:26:42.919696Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:26:47.963742Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:26:47.964344Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:26:53.012561Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:26:53.013137Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:26:58.066609Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:26:58.067351Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:27:03.103406Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:27:03.104139Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:27:08.141290Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:27:08.141855Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:27:13.204647Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:27:13.205241Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:27:18.249195Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:27:18.249792Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:27:23.290410Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:27:23.290998Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:27:28.329435Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:27:28.330061Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:27:33.376076Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:27:33.376668Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:27:38.415213Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:27:38.415854Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:27:43.461071Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:27:43.461807Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:27:48.501312Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:27:48.502093Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:27:53.543350Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:27:53.543937Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:27:58.583601Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:27:58.584192Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:28:03.624802Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:28:03.625626Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:28:08.671117Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:28:08.671938Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:28:13.716547Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:28:13.717155Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:28:18.755354Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:28:18.755957Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:28:23.803483Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:28:23.804046Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:28:28.862885Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:28:28.863466Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:28:33.899191Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:28:33.899948Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:28:38.941646Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:28:38.942248Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:28:43.978996Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:28:43.979593Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:28:49.019078Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:28:49.019678Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:28:54.058095Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:28:54.059082Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:28:59.134551Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:28:59.135250Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:29:04.174408Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:29:04.174975Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:29:09.215692Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:29:09.216305Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:29:14.253959Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:29:14.254579Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:29:19.295170Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:29:19.295760Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:29:24.332508Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:29:24.333101Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:29:29.370084Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:29:29.370774Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:29:34.430383Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:29:34.430950Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:29:39.466721Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:29:39.467310Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:29:44.506591Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:29:44.507423Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:29:49.549537Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:29:49.550330Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:29:54.587790Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:29:54.588390Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:29:59.627727Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:29:59.629156Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:30:04.667025Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:30:04.667760Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:30:09.709677Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:30:09.710272Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:30:14.752963Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:30:14.753572Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:30:19.798471Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:30:19.799055Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:30:24.867001Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:30:24.867757Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:30:29.908508Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:30:29.909836Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:30:34.957442Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:30:34.958034Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:30:39.998211Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:30:39.999094Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:30:45.040141Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:30:45.040944Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:30:50.111430Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:30:50.112912Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:30:55.154209Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:30:55.155140Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:31:00.205595Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:31:00.206240Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:31:05.240094Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:31:05.240716Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:31:10.281138Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:31:10.282582Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest 2026-06-15T07:31:15.321479Z [info ] Received 503 response from https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models,

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [tests.model_serving.maas_billing.utils] name=tests.model_serving.maas_billing.utils 2026-06-15T07:31:15.322044Z [warning ] MaaS gateway reachable: False, status_code: 503, response_text:

Application is not available

The application is currently not serving requests at this endpoint. It may not have been started or is still starting.

Possible reasons you are seeing this page:

  • The host doesn't exist. Make sure the hostname was typed correctly and that a route matching this hostname exists.
  • The host exists, but doesn't have a matching path. Check if the URL path was typed correctly and that the route was created using the desired path.
  • Route and path matches, but all pods are down. Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
 [conftest] name=conftest ERROR TEST: TestOIDCTokenFlow.test_oidc_token_creates_api_key [setup] STATUS: ERROR 2026-06-15T07:31:20.334199Z [error ] Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1110, in execute result: FixtureValue = ihook.pytest_fixture_setup( ~~~~~~~~~~~~~~~~~~~~~~~~~~^ fixturedef=self, request=request ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pytest_asyncio/plugin.py", line 924, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/setuponly.py", line 36, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 915, in call_fixture_func fixture_result = fixturefunc(**kwargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 903, in maas_api_gateway_reachable for gateway_reachable, _status_code, _response_text in TimeoutSampler( ~~~~~~~~~~~~~~^ wait_timeout=300, ^^^^^^^^^^^^^^^^^ ...<4 lines>... request_timeout_seconds=30, ^^^^^^^^^^^^^^^^^^^^^^^^^^^ ): ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__ raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp) timeout_sampler.TimeoutExpiredError: Timed Out: 300 Function: tests.model_serving.maas_billing.utils.gateway_probe_reaches_maas_api Kwargs: {'http_session': , 'probe_url': 'https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models', 'request_timeout_seconds': 30} Last exception: N/A. [conftest] 2026-06-15T07:31:20.334520Z [info ] Must-gather collection is enabled for /home/odh/opendatahub-tests/tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py::test_oidc_token_creates_api_key. [conftest] 2026-06-15T07:31:20.334686Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:31:20.334812Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-15T07:31:20.334982Z [info ] SELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" FROM "OpenDataHubTestTable" WHERE "OpenDataHubTestTable".test_name = ? LIMIT ? OFFSET ? [sqlalchemy.engine.Engine] 2026-06-15T07:31:20.335118Z [info ] SELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" FROM "OpenDataHubTestTable" WHERE "OpenDataHubTestTable".test_name = ? LIMIT ? OFFSET ? [sqlalchemy.engine.Engine] 2026-06-15T07:31:20.339824Z [info ] [cached since 1225s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py::test_oidc_token_creates_api_key', 1, 0) [sqlalchemy.engine.Engine] 2026-06-15T07:31:20.340040Z [info ] [cached since 1225s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py::test_oidc_token_creates_api_key', 1, 0) [sqlalchemy.engine.Engine] 2026-06-15T07:31:20.340188Z [info ] ROLLBACK  [sqlalchemy.engine.Engine] 2026-06-15T07:31:20.340379Z [info ] ROLLBACK  [sqlalchemy.engine.Engine] 2026-06-15T07:31:20.340551Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] 2026-06-15T07:31:20.478151Z [info ] Checking subscription rhods-operator [utilities.infra] name=utilities.infra 2026-06-15T07:31:20.490665Z [info ] Expected CSV: rhods-operator.3.4.0 [utilities.infra] name=utilities.infra 2026-06-15T07:31:20.579684Z [info ] kind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1 [ocp_resources.resource] 2026-06-15T07:31:20.823535Z [info ] Running oc adm must-gather --dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/oidc_tests/test_oidc_token_flow/TestOIDCTokenFlow/test_oidc_token_creates_api_key/pytest_exception_interact --since=304s --image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 command [pyhelper_utils.shell] 2026-06-15T07:31:31.518469Z [info ] Running must-gather-clean: must-gather-clean -c /home/odh/opendatahub-tests/utilities/manifests/must_gather_clean/must-gather-clean-config.yaml -i /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/oidc_tests/test_oidc_token_flow/TestOIDCTokenFlow/test_oidc_token_creates_api_key/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 -o /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/oidc_tests/test_oidc_token_flow/TestOIDCTokenFlow/test_oidc_token_creates_api_key/pytest_exception_interact/must-gather-cleaned [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:31:31.519609Z [info ] Running must-gather-clean -c /home/odh/opendatahub-tests/utilities/manifests/must_gather_clean/must-gather-clean-config.yaml -i /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/oidc_tests/test_oidc_token_flow/TestOIDCTokenFlow/test_oidc_token_creates_api_key/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 -o /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/oidc_tests/test_oidc_token_flow/TestOIDCTokenFlow/test_oidc_token_creates_api_key/pytest_exception_interact/must-gather-cleaned command [pyhelper_utils.shell] 2026-06-15T07:31:31.525242Z [info ] must-gather-clean output:  [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:31:31.525749Z [info ] Removed original must-gather output: /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/oidc_tests/test_oidc_token_flow/TestOIDCTokenFlow/test_oidc_token_creates_api_key/pytest_exception_interact/registry-redhat-io-rhoai-odh-must-gather-rhel9-sha256-3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 [utilities.must_gather_collector] name=utilities.must_gather_collector 2026-06-15T07:31:31.527482Z [info ] /home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/oidc_tests/test_oidc_token_flow/TestOIDCTokenFlow/test_oidc_token_creates_api_key/pytest_exception_interact/mg-1781508376.zip is collected successfully [utilities.must_gather_collector] name=utilities.must_gather_collector ------------------------------------------------------- TEARDOWN ------------------------------------------------------- 2026-06-15T07:31:31.528976Z [info ] Delete MaaSSubscription e2e-oidc-sub-298b4431 [ocp_resources MaaSSubscription] 2026-06-15T07:31:31.592065Z [info ] Deleting {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'kind': 'MaaSSubscription', 'metadata': {'creationTimestamp': '2026-06-15T07:26:17Z', 'finalizers': ['maas.opendatahub.io/subscription-cleanup'], 'generation': 1, 'managedFields': [{'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'.': {}, 'f:modelRefs': {}, 'f:owner': {'.': {}, 'f:groups': {}}, 'f:priority': {}}}, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': '2026-06-15T07:26:17Z'}, {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:finalizers': {'.': {}, 'v:"maas.opendatahub.io/subscription-cleanup"': {}}}}, 'manager': 'manager', 'operation': 'Update', 'time': '2026-06-15T07:26:17Z'}, {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'.': {}, 'f:conditions': {}, 'f:modelRefStatuses': {}, 'f:phase': {}, 'f:tokenRateLimitStatuses': {}}}, 'manager': 'manager', 'operation': 'Update', 'subresource': 'status', 'time': '2026-06-15T07:26:17Z'}], 'name': 'e2e-oidc-sub-298b4431', 'namespace': 'models-as-a-service', 'resourceVersion': '184691468', 'uid': '20d2447d-145e-43b8-a90d-2872b973b127'}, 'spec': {'modelRefs': [{'name': 'e2e-authz-model-feab77ff', 'namespace': 'llm', 'tokenRateLimits': [{'limit': 1000, 'window': '1m'}]}], 'owner': {'groups': [{'name': 'maas-users'}]}, 'priority': 0}, 'status': {'conditions': [{'lastTransitionTime': '2026-06-15T07:26:17Z', 'message': 'all 1 model references are invalid or unavailable', 'observedGeneration': 1, 'reason': 'ReconcileFailed', 'status': 'False', 'type': 'Ready'}], 'modelRefStatuses': [{'message': 'HTTPRoute not found yet; TokenRateLimitPolicy cannot be created: HTTPRoute not found yet: for LLMInferenceService e2e-authz-model-feab77ff in namespace llm', 'name': 'e2e-authz-model-feab77ff', 'namespace': 'llm', 'ready': False, 'reason': 'NotFound'}], 'phase': 'Failed', 'tokenRateLimitStatuses': [{'message': 'HTTPRoute not found yet; TokenRateLimitPolicy cannot be created: HTTPRoute not found yet: for LLMInferenceService e2e-authz-model-feab77ff in namespace llm', 'model': 'e2e-authz-model-feab77ff', 'name': 'maas-trlp-e2e-authz-model-feab77ff', 'namespace': 'llm', 'ready': False, 'reason': 'BackendNotReady'}]}} [ocp_resources MaaSSubscription] 2026-06-15T07:31:31.609246Z [info ] Wait until MaaSSubscription e2e-oidc-sub-298b4431 is deleted [ocp_resources MaaSSubscription] 2026-06-15T07:31:31.609447Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-06-15T07:31:32.636888Z [info ] Elapsed time: 1.0137763023376465 [0:00:01.013776] [timeout_sampler] 2026-06-15T07:31:32.637081Z [info ] Delete MaaSModelRef e2e-authz-model-feab77ff [ocp_resources MaaSModelRef] 2026-06-15T07:31:32.951433Z [info ] Deleting {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'kind': 'MaaSModelRef', 'metadata': {'creationTimestamp': '2026-06-15T07:26:17Z', 'finalizers': ['maas.opendatahub.io/model-cleanup'], 'generation': 1, 'managedFields': [{'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'.': {}, 'f:modelRef': {'.': {}, 'f:kind': {}, 'f:name': {}}}}, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': '2026-06-15T07:26:17Z'}, {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:finalizers': {'.': {}, 'v:"maas.opendatahub.io/model-cleanup"': {}}}}, 'manager': 'manager', 'operation': 'Update', 'time': '2026-06-15T07:26:17Z'}, {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'.': {}, 'f:conditions': {}, 'f:phase': {}}}, 'manager': 'manager', 'operation': 'Update', 'subresource': 'status', 'time': '2026-06-15T07:26:17Z'}], 'name': 'e2e-authz-model-feab77ff', 'namespace': 'llm', 'resourceVersion': '184691464', 'uid': '16a274d4-08c4-42ed-8054-37e0eb1207a3'}, 'spec': {'modelRef': {'kind': 'LLMInferenceService', 'name': 'e2e-authz-model-feab77ff'}}, 'status': {'conditions': [{'lastTransitionTime': '2026-06-15T07:26:17Z', 'message': 'Waiting for HTTPRoute to be created', 'observedGeneration': 1, 'reason': 'BackendNotReady', 'status': 'False', 'type': 'Ready'}], 'phase': 'Pending'}} [ocp_resources MaaSModelRef] 2026-06-15T07:31:32.968200Z [info ] Wait until MaaSModelRef e2e-authz-model-feab77ff is deleted [ocp_resources MaaSModelRef] 2026-06-15T07:31:32.968477Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-06-15T07:31:33.995240Z [info ] Elapsed time: 1.0129244327545166 [0:00:01.012924] [timeout_sampler] 2026-06-15T07:31:34.008430Z [info ] Delete Project llm  [ocp_resources Project] 2026-06-15T07:31:34.053624Z [info ] Deleting {'kind': 'Project', 'apiVersion': 'project.openshift.io/v1', 'metadata': {'name': 'llm', 'uid': 'ad358e7e-7c46-4918-adf8-7e320426b285', 'resourceVersion': '184691452', 'creationTimestamp': '2026-06-15T07:26:17Z', 'labels': {'kubernetes.io/metadata.name': 'llm', 'pod-security.kubernetes.io/audit': 'restricted', 'pod-security.kubernetes.io/audit-version': 'latest', 'pod-security.kubernetes.io/enforce': 'restricted', 'pod-security.kubernetes.io/enforce-version': 'latest', 'pod-security.kubernetes.io/warn': 'restricted', 'pod-security.kubernetes.io/warn-version': 'latest'}, 'annotations': {'openshift.io/description': '', 'openshift.io/display-name': '', 'openshift.io/requester': 'odh-user1', 'openshift.io/sa.scc.mcs': 's0:c31,c0', 'openshift.io/sa.scc.supplemental-groups': '1000930000/10000', 'openshift.io/sa.scc.uid-range': '1000930000/10000', 'security.openshift.io/MinimallySufficientPodSecurityStandard': 'restricted'}, 'managedFields': [{'manager': 'pod-security-admission-label-synchronization-controller', 'operation': 'Apply', 'apiVersion': 'v1', 'time': '2026-06-15T07:26:17Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:security.openshift.io/MinimallySufficientPodSecurityStandard': {}}, 'f:labels': {'f:pod-security.kubernetes.io/audit': {}, 'f:pod-security.kubernetes.io/audit-version': {}, 'f:pod-security.kubernetes.io/enforce': {}, 'f:pod-security.kubernetes.io/enforce-version': {}, 'f:pod-security.kubernetes.io/warn': {}, 'f:pod-security.kubernetes.io/warn-version': {}}}}}, {'manager': 'cluster-policy-controller', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-15T07:26:17Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:openshift.io/sa.scc.mcs': {}, 'f:openshift.io/sa.scc.supplemental-groups': {}, 'f:openshift.io/sa.scc.uid-range': {}}}}}, {'manager': 'openshift-apiserver', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-15T07:26:17Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:openshift.io/description': {}, 'f:openshift.io/display-name': {}, 'f:openshift.io/requester': {}}, 'f:labels': {'.': {}, 'f:kubernetes.io/metadata.name': {}}}}}, {'manager': 'openshift-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-15T07:26:17Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'f:finalizers': {}}}, 'subresource': 'finalize'}]}, 'spec': {'finalizers': ['kubernetes']}, 'status': {'phase': 'Active'}} [ocp_resources Project] 2026-06-15T07:31:34.074938Z [info ] Wait until Project llm is deleted [ocp_resources Project] 2026-06-15T07:31:34.075079Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-06-15T07:31:44.267095Z [info ] Elapsed time: 10.172805547714233 [0:00:10.172806] [timeout_sampler] 2026-06-15T07:31:44.269472Z [info ] ResourceEdits: Restoring data for resource Service authorino-authorino-authorization [ocp_resources.resource] 2026-06-15T07:31:44.269650Z [info ] Update Service authorino-authorino-authorization: {'metadata': {'annotations': {}, 'name': 'authorino-authorino-authorization'}} [ocp_resources Service] 2026-06-15T07:31:44.291073Z [info ] ResourceEdits: Restoring data for resource Deployment authorino [ocp_resources.resource] 2026-06-15T07:31:44.291387Z [info ] Update Deployment authorino: {'spec': {'template': {'spec': {'containers': [{'name': 'authorino', 'image': 'registry.redhat.io/rhcl-1/authorino-rhel9@sha256:b9e3aec873834dab0e8461e76931799ccd2538f1157a1626be233f8ede268c45', 'args': ['--allow-superseding-host-subsets', '--tls-cert=/etc/ssl/certs/tls.crt', '--tls-cert-key=/etc/ssl/private/tls.key'], 'env': [{'name': 'SSL_CERT_FILE', 'value': '/etc/ssl/certs/openshift-service-ca/service-ca-bundle.crt'}, {'name': 'REQUESTS_CA_BUNDLE', 'value': '/etc/ssl/certs/openshift-service-ca/service-ca-bundle.crt'}], 'resources': {}, 'volumeMounts': [{'name': 'tls-cert', 'readOnly': True, 'mountPath': '/etc/ssl/certs/tls.crt', 'subPath': 'tls.crt'}, {'name': 'tls-cert', 'readOnly': True, 'mountPath': '/etc/ssl/private/tls.key', 'subPath': 'tls.key'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}]}}}, 'metadata': {'name': 'authorino'}} [ocp_resources Deployment] 2026-06-15T07:31:44.309736Z [info ] ResourceEdits: Restoring data for resource Authorino authorino [ocp_resources.resource] 2026-06-15T07:31:44.310284Z [info ] Update Authorino authorino: {'spec': {'listener': {'tls': {'certSecretRef': {}}}}, 'metadata': {'name': 'authorino'}} [ocp_resources Authorino] 2026-06-15T07:31:44.329175Z [info ] Wait for Deployment/authorino's 'Available' condition to be 'True' [ocp_resources Deployment] 2026-06-15T07:31:44.329422Z [info ] Wait until Deployment authorino is created [ocp_resources Deployment] 2026-06-15T07:31:44.329601Z [info ] Waiting for 120 seconds [0:02:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-06-15T07:31:44.341626Z [info ] Elapsed time: 4.458427429199219e-05 [0:00:00.000045] [timeout_sampler] 2026-06-15T07:31:44.341816Z [info ] Waiting for 119.98751449584961 seconds [0:01:59.987514], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-06-15T07:31:44.354472Z [info ] Elapsed time: 3.743171691894531e-05 [0:00:00.000037] [timeout_sampler] 2026-06-15T07:31:44.353098Z [info ] authorino_tls_configured: TLS configuration removed, rollout complete [conftest] name=conftest 2026-06-15T07:31:44.354874Z [info ] ResourceEdits: Restoring data for resource DataScienceCluster default-dsc [ocp_resources.resource] 2026-06-15T07:31:44.355030Z [info ] Update DataScienceCluster default-dsc: {'spec': {'components': {'kserve': {'modelsAsService': {}}}}, 'metadata': {'name': 'default-dsc'}} [ocp_resources DataScienceCluster] 2026-06-15T07:31:44.397872Z [info ] Wait for DataScienceCluster/default-dsc's 'Ready' condition to be 'True' [ocp_resources DataScienceCluster] 2026-06-15T07:31:44.398068Z [info ] Wait until DataScienceCluster default-dsc is created [ocp_resources DataScienceCluster] 2026-06-15T07:31:44.398203Z [info ] Waiting for 600 seconds [0:10:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-06-15T07:31:44.421949Z [info ] Elapsed time: 6.198883056640625e-05 [0:00:00.000062] [timeout_sampler] 2026-06-15T07:31:44.422119Z [info ] Waiting for 599.9757571220398 seconds [0:09:59.975757], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-06-15T07:31:44.436768Z [info ] Elapsed time: 3.719329833984375e-05 [0:00:00.000037] [timeout_sampler] 2026-06-15T07:31:44.437292Z [info ] ResourceEdits: Restoring data for resource Gateway maas-default-gateway [ocp_resources.resource] 2026-06-15T07:31:44.437429Z [info ] Update Gateway maas-default-gateway: {'metadata': {'annotations': {}, 'name': 'maas-default-gateway'}} [ocp_resources Gateway] _____ ERROR at setup of TestOIDCTokenFlow.test_oidc_token_creates_api_key ______ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1110, in execute result: FixtureValue = ihook.pytest_fixture_setup( ~~~~~~~~~~~~~~~~~~~~~~~~~~^ fixturedef=self, request=request ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pytest_asyncio/plugin.py", line 924, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/setuponly.py", line 36, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 915, in call_fixture_func fixture_result = fixturefunc(**kwargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 903, in maas_api_gateway_reachable for gateway_reachable, _status_code, _response_text in TimeoutSampler( ~~~~~~~~~~~~~~^ wait_timeout=300, ^^^^^^^^^^^^^^^^^ ...<4 lines>... request_timeout_seconds=30, ^^^^^^^^^^^^^^^^^^^^^^^^^^^ ): ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__ raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp) timeout_sampler.TimeoutExpiredError: Timed Out: 300 Function: tests.model_serving.maas_billing.utils.gateway_probe_reaches_maas_api Kwargs: {'http_session': , 'probe_url': 'https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models', 'request_timeout_seconds': 30} Last exception: N/A. _ 15 of 15 completed, 0 Pass, 4 Fail, 7 Skip, 0 XPass, 0 XFail, 4 Error, 0 ReRun _ = 4 failed, 7 skipped, 161 deselected, 148 warnings, 4 errors in 1282.55s (0:21:22) = ==================================== ERRORS ==================================== _ ERROR at setup of TestAuthPolicyApiKeyValidation.test_auth_policy_callback_url_uses_correct_namespace _ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1110, in execute result: FixtureValue = ihook.pytest_fixture_setup( ~~~~~~~~~~~~~~~~~~~~~~~~~~^ fixturedef=self, request=request ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pytest_asyncio/plugin.py", line 924, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/setuponly.py", line 36, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 915, in call_fixture_func fixture_result = fixturefunc(**kwargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 903, in maas_api_gateway_reachable for gateway_reachable, _status_code, _response_text in TimeoutSampler( ~~~~~~~~~~~~~~^ wait_timeout=300, ^^^^^^^^^^^^^^^^^ ...<4 lines>... request_timeout_seconds=30, ^^^^^^^^^^^^^^^^^^^^^^^^^^^ ): ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__ raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp) timeout_sampler.TimeoutExpiredError: Timed Out: 300 Function: tests.model_serving.maas_billing.utils.gateway_probe_reaches_maas_api Kwargs: {'http_session': , 'probe_url': 'https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models', 'request_timeout_seconds': 30} Last exception: N/A. _ ERROR at setup of TestAIGatewayTenantSetup.test_aigateway_bootstrap_creates_tenant_environment _ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1110, in execute result: FixtureValue = ihook.pytest_fixture_setup( ~~~~~~~~~~~~~~~~~~~~~~~~~~^ fixturedef=self, request=request ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pytest_asyncio/plugin.py", line 924, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/setuponly.py", line 36, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 915, in call_fixture_func fixture_result = fixturefunc(**kwargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/conftest.py", line 34, in aigateway_infra_namespace assert infra_namespace.exists, ( f"Infra namespace '{AIGATEWAY_INFRA_NAMESPACE}' not found — required for AIGateway multitenancy tests" ) AssertionError: Infra namespace 'ai-gateway-system' not found — required for AIGateway multitenancy tests assert None + where None = .exists _ ERROR at setup of TestAIGatewayTenantSetup.test_aigateway_bootstrap_does_not_break_default_tenant _ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute raise exc.with_traceback(exc_tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 915, in call_fixture_func fixture_result = fixturefunc(**kwargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/conftest.py", line 34, in aigateway_infra_namespace assert infra_namespace.exists, ( f"Infra namespace '{AIGATEWAY_INFRA_NAMESPACE}' not found — required for AIGateway multitenancy tests" ) AssertionError: Infra namespace 'ai-gateway-system' not found — required for AIGateway multitenancy tests assert None + where None = .exists _____ ERROR at setup of TestOIDCTokenFlow.test_oidc_token_creates_api_key ______ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1110, in execute result: FixtureValue = ihook.pytest_fixture_setup( ~~~~~~~~~~~~~~~~~~~~~~~~~~^ fixturedef=self, request=request ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pytest_asyncio/plugin.py", line 924, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/setuponly.py", line 36, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 915, in call_fixture_func fixture_result = fixturefunc(**kwargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 903, in maas_api_gateway_reachable for gateway_reachable, _status_code, _response_text in TimeoutSampler( ~~~~~~~~~~~~~~^ wait_timeout=300, ^^^^^^^^^^^^^^^^^ ...<4 lines>... request_timeout_seconds=30, ^^^^^^^^^^^^^^^^^^^^^^^^^^^ ): ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__ raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp) timeout_sampler.TimeoutExpiredError: Timed Out: 300 Function: tests.model_serving.maas_billing.utils.gateway_probe_reaches_maas_api Kwargs: {'http_session': , 'probe_url': 'https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models', 'request_timeout_seconds': 30} Last exception: N/A. =================================== FAILURES =================================== ____________ TestBBRSetup.test_bbr_pre_processing_deployment_ready _____________ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 179, in pytest_runtest_call item.runtest() ~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1720, in runtest self.ihook.pytest_pyfunc_call(pyfuncitem=self) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 166, in pytest_pyfunc_call result = testfunction(**testargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py", line 24, in test_bbr_pre_processing_deployment_ready verify_bbr_pre_processing_deployment_ready( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ admin_client=admin_client, ^^^^^^^^^^^^^^^^^^^^^^^^^^ gateway_namespace=bbr_gateway_namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/utils.py", line 29, in verify_bbr_pre_processing_deployment_ready assert deployment.exists, ( ^^^^^^^^^^^^^^^^^ AssertionError: Deployment 'openshift-ingress/payload-pre-processing' not found — payload-pre-processing must be deployed by the controller after PR #948 is merged ________ TestBBRSetup.test_bbr_pre_processing_service_exposes_port_9004 ________ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 179, in pytest_runtest_call item.runtest() ~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1720, in runtest self.ihook.pytest_pyfunc_call(pyfuncitem=self) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 166, in pytest_pyfunc_call result = testfunction(**testargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py", line 36, in test_bbr_pre_processing_service_exposes_port_9004 verify_bbr_pre_processing_service_port( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ admin_client=admin_client, ^^^^^^^^^^^^^^^^^^^^^^^^^^ gateway_namespace=bbr_gateway_namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/utils.py", line 55, in verify_bbr_pre_processing_service_port assert service.exists, f"Service '{gateway_namespace}/{BBR_PRE_PROCESSING_SERVICE_NAME}' not found" ^^^^^^^^^^^^^^ AssertionError: Service 'openshift-ingress/payload-pre-processing' not found _________ TestBBRSetup.test_bbr_pre_processing_destination_rule_exists _________ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 179, in pytest_runtest_call item.runtest() ~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1720, in runtest self.ihook.pytest_pyfunc_call(pyfuncitem=self) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 166, in pytest_pyfunc_call result = testfunction(**testargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py", line 48, in test_bbr_pre_processing_destination_rule_exists verify_bbr_pre_processing_destination_rule_exists( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ admin_client=admin_client, ^^^^^^^^^^^^^^^^^^^^^^^^^^ gateway_namespace=bbr_gateway_namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/utils.py", line 78, in verify_bbr_pre_processing_destination_rule_exists assert destination_rule.exists, ( ^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: DestinationRule 'openshift-ingress/payload-pre-processing' not found — expected to be created by the controller after reconciliation ______________ TestAIGatewayTenantSetup.test_aigateway_crd_exists ______________ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 179, in pytest_runtest_call item.runtest() ~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1720, in runtest self.ihook.pytest_pyfunc_call(pyfuncitem=self) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 166, in pytest_pyfunc_call result = testfunction(**testargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py", line 25, in test_aigateway_crd_exists crd = CustomResourceDefinition( client=admin_client, name=AIGATEWAY_CRD_NAME, ensure_exists=True, ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 706, in __init__ self._ensure_exists() ~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 717, in _ensure_exists raise ResourceNotFoundError(f"Resource `{self.kind}` `{_name_for_raise}` does not exist") kubernetes.dynamic.exceptions.ResourceNotFoundError: Resource `CustomResourceDefinition` `aigateways.maas.opendatahub.io` does not exist =============================== warnings summary =============================== tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py: 19 warnings tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py: 48 warnings tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py: 14 warnings tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py: 59 warnings /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-23.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::TestBBRSetup::test_bbr_pre_processing_deployment_ready tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::TestBBRSetup::test_bbr_pre_processing_service_exposes_port_9004 tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::TestBBRSetup::test_bbr_pre_processing_destination_rule_exists tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::TestAuthPolicyApiKeyValidation::test_auth_policy_callback_url_uses_correct_namespace tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::TestAIGatewayTenantSetup::test_aigateway_crd_exists tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::TestAIGatewayTenantSetup::test_aigateway_bootstrap_creates_tenant_environment tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::TestAIGatewayTenantSetup::test_aigateway_bootstrap_does_not_break_default_tenant tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py::TestOIDCTokenFlow::test_oidc_token_creates_api_key /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py:1636: FutureWarning: 'client' arg will be mandatory in the next major release. `config_file` and `context` args will be removed. super().__init__( -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html ------------ generated xml file: /artifacts/maas_billing-smoke.xml ------------- =========================== short test summary info ============================ FAILED tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::TestBBRSetup::test_bbr_pre_processing_deployment_ready - AssertionError: Deployment 'openshift-ingress/payload-pre-processing' not found — payload-pre-processing must be deployed by the controller after PR #948 is merged FAILED tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::TestBBRSetup::test_bbr_pre_processing_service_exposes_port_9004 - AssertionError: Service 'openshift-ingress/payload-pre-processing' not found FAILED tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::TestBBRSetup::test_bbr_pre_processing_destination_rule_exists - AssertionError: DestinationRule 'openshift-ingress/payload-pre-processing' not found — expected to be created by the controller after reconciliation FAILED tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::TestAIGatewayTenantSetup::test_aigateway_crd_exists - kubernetes.dynamic.exceptions.ResourceNotFoundError: Resource `CustomResourceDefinition` `aigateways.maas.opendatahub.io` does not exist ERROR tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::TestAuthPolicyApiKeyValidation::test_auth_policy_callback_url_uses_correct_namespace - timeout_sampler.TimeoutExpiredError: Timed Out: 300 Function: tests.model_serving.maas_billing.utils.gateway_probe_reaches_maas_api Kwargs: {'http_session': , 'probe_url': 'https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models', 'request_timeout_seconds': 30} Last exception: N/A. ERROR tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::TestAIGatewayTenantSetup::test_aigateway_bootstrap_creates_tenant_environment - AssertionError: Infra namespace 'ai-gateway-system' not found — required for AIGateway multitenancy tests assert None + where None = .exists ERROR tests/model_serving/maas_billing/multitenancy/aigateway/test_aigateway_tenant_setup.py::TestAIGatewayTenantSetup::test_aigateway_bootstrap_does_not_break_default_tenant - AssertionError: Infra namespace 'ai-gateway-system' not found — required for AIGateway multitenancy tests assert None + where None = .exists ERROR tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py::TestOIDCTokenFlow::test_oidc_token_creates_api_key - timeout_sampler.TimeoutExpiredError: Timed Out: 300 Function: tests.model_serving.maas_billing.utils.gateway_probe_reaches_maas_api Kwargs: {'http_session': , 'probe_url': 'https://maas.apps.ods-qe-psi-23.osp.rh-ods.com/maas-api/v1/models', 'request_timeout_seconds': 30} Last exception: N/A. = 4 failed, 7 skipped, 161 deselected, 148 warnings, 4 errors in 1282.56s (0:21:22) =