
--- BVT pytest attempt 2026-06-14T11:23:08.518993+00:00 (/.local/bin/uv run pytest...) ---
[2m2026-06-14T11:23:09.977514Z[0m [[32m[1minfo     [0m] [1mWriting tests log to /home/odh/opendatahub-tests/results/pytest-tests.log[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:09.986567Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:09.986735Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:09.987724Z[0m [[32m[1minfo     [0m] [1mPRAGMA main.table_info("OpenDataHubTestTable")[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:09.987953Z[0m [[32m[1minfo     [0m] [1mPRAGMA main.table_info("OpenDataHubTestTable")[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:09.988132Z[0m [[32m[1minfo     [0m] [1m[raw sql] ()                  [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:09.988455Z[0m [[32m[1minfo     [0m] [1m[raw sql] ()                  [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:09.988796Z[0m [[32m[1minfo     [0m] [1mPRAGMA temp.table_info("OpenDataHubTestTable")[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:09.991037Z[0m [[32m[1minfo     [0m] [1mPRAGMA temp.table_info("OpenDataHubTestTable")[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:09.991234Z[0m [[32m[1minfo     [0m] [1m[raw sql] ()                  [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:09.991404Z[0m [[32m[1minfo     [0m] [1m[raw sql] ()                  [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:09.991564Z[0m [[32m[1minfo     [0m] [1m
CREATE TABLE "OpenDataHubTestTable" (
	id INTEGER NOT NULL, 
	test_name VARCHAR(500) NOT NULL, 
	start_time INTEGER NOT NULL, 
	PRIMARY KEY (id)
)

[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:09.991754Z[0m [[32m[1minfo     [0m] [1m
CREATE TABLE "OpenDataHubTestTable" (
	id INTEGER NOT NULL, 
	test_name VARCHAR(500) NOT NULL, 
	start_time INTEGER NOT NULL, 
	PRIMARY KEY (id)
)

[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:09.992377Z[0m [[32m[1minfo     [0m] [1m[no key 0.00007s] ()          [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:09.992516Z[0m [[32m[1minfo     [0m] [1m[no key 0.00007s] ()          [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:09.992662Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:09.992782Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:09.992947Z[0m [[32m[1minfo     [0m] [1mTrying to get client via new_client_from_config[0m [[0m[1m[34mocp_resources.resource[0m][0m
/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-23.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings
  warnings.warn(
[2m2026-06-14T11:23:10.131511Z[0m [[32m[1minfo     [0m] [1mkind: DataScienceCluster api version: datasciencecluster.opendatahub.io/v2[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:23:10.204489Z[0m [[32m[1minfo     [0m] [1mkind: DSCInitialization api version: dscinitialization.opendatahub.io/v2[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:23:10.237017Z[0m [[32m[1minfo     [0m] [1mRunning model registry tests against default namespace[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:10.237145Z[0m [[32m[1minfo     [0m] [1mkind: DataScienceCluster api version: datasciencecluster.opendatahub.io/v2[0m [[0m[1m[34mocp_resources.resource[0m][0m
============================= test session starts ==============================
platform linux -- Python 3.14.5, pytest-9.0.3, pluggy-1.6.0 -- /home/odh/opendatahub-tests/.venv/bin/python
cachedir: .pytest_cache
metadata: {'Python': '3.14.5', 'Platform': 'Linux-5.14.0-427.115.1.el9_4.x86_64-x86_64-with-glibc2.42', 'Packages': {'pytest': '9.0.3', 'pluggy': '1.6.0'}, 'Plugins': {'anyio': '4.13.0', 'asyncio': '1.3.0', 'dependency': '0.6.1', 'html': '4.2.0', 'metadata': '3.1.1', 'order': '1.3.0', 'progress': '1.4.0', 'testconfig': '0.2.0', 'xdist': '3.8.0', 'syrupy': '5.1.0'}}
rootdir: /home/odh/opendatahub-tests
configfile: pytest.ini
plugins: anyio-4.13.0, asyncio-1.3.0, dependency-0.6.1, html-4.2.0, metadata-3.1.1, order-1.3.0, progress-1.4.0, testconfig-0.2.0, xdist-3.8.0, syrupy-5.1.0
asyncio: mode=Mode.STRICT, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function
collecting ... collected 105 items / 94 deselected / 11 selected

tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::TestAuthPolicyApiKeyValidation::test_auth_policy_callback_url_uses_correct_namespace [1m
--------------------------------- test_auth_policy_callback_url_uses_correct_namespace ---------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-06-14T11:23:10.519102Z[0m [[32m[1minfo     [0m] [1m(OpenDataHubTestTable|OpenDataHubTestTable) _post_configure_properties() started[0m [[0m[1m[34msqlalchemy.orm.mapper.Mapper[0m][0m
[2m2026-06-14T11:23:10.519279Z[0m [[32m[1minfo     [0m] [1m(OpenDataHubTestTable|OpenDataHubTestTable) initialize prop id[0m [[0m[1m[34msqlalchemy.orm.mapper.Mapper[0m][0m
[2m2026-06-14T11:23:10.519429Z[0m [[32m[1minfo     [0m] [1m(OpenDataHubTestTable|OpenDataHubTestTable) initialize prop test_name[0m [[0m[1m[34msqlalchemy.orm.mapper.Mapper[0m][0m
[2m2026-06-14T11:23:10.519583Z[0m [[32m[1minfo     [0m] [1m(OpenDataHubTestTable|OpenDataHubTestTable) initialize prop start_time[0m [[0m[1m[34msqlalchemy.orm.mapper.Mapper[0m][0m
[2m2026-06-14T11:23:10.520092Z[0m [[32m[1minfo     [0m] [1m(OpenDataHubTestTable|OpenDataHubTestTable) _post_configure_properties() complete[0m [[0m[1m[34msqlalchemy.orm.mapper.Mapper[0m][0m
[2m2026-06-14T11:23:10.520223Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:10.520678Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:10.521008Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:10.521199Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:10.522061Z[0m [[32m[1minfo     [0m] [1m[generated in 0.00014s] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::test_auth_policy_callback_url_uses_correct_namespace', 1781436190)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:10.522235Z[0m [[32m[1minfo     [0m] [1m[generated in 0.00014s] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::test_auth_policy_callback_url_uses_correct_namespace', 1781436190)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:10.522364Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:10.524351Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:23:10.525788Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: event_loop_policy[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:10.525958Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: _syrupy_apply_ide_patches[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:10.526091Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: admin_client[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:10.526219Z[0m [[32m[1minfo     [0m] [1mTrying to get client via new_client_from_config[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:23:10.526344Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: dsc_resource[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:10.526467Z[0m [[32m[1minfo     [0m] [1mkind: DataScienceCluster api version: datasciencecluster.opendatahub.io/v2[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:23:10.612191Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: tmp_path_factory[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:10.612349Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: tests_tmp_dir[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:10.613441Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: os_path_environment[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:10.613809Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: tmpdir_factory[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:10.614012Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: bin_directory[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:10.615133Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: oc_binary_path[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:10.634972Z[0m [[32m[1minfo     [0m] [1mkind: ConsoleCLIDownload api version: console.openshift.io/v1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:23:10.667608Z[0m [[32m[1minfo     [0m] [1mAll oc console cli download links: ['https://downloads-openshift-console.apps.ods-qe-psi-23.osp.rh-ods.com/amd64/linux/oc.tar'][0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:23:10.667776Z[0m [[32m[1minfo     [0m] [1mDownloading archive using: url=https://downloads-openshift-console.apps.ods-qe-psi-23.osp.rh-ods.com/amd64/linux/oc.tar[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:23:21.233999Z[0m [[32m[1minfo     [0m] [1mExtract the downloaded archive.[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:23:21.349928Z[0m [[32m[1minfo     [0m] [1mDownloaded file: ['oc']       [0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:23:21.372759Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: bin_directory_to_os_path[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:21.371214Z[0m [[32m[1minfo     [0m] [1mOC binary path: /tmp/pytest-TKkkvcxc4LwDKrthoexTX8/bin0/oc[0m [[0m[1m[34mtests.conftest[0m][0m [36mname[0m=[35mtests.conftest[0m
[2m2026-06-14T11:23:21.371268Z[0m [[32m[1minfo     [0m] [1mAdding /tmp/pytest-TKkkvcxc4LwDKrthoexTX8/bin0 to $PATH[0m [[0m[1m[34mtests.conftest[0m][0m [36mname[0m=[35mtests.conftest[0m
[2m2026-06-14T11:23:21.373204Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: nodes[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:22.169424Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: dsci_resource[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:22.169596Z[0m [[32m[1minfo     [0m] [1mkind: DSCInitialization api version: dscinitialization.opendatahub.io/v2[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:23:22.182186Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: record_testsuite_property[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:22.182395Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: junitxml_plugin[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:22.182537Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: cluster_sanity_scope_session[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:22.181618Z[0m [[32m[1minfo     [0m] [1mCheck cluster sanity.         [0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:23:22.182812Z[0m [[32m[1minfo     [0m] [1mVerify all nodes are in a healthy condition.[0m [[0m[1m[34mocp_utilities.infra[0m][0m
[2m2026-06-14T11:23:22.255491Z[0m [[32m[1minfo     [0m] [1mVerify all nodes are schedulable.[0m [[0m[1m[34mocp_utilities.infra[0m][0m
[2m2026-06-14T11:23:22.330063Z[0m [[32m[1minfo     [0m] [1mWaiting for 120 seconds [0:02:00], retry every 5 seconds. (Function: utilities.infra.wait_for_dsci_status_ready  Kwargs: {'dsci_resource': <ocp_resources.dsc_initialization.DSCInitialization object at 0x7fbcf535fed0>})[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-06-14T11:23:22.329448Z[0m [[32m[1minfo     [0m] [1mWait for DSCI default-dsci to be in Ready status.[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:23:22.330325Z[0m [[32m[1minfo     [0m] [1mGet DSCInitialization default-dsci status[0m [[0m[1m[34mocp_resources DSCInitialization[0m][0m
[2m2026-06-14T11:23:22.341190Z[0m [[32m[1minfo     [0m] [1mElapsed time: 7.867813110351562e-05 [0:00:00.000079][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-06-14T11:23:22.341319Z[0m [[32m[1minfo     [0m] [1mWaiting for 120 seconds [0:02:00], retry every 5 seconds. (Function: utilities.infra.wait_for_dsc_status_ready  Kwargs: {'dsc_resource': <ocp_resources.data_science_cluster.DataScienceCluster object at 0x7fbcf535efd0>})[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-06-14T11:23:22.340669Z[0m [[32m[1minfo     [0m] [1mWait for DSC default-dsc are Ready.[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:23:22.341539Z[0m [[32m[1minfo     [0m] [1mGet DataScienceCluster default-dsc status[0m [[0m[1m[34mocp_resources DataScienceCluster[0m][0m
[2m2026-06-14T11:23:22.353886Z[0m [[32m[1minfo     [0m] [1mElapsed time: 3.170967102050781e-05 [0:00:00.000032][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-06-14T11:23:22.354016Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: autouse_fixtures[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:22.354126Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: maas_gateway_api_hostname[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:22.385715Z[0m [[32m[1minfo     [0m] [1mkind: Ingress api version: config.openshift.io/v1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:23:22.408972Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: maas_gateway_api[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:22.431013Z[0m [[32m[1minfo     [0m] [1mkind: Gateway api version: gateway.networking.k8s.io/v1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:23:22.442958Z[0m [[32m[1minfo     [0m] [1mReusing existing gateway openshift-ingress/maas-default-gateway[0m [[0m[1m[34mconftest[0m][0m [36mname[0m=[35mconftest[0m
[2m2026-06-14T11:23:22.443762Z[0m [[32m[1minfo     [0m] [1mWait for Gateway/maas-default-gateway's 'Programmed' condition to be 'True'[0m [[0m[1m[34mocp_resources Gateway[0m][0m
[2m2026-06-14T11:23:22.443917Z[0m [[32m[1minfo     [0m] [1mWait until Gateway maas-default-gateway is created[0m [[0m[1m[34mocp_resources Gateway[0m][0m
[2m2026-06-14T11:23:22.444041Z[0m [[32m[1minfo     [0m] [1mWaiting for 300 seconds [0:05:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-06-14T11:23:22.456294Z[0m [[32m[1minfo     [0m] [1mElapsed time: 3.886222839355469e-05 [0:00:00.000039][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-06-14T11:23:22.456452Z[0m [[32m[1minfo     [0m] [1mWaiting for 299.9872612953186 seconds [0:04:59.987261], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-06-14T11:23:22.468891Z[0m [[32m[1minfo     [0m] [1mElapsed time: 3.790855407714844e-05 [0:00:00.000038][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-06-14T11:23:22.469103Z[0m [[32m[1minfo     [0m] [1mResourceEdit: Backing up old data[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:23:22.481753Z[0m [[32m[1minfo     [0m] [1mResourceEdits: Updating data for resource Gateway maas-default-gateway[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:23:22.481968Z[0m [[32m[1minfo     [0m] [1mUpdate Gateway maas-default-gateway:
{'metadata': {'annotations': {'security.opendatahub.io/authorino-tls-bootstrap': 'true'}, 'name': 'maas-default-gateway'}}[0m [[0m[1m[34mocp_resources Gateway[0m][0m
[2m2026-06-14T11:23:22.500296Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: pytestconfig[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:22.500469Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: use_unprivileged_client[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:22.500668Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: kubconfig_filepath[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:22.500807Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: cluster_authentication[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:22.500966Z[0m [[32m[1minfo     [0m] [1mkind: Authentication api version: config.openshift.io/v1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:23:22.512542Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: is_byoidc[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:22.524982Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: non_admin_user_password[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:22.547690Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: unprivileged_client[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:22.842939Z[0m [[32m[1minfo     [0m] [1mRequesting token for user odh-user1 from https://keycloak.qe.rh-ods.com/realms/openshift/protocol/openid-connect/token[0m [[0m[1m[34mutilities.user_utils[0m][0m
[2m2026-06-14T11:23:23.156115Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: maas_subscription_namespace[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:23.177241Z[0m [[32m[1minfo     [0m] [1mNamespace models-as-a-service already exists, reusing it[0m [[0m[1m[34mconftest[0m][0m [36mname[0m=[35mconftest[0m
[2m2026-06-14T11:23:23.178371Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: maas_subscription_controller_enabled_latest[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:23:23.178490Z[0m [[32m[1minfo     [0m] [1mResourceEdit: Backing up old data --- [DuplicateFilter: Last log `kind: Authentication api version: config.openshift.io/v1` repeated 3 times][0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:23:23.197427Z[0m [[32m[1minfo     [0m] [1mResourceEdits: Updating data for resource DataScienceCluster default-dsc[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:23:23.197878Z[0m [[32m[1minfo     [0m] [1mUpdate DataScienceCluster default-dsc:
{'spec': {'components': {'kserve': {'modelsAsService': {'managementState': 'Managed'}}}}, 'metadata': {'name': 'default-dsc'}}[0m [[0m[1m[34mocp_resources DataScienceCluster[0m][0m
[2m2026-06-14T11:23:23.237453Z[0m [[32m[1minfo     [0m] [1mWait for DataScienceCluster/default-dsc's 'ModelsAsServiceReady' condition to be 'True'[0m [[0m[1m[34mocp_resources DataScienceCluster[0m][0m
[2m2026-06-14T11:23:23.237755Z[0m [[32m[1minfo     [0m] [1mWait until DataScienceCluster default-dsc is created[0m [[0m[1m[34mocp_resources DataScienceCluster[0m][0m
[2m2026-06-14T11:23:23.238091Z[0m [[32m[1minfo     [0m] [1mWaiting for 900 seconds [0:15:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-06-14T11:23:23.254985Z[0m [[32m[1minfo     [0m] [1mElapsed time: 3.838539123535156e-05 [0:00:00.000038][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-06-14T11:23:23.255252Z[0m [[32m[1minfo     [0m] [1mWaiting for 899.9824194908142 seconds [0:14:59.982419], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-06-14T11:38:24.157906Z[0m [[32m[1minfo     [0m] [1mResourceEdits: Restoring data for resource DataScienceCluster default-dsc[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:38:24.158174Z[0m [[32m[1minfo     [0m] [1mUpdate DataScienceCluster default-dsc:
{'spec': {'components': {'kserve': {'modelsAsService': None}}}, 'metadata': {'name': 'default-dsc'}}[0m [[0m[1m[34mocp_resources DataScienceCluster[0m][0m
ERROR[1m
TEST: TestAuthPolicyApiKeyValidation.test_auth_policy_callback_url_uses_correct_namespace [setup] STATUS: [0;31mERROR[0m[0m
[2m2026-06-14T11:38:24.220581Z[0m [[31m[1merror    [0m] [1mTraceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1110, in execute
    result: FixtureValue = ihook.pytest_fixture_setup(
                           ~~~~~~~~~~~~~~~~~~~~~~~~~~^
        fixturedef=self, request=request
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pytest_asyncio/plugin.py", line 728, in pytest_fixture_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper
    return result.get_result()
           ~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result
    raise exc.with_traceback(tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper
    res = yield
          ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/setuponly.py", line 36, in pytest_fixture_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:38:24.220737Z[0m [[32m[1minfo     [0m] [1mMust-gather collection is enabled for /home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::test_auth_policy_callback_url_uses_correct_namespace.[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:38:24.221651Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:24.221839Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:24.223952Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:24.224160Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:24.228119Z[0m [[32m[1minfo     [0m] [1m[generated in 0.00014s] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::test_auth_policy_callback_url_uses_correct_namespace', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:24.228429Z[0m [[32m[1minfo     [0m] [1m[generated in 0.00014s] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::test_auth_policy_callback_url_uses_correct_namespace', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:24.228575Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:24.228709Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:24.228856Z[0m [[32m[1minfo     [0m] [1mTrying to get client via new_client_from_config[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:38:24.330496Z[0m [[32m[1minfo     [0m] [1mkind: Subscription api version: operators.coreos.com/v1alpha1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:38:24.343812Z[0m [[32m[1minfo     [0m] [1mChecking subscription rhods-operator[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:38:24.356128Z[0m [[32m[1minfo     [0m] [1mExpected CSV: rhods-operator.3.4.0[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:38:24.356633Z[0m [[32m[1minfo     [0m] [1mTrying to get client via new_client_from_config[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:38:24.364324Z[0m [[32m[1minfo     [0m] [1mkind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:38:24.507518Z[0m [[32m[1minfo     [0m] [1mRunning oc adm must-gather --dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation/TestAuthPolicyApiKeyValidation/test_auth_policy_callback_url_uses_correct_namespace/pytest_exception_interact --since=914s --image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 command[0m [[0m[1m[34mpyhelper_utils.shell[0m][0m
[2m2026-06-14T11:38:35.313773Z[0m [[32m[1minfo     [0m] [1m/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation/TestAuthPolicyApiKeyValidation/test_auth_policy_callback_url_uses_correct_namespace/pytest_exception_interact/mg-1781436190.zip is collected successfully[0m [[0m[1m[34mutilities.must_gather_collector[0m][0m [36mname[0m=[35mutilities.must_gather_collector[0m

_ ERROR at setup of TestAuthPolicyApiKeyValidation.test_auth_policy_callback_url_uses_correct_namespace _
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1110, in execute
    result: FixtureValue = ihook.pytest_fixture_setup(
                           ~~~~~~~~~~~~~~~~~~~~~~~~~~^
        fixturedef=self, request=request
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pytest_asyncio/plugin.py", line 728, in pytest_fixture_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper
    return result.get_result()
           ~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result
    raise exc.with_traceback(tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper
    res = yield
          ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/setuponly.py", line 36, in pytest_fixture_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
_ 1 of 11 completed, 0 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 1 Error, 0 ReRun _

tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::TestAuthPolicyApiKeyValidation::test_api_key_can_list_models[ocp_token_for_actor0] [1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
---------------------------------- test_api_key_can_list_models[ocp_token_for_actor0] ----------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-06-14T11:38:35.316332Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:35.316466Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:35.316574Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:35.316683Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:35.316856Z[0m [[32m[1minfo     [0m] [1m[cached since 924.8s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::test_api_key_can_list_models[ocp_token_for_actor0]', 1781437115)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:35.317233Z[0m [[32m[1minfo     [0m] [1m[cached since 924.8s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::test_api_key_can_list_models[ocp_token_for_actor0]', 1781437115)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:35.317355Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:35.317470Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
ERROR[1m
TEST: TestAuthPolicyApiKeyValidation.test_api_key_can_list_models[ocp_token_for_actor0] [setup] STATUS: [0;31mERROR[0m[0m
[2m2026-06-14T11:38:35.321980Z[0m [[31m[1merror    [0m] [1mTraceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:38:35.323879Z[0m [[32m[1minfo     [0m] [1mMust-gather collection is enabled for /home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::test_api_key_can_list_models[ocp_token_for_actor0].[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:38:35.324029Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:35.324150Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:35.324263Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:35.324372Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:35.324506Z[0m [[32m[1minfo     [0m] [1m[cached since 11.1s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::test_api_key_can_list_models[ocp_token_for_actor0]', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:35.324674Z[0m [[32m[1minfo     [0m] [1m[cached since 11.1s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::test_api_key_can_list_models[ocp_token_for_actor0]', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:35.324791Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:35.328636Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:38:35.328779Z[0m [[32m[1minfo     [0m] [1mTrying to get client via new_client_from_config[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:38:35.402270Z[0m [[32m[1minfo     [0m] [1mChecking subscription rhods-operator[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:38:35.414469Z[0m [[32m[1minfo     [0m] [1mExpected CSV: rhods-operator.3.4.0[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:38:35.421710Z[0m [[32m[1minfo     [0m] [1mkind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:38:35.579736Z[0m [[32m[1minfo     [0m] [1mRunning oc adm must-gather --dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation/TestAuthPolicyApiKeyValidation/test_api_key_can_list_models_ocp_token_for_actor0_/pytest_exception_interact --since=300s --image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 command[0m [[0m[1m[34mpyhelper_utils.shell[0m][0m
[2m2026-06-14T11:43:37.303590Z[0m [[32m[1minfo     [0m] [1m/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation/TestAuthPolicyApiKeyValidation/test_api_key_can_list_models_ocp_token_for_actor0_/pytest_exception_interact/mg-1781437115.zip is collected successfully[0m [[0m[1m[34mutilities.must_gather_collector[0m][0m [36mname[0m=[35mutilities.must_gather_collector[0m

_ ERROR at setup of TestAuthPolicyApiKeyValidation.test_api_key_can_list_models[ocp_token_for_actor0] _
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
_ 2 of 11 completed, 0 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 2 Error, 0 ReRun _

tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py::TestAPIKeyCRUD::test_create_api_key[ocp_token_for_actor0] [1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
-------------------------------------- test_create_api_key[ocp_token_for_actor0] --------------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-06-14T11:43:37.307639Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:37.307856Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:37.308037Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:37.308188Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:37.308370Z[0m [[32m[1minfo     [0m] [1m[cached since 1227s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py::test_create_api_key[ocp_token_for_actor0]', 1781437417)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:37.308537Z[0m [[32m[1minfo     [0m] [1m[cached since 1227s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py::test_create_api_key[ocp_token_for_actor0]', 1781437417)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:37.308981Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:37.309136Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
ERROR[1m
TEST: TestAPIKeyCRUD.test_create_api_key[ocp_token_for_actor0] [setup] STATUS: [0;31mERROR[0m[0m
[2m2026-06-14T11:43:37.313509Z[0m [[31m[1merror    [0m] [1mTraceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:43:37.313680Z[0m [[32m[1minfo     [0m] [1mMust-gather collection is enabled for /home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py::test_create_api_key[ocp_token_for_actor0].[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:43:37.313849Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:37.314005Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:37.314156Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:37.314299Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:37.314465Z[0m [[32m[1minfo     [0m] [1m[cached since 313.1s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py::test_create_api_key[ocp_token_for_actor0]', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:37.315211Z[0m [[32m[1minfo     [0m] [1m[cached since 313.1s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py::test_create_api_key[ocp_token_for_actor0]', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:37.315387Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:37.315532Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:37.315683Z[0m [[32m[1minfo     [0m] [1mTrying to get client via new_client_from_config[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:43:37.404129Z[0m [[32m[1minfo     [0m] [1mChecking subscription rhods-operator[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:43:37.418453Z[0m [[32m[1minfo     [0m] [1mExpected CSV: rhods-operator.3.4.0[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:43:37.424376Z[0m [[32m[1minfo     [0m] [1mkind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:43:37.582529Z[0m [[32m[1minfo     [0m] [1mRunning oc adm must-gather --dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_api_key/test_api_key_crud/TestAPIKeyCRUD/test_create_api_key_ocp_token_for_actor0_/pytest_exception_interact --since=300s --image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 command[0m [[0m[1m[34mpyhelper_utils.shell[0m][0m

__ ERROR at setup of TestAPIKeyCRUD.test_create_api_key[ocp_token_for_actor0] __
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
_ 3 of 11 completed, 0 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 3 Error, 0 ReRun _

tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py::TestAPIKeyCRUD::test_revoke_api_key[ocp_token_for_actor0] [2m2026-06-14T11:43:48.289731Z[0m [[32m[1minfo     [0m] [1m/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_api_key/test_api_key_crud/TestAPIKeyCRUD/test_create_api_key_ocp_token_for_actor0_/pytest_exception_interact/mg-1781437417.zip is collected successfully[0m [[0m[1m[34mutilities.must_gather_collector[0m][0m [36mname[0m=[35mutilities.must_gather_collector[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
-------------------------------------- test_revoke_api_key[ocp_token_for_actor0] --------------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-06-14T11:43:48.292175Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:48.292318Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:48.292721Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:48.293703Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:48.293946Z[0m [[32m[1minfo     [0m] [1m[cached since 1238s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py::test_revoke_api_key[ocp_token_for_actor0]', 1781437428)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:48.294119Z[0m [[32m[1minfo     [0m] [1m[cached since 1238s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py::test_revoke_api_key[ocp_token_for_actor0]', 1781437428)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:48.294275Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:48.294438Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
ERROR[1m
TEST: TestAPIKeyCRUD.test_revoke_api_key[ocp_token_for_actor0] [setup] STATUS: [0;31mERROR[0m[0m
[2m2026-06-14T11:43:48.297567Z[0m [[31m[1merror    [0m] [1mTraceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:43:48.297750Z[0m [[32m[1minfo     [0m] [1mMust-gather collection is enabled for /home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py::test_revoke_api_key[ocp_token_for_actor0].[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:43:48.297921Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:48.299760Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:48.299960Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:48.300103Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:48.304390Z[0m [[32m[1minfo     [0m] [1m[cached since 324.1s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py::test_revoke_api_key[ocp_token_for_actor0]', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:48.304586Z[0m [[32m[1minfo     [0m] [1m[cached since 324.1s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py::test_revoke_api_key[ocp_token_for_actor0]', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:48.304742Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:48.304927Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:43:48.305081Z[0m [[32m[1minfo     [0m] [1mTrying to get client via new_client_from_config[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:43:48.357215Z[0m [[32m[1minfo     [0m] [1mChecking subscription rhods-operator[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:43:48.375165Z[0m [[32m[1minfo     [0m] [1mExpected CSV: rhods-operator.3.4.0[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:43:48.381047Z[0m [[32m[1minfo     [0m] [1mkind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:43:48.551904Z[0m [[32m[1minfo     [0m] [1mRunning oc adm must-gather --dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_api_key/test_api_key_crud/TestAPIKeyCRUD/test_revoke_api_key_ocp_token_for_actor0_/pytest_exception_interact --since=300s --image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 command[0m [[0m[1m[34mpyhelper_utils.shell[0m][0m
[2m2026-06-14T11:48:49.330404Z[0m [[32m[1minfo     [0m] [1m/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_api_key/test_api_key_crud/TestAPIKeyCRUD/test_revoke_api_key_ocp_token_for_actor0_/pytest_exception_interact/mg-1781437428.zip is collected successfully[0m [[0m[1m[34mutilities.must_gather_collector[0m][0m [36mname[0m=[35mutilities.must_gather_collector[0m

__ ERROR at setup of TestAPIKeyCRUD.test_revoke_api_key[ocp_token_for_actor0] __
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
_ 4 of 11 completed, 0 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 4 Error, 0 ReRun _

tests/model_serving/maas_billing/maas_api_key/test_gateway_deny_default.py::TestGatewayDenyByDefault::test_gateway_default_auth_in_gateway_namespace_and_accepted [1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
----------------------------- test_gateway_default_auth_in_gateway_namespace_and_accepted -----------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-06-14T11:48:49.333225Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:48:49.333369Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:48:49.333511Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:48:49.333650Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:48:49.334015Z[0m [[32m[1minfo     [0m] [1m[cached since 1539s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_gateway_deny_default.py::test_gateway_default_auth_in_gateway_namespace_and_accepted', 1781437729)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:48:49.334179Z[0m [[32m[1minfo     [0m] [1m[cached since 1539s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_gateway_deny_default.py::test_gateway_default_auth_in_gateway_namespace_and_accepted', 1781437729)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:48:49.335154Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:48:49.335302Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
ERROR[1m
TEST: TestGatewayDenyByDefault.test_gateway_default_auth_in_gateway_namespace_and_accepted [setup] STATUS: [0;31mERROR[0m[0m
[2m2026-06-14T11:48:49.338536Z[0m [[31m[1merror    [0m] [1mTraceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:48:49.338730Z[0m [[32m[1minfo     [0m] [1mMust-gather collection is enabled for /home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_gateway_deny_default.py::test_gateway_default_auth_in_gateway_namespace_and_accepted.[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:48:49.338940Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:48:49.340761Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:48:49.340979Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:48:49.341124Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:48:49.345528Z[0m [[32m[1minfo     [0m] [1m[cached since 625.1s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_gateway_deny_default.py::test_gateway_default_auth_in_gateway_namespace_and_accepted', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:48:49.345884Z[0m [[32m[1minfo     [0m] [1m[cached since 625.1s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_gateway_deny_default.py::test_gateway_default_auth_in_gateway_namespace_and_accepted', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:48:49.346192Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:48:49.350728Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:48:49.350893Z[0m [[32m[1minfo     [0m] [1mTrying to get client via new_client_from_config[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:48:49.431242Z[0m [[32m[1minfo     [0m] [1mChecking subscription rhods-operator[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:48:49.442998Z[0m [[32m[1minfo     [0m] [1mExpected CSV: rhods-operator.3.4.0[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:48:49.448576Z[0m [[32m[1minfo     [0m] [1mkind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:48:49.571582Z[0m [[32m[1minfo     [0m] [1mRunning oc adm must-gather --dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_api_key/test_gateway_deny_default/TestGatewayDenyByDefault/test_gateway_default_auth_in_gateway_namespace_and_accepted/pytest_exception_interact --since=300s --image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 command[0m [[0m[1m[34mpyhelper_utils.shell[0m][0m
[2m2026-06-14T11:49:00.271474Z[0m [[32m[1minfo     [0m] [1m/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_api_key/test_gateway_deny_default/TestGatewayDenyByDefault/test_gateway_default_auth_in_gateway_namespace_and_accepted/pytest_exception_interact/mg-1781437729.zip is collected successfully[0m [[0m[1m[34mutilities.must_gather_collector[0m][0m [36mname[0m=[35mutilities.must_gather_collector[0m

_ ERROR at setup of TestGatewayDenyByDefault.test_gateway_default_auth_in_gateway_namespace_and_accepted _
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
_ 5 of 11 completed, 0 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 5 Error, 0 ReRun _

tests/model_serving/maas_billing/maas_api_key/test_gateway_deny_default.py::TestGatewayDenyByDefault::test_unconfigured_model_denies_unauthenticated_request [1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
-------------------------------- test_unconfigured_model_denies_unauthenticated_request --------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-06-14T11:49:00.273898Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:49:00.274053Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:49:00.274250Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:49:00.274437Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:49:00.274610Z[0m [[32m[1minfo     [0m] [1m[cached since 1550s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_gateway_deny_default.py::test_unconfigured_model_denies_unauthenticated_request', 1781437740)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:49:00.274954Z[0m [[32m[1minfo     [0m] [1m[cached since 1550s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_gateway_deny_default.py::test_unconfigured_model_denies_unauthenticated_request', 1781437740)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:49:00.275962Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:49:00.276101Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
ERROR[1m
TEST: TestGatewayDenyByDefault.test_unconfigured_model_denies_unauthenticated_request [setup] STATUS: [0;31mERROR[0m[0m
[2m2026-06-14T11:49:00.279231Z[0m [[31m[1merror    [0m] [1mTraceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:49:00.279360Z[0m [[32m[1minfo     [0m] [1mMust-gather collection is enabled for /home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_gateway_deny_default.py::test_unconfigured_model_denies_unauthenticated_request.[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:49:00.279473Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:49:00.279586Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:49:00.281425Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:49:00.281571Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:49:00.281713Z[0m [[32m[1minfo     [0m] [1m[cached since 636.1s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_gateway_deny_default.py::test_unconfigured_model_denies_unauthenticated_request', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:49:00.281878Z[0m [[32m[1minfo     [0m] [1m[cached since 636.1s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_api_key/test_gateway_deny_default.py::test_unconfigured_model_denies_unauthenticated_request', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:49:00.282008Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:49:00.282120Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:49:00.282273Z[0m [[32m[1minfo     [0m] [1mTrying to get client via new_client_from_config[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:49:00.334543Z[0m [[32m[1minfo     [0m] [1mChecking subscription rhods-operator[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:49:00.347619Z[0m [[32m[1minfo     [0m] [1mExpected CSV: rhods-operator.3.4.0[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:49:00.353268Z[0m [[32m[1minfo     [0m] [1mkind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:49:00.498341Z[0m [[32m[1minfo     [0m] [1mRunning oc adm must-gather --dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_api_key/test_gateway_deny_default/TestGatewayDenyByDefault/test_unconfigured_model_denies_unauthenticated_request/pytest_exception_interact --since=300s --image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 command[0m [[0m[1m[34mpyhelper_utils.shell[0m][0m
[2m2026-06-14T11:53:59.473970Z[0m [[32m[1minfo     [0m] [1m/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_api_key/test_gateway_deny_default/TestGatewayDenyByDefault/test_unconfigured_model_denies_unauthenticated_request/pytest_exception_interact/mg-1781437740.zip is collected successfully[0m [[0m[1m[34mutilities.must_gather_collector[0m][0m [36mname[0m=[35mutilities.must_gather_collector[0m

_ ERROR at setup of TestGatewayDenyByDefault.test_unconfigured_model_denies_unauthenticated_request _
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
_ 6 of 11 completed, 0 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 6 Error, 0 ReRun _

tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::TestMaaSAuthPolicyEnforcementTinyLlama::test_authorized_user_gets_200[ocp_token_for_actor0] [1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
--------------------------------- test_authorized_user_gets_200[ocp_token_for_actor0] ---------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-06-14T11:53:59.477809Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:53:59.478174Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:53:59.478306Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:53:59.478419Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:53:59.478844Z[0m [[32m[1minfo     [0m] [1m[cached since 1849s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_authorized_user_gets_200[ocp_token_for_actor0]', 1781438039)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:53:59.479063Z[0m [[32m[1minfo     [0m] [1m[cached since 1849s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_authorized_user_gets_200[ocp_token_for_actor0]', 1781438039)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:53:59.480159Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:53:59.480306Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
ERROR[1m
TEST: TestMaaSAuthPolicyEnforcementTinyLlama.test_authorized_user_gets_200[ocp_token_for_actor0] [setup] STATUS: [0;31mERROR[0m[0m
[2m2026-06-14T11:53:59.484086Z[0m [[31m[1merror    [0m] [1mTraceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:53:59.486218Z[0m [[32m[1minfo     [0m] [1mMust-gather collection is enabled for /home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_authorized_user_gets_200[ocp_token_for_actor0].[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:53:59.491498Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:53:59.491903Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:53:59.492304Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:53:59.492700Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:53:59.497957Z[0m [[32m[1minfo     [0m] [1m[cached since 935.3s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_authorized_user_gets_200[ocp_token_for_actor0]', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:53:59.498126Z[0m [[32m[1minfo     [0m] [1m[cached since 935.3s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_authorized_user_gets_200[ocp_token_for_actor0]', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:53:59.498273Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:53:59.498404Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:53:59.498535Z[0m [[32m[1minfo     [0m] [1mTrying to get client via new_client_from_config[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:53:59.564599Z[0m [[32m[1minfo     [0m] [1mChecking subscription rhods-operator[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:53:59.576858Z[0m [[32m[1minfo     [0m] [1mExpected CSV: rhods-operator.3.4.0[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:53:59.582547Z[0m [[32m[1minfo     [0m] [1mkind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:53:59.723043Z[0m [[32m[1minfo     [0m] [1mRunning oc adm must-gather --dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement/TestMaaSAuthPolicyEnforcementTinyLlama/test_authorized_user_gets_200_ocp_token_for_actor0_/pytest_exception_interact --since=300s --image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 command[0m [[0m[1m[34mpyhelper_utils.shell[0m][0m
[2m2026-06-14T11:54:10.437712Z[0m [[32m[1minfo     [0m] [1m/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement/TestMaaSAuthPolicyEnforcementTinyLlama/test_authorized_user_gets_200_ocp_token_for_actor0_/pytest_exception_interact/mg-1781438039.zip is collected successfully[0m [[0m[1m[34mutilities.must_gather_collector[0m][0m [36mname[0m=[35mutilities.must_gather_collector[0m

_ ERROR at setup of TestMaaSAuthPolicyEnforcementTinyLlama.test_authorized_user_gets_200[ocp_token_for_actor0] _
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
_ 7 of 11 completed, 0 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 7 Error, 0 ReRun _

tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::TestMaaSAuthPolicyEnforcementTinyLlama::test_no_auth_header_gets_401 [1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
--------------------------------------------- test_no_auth_header_gets_401 ---------------------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-06-14T11:54:10.440027Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:54:10.440358Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:54:10.440498Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:54:10.441485Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:54:10.441673Z[0m [[32m[1minfo     [0m] [1m[cached since 1860s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_no_auth_header_gets_401', 1781438050)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:54:10.441871Z[0m [[32m[1minfo     [0m] [1m[cached since 1860s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_no_auth_header_gets_401', 1781438050)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:54:10.442059Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:54:10.442211Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
ERROR[1m
TEST: TestMaaSAuthPolicyEnforcementTinyLlama.test_no_auth_header_gets_401 [setup] STATUS: [0;31mERROR[0m[0m
[2m2026-06-14T11:54:10.445943Z[0m [[31m[1merror    [0m] [1mTraceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:54:10.447833Z[0m [[32m[1minfo     [0m] [1mMust-gather collection is enabled for /home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_no_auth_header_gets_401.[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:54:10.447993Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:54:10.448169Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:54:10.448318Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:54:10.452173Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:54:10.452321Z[0m [[32m[1minfo     [0m] [1m[cached since 946.2s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_no_auth_header_gets_401', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:54:10.452448Z[0m [[32m[1minfo     [0m] [1m[cached since 946.2s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_no_auth_header_gets_401', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:54:10.452558Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:54:10.452660Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:54:10.452763Z[0m [[32m[1minfo     [0m] [1mTrying to get client via new_client_from_config[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:54:10.505780Z[0m [[32m[1minfo     [0m] [1mChecking subscription rhods-operator[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:54:10.520963Z[0m [[32m[1minfo     [0m] [1mExpected CSV: rhods-operator.3.4.0[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:54:10.526759Z[0m [[32m[1minfo     [0m] [1mkind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:54:10.668116Z[0m [[32m[1minfo     [0m] [1mRunning oc adm must-gather --dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement/TestMaaSAuthPolicyEnforcementTinyLlama/test_no_auth_header_gets_401/pytest_exception_interact --since=300s --image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 command[0m [[0m[1m[34mpyhelper_utils.shell[0m][0m
[2m2026-06-14T11:59:03.610364Z[0m [[32m[1minfo     [0m] [1m/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement/TestMaaSAuthPolicyEnforcementTinyLlama/test_no_auth_header_gets_401/pytest_exception_interact/mg-1781438050.zip is collected successfully[0m [[0m[1m[34mutilities.must_gather_collector[0m][0m [36mname[0m=[35mutilities.must_gather_collector[0m

_ ERROR at setup of TestMaaSAuthPolicyEnforcementTinyLlama.test_no_auth_header_gets_401 _
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
_ 8 of 11 completed, 0 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 8 Error, 0 ReRun _

tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::TestMaaSAuthPolicyEnforcementTinyLlama::test_invalid_token_gets_401 [1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
--------------------------------------------- test_invalid_token_gets_401 ---------------------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-06-14T11:59:03.613066Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:03.613208Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:03.613333Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:03.613452Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:03.613599Z[0m [[32m[1minfo     [0m] [1m[cached since 2153s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_invalid_token_gets_401', 1781438343)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:03.613945Z[0m [[32m[1minfo     [0m] [1m[cached since 2153s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_invalid_token_gets_401', 1781438343)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:03.614075Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:03.615136Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
ERROR[1m
TEST: TestMaaSAuthPolicyEnforcementTinyLlama.test_invalid_token_gets_401 [setup] STATUS: [0;31mERROR[0m[0m
[2m2026-06-14T11:59:03.618387Z[0m [[31m[1merror    [0m] [1mTraceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:59:03.620885Z[0m [[32m[1minfo     [0m] [1mMust-gather collection is enabled for /home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_invalid_token_gets_401.[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:59:03.621083Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:03.621232Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:03.621376Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:03.621555Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:03.626146Z[0m [[32m[1minfo     [0m] [1m[cached since 1239s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_invalid_token_gets_401', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:03.626497Z[0m [[32m[1minfo     [0m] [1m[cached since 1239s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::test_invalid_token_gets_401', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:03.626794Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:03.631620Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:03.631775Z[0m [[32m[1minfo     [0m] [1mTrying to get client via new_client_from_config[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:59:03.686648Z[0m [[32m[1minfo     [0m] [1mChecking subscription rhods-operator[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:59:03.698445Z[0m [[32m[1minfo     [0m] [1mExpected CSV: rhods-operator.3.4.0[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:59:03.782921Z[0m [[32m[1minfo     [0m] [1mkind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:59:03.951347Z[0m [[32m[1minfo     [0m] [1mRunning oc adm must-gather --dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement/TestMaaSAuthPolicyEnforcementTinyLlama/test_invalid_token_gets_401/pytest_exception_interact --since=300s --image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 command[0m [[0m[1m[34mpyhelper_utils.shell[0m][0m
[2m2026-06-14T11:59:14.782959Z[0m [[32m[1minfo     [0m] [1m/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement/TestMaaSAuthPolicyEnforcementTinyLlama/test_invalid_token_gets_401/pytest_exception_interact/mg-1781438343.zip is collected successfully[0m [[0m[1m[34mutilities.must_gather_collector[0m][0m [36mname[0m=[35mutilities.must_gather_collector[0m

_ ERROR at setup of TestMaaSAuthPolicyEnforcementTinyLlama.test_invalid_token_gets_401 _
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
_ 9 of 11 completed, 0 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 9 Error, 0 ReRun _

tests/model_serving/maas_billing/maas_subscription/test_maas_sub_enforcement.py::TestSubscriptionEnforcementTinyLlama::test_subscribed_user_gets_200[ocp_token_for_actor0] [1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
--------------------------------- test_subscribed_user_gets_200[ocp_token_for_actor0] ---------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-06-14T11:59:14.785515Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:14.785653Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:14.786056Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:14.786207Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:14.787241Z[0m [[32m[1minfo     [0m] [1m[cached since 2164s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_sub_enforcement.py::test_subscribed_user_gets_200[ocp_token_for_actor0]', 1781438354)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:14.787426Z[0m [[32m[1minfo     [0m] [1m[cached since 2164s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_sub_enforcement.py::test_subscribed_user_gets_200[ocp_token_for_actor0]', 1781438354)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:14.787578Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:14.787730Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
ERROR[1m
TEST: TestSubscriptionEnforcementTinyLlama.test_subscribed_user_gets_200[ocp_token_for_actor0] [setup] STATUS: [0;31mERROR[0m[0m
[2m2026-06-14T11:59:14.791118Z[0m [[31m[1merror    [0m] [1mTraceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:59:14.791306Z[0m [[32m[1minfo     [0m] [1mMust-gather collection is enabled for /home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_sub_enforcement.py::test_subscribed_user_gets_200[ocp_token_for_actor0].[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T11:59:14.793200Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:14.793347Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:14.793519Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:14.793663Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:14.797674Z[0m [[32m[1minfo     [0m] [1m[cached since 1251s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_sub_enforcement.py::test_subscribed_user_gets_200[ocp_token_for_actor0]', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:14.797858Z[0m [[32m[1minfo     [0m] [1m[cached since 1251s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/maas_subscription/test_maas_sub_enforcement.py::test_subscribed_user_gets_200[ocp_token_for_actor0]', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:14.797998Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:14.798125Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T11:59:14.798252Z[0m [[32m[1minfo     [0m] [1mTrying to get client via new_client_from_config[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:59:14.842684Z[0m [[32m[1minfo     [0m] [1mChecking subscription rhods-operator[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:59:14.860456Z[0m [[32m[1minfo     [0m] [1mExpected CSV: rhods-operator.3.4.0[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T11:59:14.868783Z[0m [[32m[1minfo     [0m] [1mkind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T11:59:15.017663Z[0m [[32m[1minfo     [0m] [1mRunning oc adm must-gather --dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_subscription/test_maas_sub_enforcement/TestSubscriptionEnforcementTinyLlama/test_subscribed_user_gets_200_ocp_token_for_actor0_/pytest_exception_interact --since=300s --image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 command[0m [[0m[1m[34mpyhelper_utils.shell[0m][0m
[2m2026-06-14T12:04:06.779592Z[0m [[32m[1minfo     [0m] [1m/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/maas_subscription/test_maas_sub_enforcement/TestSubscriptionEnforcementTinyLlama/test_subscribed_user_gets_200_ocp_token_for_actor0_/pytest_exception_interact/mg-1781438354.zip is collected successfully[0m [[0m[1m[34mutilities.must_gather_collector[0m][0m [36mname[0m=[35mutilities.must_gather_collector[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m

_ ERROR at setup of TestSubscriptionEnforcementTinyLlama.test_subscribed_user_gets_200[ocp_token_for_actor0] _
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
_ 10 of 11 completed, 0 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 10 Error, 0 ReRun _

tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py::TestOIDCTokenFlow::test_oidc_token_creates_api_key [1m
------------------------------------------- test_oidc_token_creates_api_key -------------------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-06-14T12:04:06.782383Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T12:04:06.782756Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T12:04:06.782939Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T12:04:06.783075Z[0m [[32m[1minfo     [0m] [1mINSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T12:04:06.783217Z[0m [[32m[1minfo     [0m] [1m[cached since 2456s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py::test_oidc_token_creates_api_key', 1781438646)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T12:04:06.783352Z[0m [[32m[1minfo     [0m] [1m[cached since 2456s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py::test_oidc_token_creates_api_key', 1781438646)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T12:04:06.783471Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T12:04:06.783588Z[0m [[32m[1minfo     [0m] [1mCOMMIT                        [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
ERROR[1m
TEST: TestOIDCTokenFlow.test_oidc_token_creates_api_key [setup] STATUS: [0;31mERROR[0m[0m
[2m2026-06-14T12:04:06.789658Z[0m [[31m[1merror    [0m] [1mTraceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T12:04:06.789892Z[0m [[32m[1minfo     [0m] [1mMust-gather collection is enabled for /home/odh/opendatahub-tests/tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py::test_oidc_token_creates_api_key.[0m [[0m[1m[34mconftest[0m][0m
[2m2026-06-14T12:04:06.790048Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T12:04:06.795005Z[0m [[32m[1minfo     [0m] [1mBEGIN (implicit)              [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T12:04:06.798733Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T12:04:06.798912Z[0m [[32m[1minfo     [0m] [1mSELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" 
FROM "OpenDataHubTestTable" 
WHERE "OpenDataHubTestTable".test_name = ?
 LIMIT ? OFFSET ?[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T12:04:06.799068Z[0m [[32m[1minfo     [0m] [1m[cached since 1543s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py::test_oidc_token_creates_api_key', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T12:04:06.799189Z[0m [[32m[1minfo     [0m] [1m[cached since 1543s ago] ('/home/odh/opendatahub-tests/tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py::test_oidc_token_creates_api_key', 1, 0)[0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T12:04:06.799294Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T12:04:06.799395Z[0m [[32m[1minfo     [0m] [1mROLLBACK                      [0m [[0m[1m[34msqlalchemy.engine.Engine[0m][0m
[2m2026-06-14T12:04:06.799500Z[0m [[32m[1minfo     [0m] [1mTrying to get client via new_client_from_config[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T12:04:06.857326Z[0m [[32m[1minfo     [0m] [1mChecking subscription rhods-operator[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T12:04:06.870216Z[0m [[32m[1minfo     [0m] [1mExpected CSV: rhods-operator.3.4.0[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-06-14T12:04:06.875859Z[0m [[32m[1minfo     [0m] [1mkind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T12:04:07.018410Z[0m [[32m[1minfo     [0m] [1mRunning oc adm must-gather --dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/oidc_tests/test_oidc_token_flow/TestOIDCTokenFlow/test_oidc_token_creates_api_key/pytest_exception_interact --since=300s --image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:3de5ff9eee7e9b8e6650f61dbae642db3d3ccb813afb804397dc60d18f150ea6 command[0m [[0m[1m[34mpyhelper_utils.shell[0m][0m
[2m2026-06-14T12:04:17.755879Z[0m [[32m[1minfo     [0m] [1m/home/odh/opendatahub-tests/results/must-gather-collected/model_serving/maas_billing/oidc_tests/test_oidc_token_flow/TestOIDCTokenFlow/test_oidc_token_creates_api_key/pytest_exception_interact/mg-1781438646.zip is collected successfully[0m [[0m[1m[34mutilities.must_gather_collector[0m][0m [36mname[0m=[35mutilities.must_gather_collector[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[2m2026-06-14T12:04:17.757747Z[0m [[32m[1minfo     [0m] [1mResourceEdits: Restoring data for resource Gateway maas-default-gateway[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-06-14T12:04:17.757891Z[0m [[32m[1minfo     [0m] [1mUpdate Gateway maas-default-gateway:
{'metadata': {'annotations': {}, 'name': 'maas-default-gateway'}}[0m [[0m[1m[34mocp_resources Gateway[0m][0m

_____ ERROR at setup of TestOIDCTokenFlow.test_oidc_token_creates_api_key ______
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
_ 11 of 11 completed, 0 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 11 Error, 0 ReRun _
========= 94 deselected, 23 warnings, 11 errors in 2467.55s (0:41:07) ==========

==================================== ERRORS ====================================
_ ERROR at setup of TestAuthPolicyApiKeyValidation.test_auth_policy_callback_url_uses_correct_namespace _
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1110, in execute
    result: FixtureValue = ihook.pytest_fixture_setup(
                           ~~~~~~~~~~~~~~~~~~~~~~~~~~^
        fixturedef=self, request=request
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pytest_asyncio/plugin.py", line 728, in pytest_fixture_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper
    return result.get_result()
           ~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result
    raise exc.with_traceback(tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper
    res = yield
          ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/setuponly.py", line 36, in pytest_fixture_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
_ ERROR at setup of TestAuthPolicyApiKeyValidation.test_api_key_can_list_models[ocp_token_for_actor0] _
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
__ ERROR at setup of TestAPIKeyCRUD.test_create_api_key[ocp_token_for_actor0] __
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
__ ERROR at setup of TestAPIKeyCRUD.test_revoke_api_key[ocp_token_for_actor0] __
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
_ ERROR at setup of TestGatewayDenyByDefault.test_gateway_default_auth_in_gateway_namespace_and_accepted _
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
_ ERROR at setup of TestGatewayDenyByDefault.test_unconfigured_model_denies_unauthenticated_request _
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
_ ERROR at setup of TestMaaSAuthPolicyEnforcementTinyLlama.test_authorized_user_gets_200[ocp_token_for_actor0] _
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
_ ERROR at setup of TestMaaSAuthPolicyEnforcementTinyLlama.test_no_auth_header_gets_401 _
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
_ ERROR at setup of TestMaaSAuthPolicyEnforcementTinyLlama.test_invalid_token_gets_401 _
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
_ ERROR at setup of TestSubscriptionEnforcementTinyLlama.test_subscribed_user_gets_200[ocp_token_for_actor0] _
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
_____ ERROR at setup of TestOIDCTokenFlow.test_oidc_token_creates_api_key ______
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 165, in pytest_runtest_setup
    item.session._setupstate.setup(item)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 523, in setup
    col.setup()
    ~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1723, in setup
    self._request._fillfixtures()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 707, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
                             ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 539, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 627, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1091, in execute
    raise exc.with_traceback(exc_tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1202, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 908, in call_fixture_func
    fixture_result = next(generator)
  File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 1100, in maas_subscription_controller_enabled_latest
    dsc_resource.wait_for_condition(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        condition="ModelsAsServiceReady",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        status="True",
        ^^^^^^^^^^^^^^
        timeout=900,
        ^^^^^^^^^^^^
    )
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1315, in wait_for_condition
    for sample in TimeoutSampler(
                  ~~~~~~~~~~~~~~^
        wait_timeout=timeout_watcher.remaining_time(),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        sleep=sleep_time,
        ^^^^^^^^^^^^^^^^^
        func=lambda: self.instance,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 182, in __iter__
    raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)
timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
=============================== warnings summary ===============================
tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py: 2 warnings
tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py: 2 warnings
tests/model_serving/maas_billing/maas_api_key/test_gateway_deny_default.py: 2 warnings
tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py: 3 warnings
tests/model_serving/maas_billing/maas_subscription/test_maas_sub_enforcement.py: 1 warning
tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py: 2 warnings
  /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-23.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings
    warnings.warn(

tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py: 2 warnings
tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py: 2 warnings
tests/model_serving/maas_billing/maas_api_key/test_gateway_deny_default.py: 2 warnings
tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py: 3 warnings
tests/model_serving/maas_billing/maas_subscription/test_maas_sub_enforcement.py: 1 warning
tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py: 1 warning
  /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py:1635: FutureWarning: 'client' arg will be mandatory in the next major release. `config_file` and `context` args will be removed.
    super().__init__(

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
------------ generated xml file: /artifacts/maas_billing-smoke.xml -------------
=========================== short test summary info ============================
ERROR tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::TestAuthPolicyApiKeyValidation::test_auth_policy_callback_url_uses_correct_namespace - timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
ERROR tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::TestAuthPolicyApiKeyValidation::test_api_key_can_list_models[ocp_token_for_actor0] - timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
ERROR tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py::TestAPIKeyCRUD::test_create_api_key[ocp_token_for_actor0] - timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
ERROR tests/model_serving/maas_billing/maas_api_key/test_api_key_crud.py::TestAPIKeyCRUD::test_revoke_api_key[ocp_token_for_actor0] - timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
ERROR tests/model_serving/maas_billing/maas_api_key/test_gateway_deny_default.py::TestGatewayDenyByDefault::test_gateway_default_auth_in_gateway_namespace_and_accepted - timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
ERROR tests/model_serving/maas_billing/maas_api_key/test_gateway_deny_default.py::TestGatewayDenyByDefault::test_unconfigured_model_denies_unauthenticated_request - timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
ERROR tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::TestMaaSAuthPolicyEnforcementTinyLlama::test_authorized_user_gets_200[ocp_token_for_actor0] - timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
ERROR tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::TestMaaSAuthPolicyEnforcementTinyLlama::test_no_auth_header_gets_401 - timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
ERROR tests/model_serving/maas_billing/maas_subscription/test_maas_auth_enforcement.py::TestMaaSAuthPolicyEnforcementTinyLlama::test_invalid_token_gets_401 - timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
ERROR tests/model_serving/maas_billing/maas_subscription/test_maas_sub_enforcement.py::TestSubscriptionEnforcementTinyLlama::test_subscribed_user_gets_200[ocp_token_for_actor0] - timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
ERROR tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py::TestOIDCTokenFlow::test_oidc_token_creates_api_key - timeout_sampler.TimeoutExpiredError: Timed Out: 899.9824194908142
Function: ocp_resources.resource.wait_for_condition.lambda: self.instance
Last exception: N/A.
========= 94 deselected, 23 warnings, 11 errors in 2467.55s (0:41:07) ==========