--- BVT pytest attempt 2026-07-09T15:35:03.775732+00:00 (/.local/bin/uv --directory /home/odh/opendatahub-tests...) --- 2026-07-09T15:35:05.980974Z [info ] Writing tests log to /home/odh/opendatahub-tests/results/pytest-tests.log [conftest] 2026-07-09T15:35:05.981452Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] /workspace/tests-shared/tests-payload/.tools/python/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /workspace/tests-shared/tests-payload/.tools/python/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /workspace/tests-shared/tests-payload/.tools/python/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /workspace/tests-shared/tests-payload/.tools/python/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /workspace/tests-shared/tests-payload/.tools/python/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( 2026-07-09T15:35:06.347441Z [info ] kind: DataScienceCluster api version: datasciencecluster.opendatahub.io/v2 [ocp_resources.resource] /workspace/tests-shared/tests-payload/.tools/python/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /workspace/tests-shared/tests-payload/.tools/python/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /workspace/tests-shared/tests-payload/.tools/python/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /workspace/tests-shared/tests-payload/.tools/python/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( 2026-07-09T15:35:06.492761Z [info ] kind: DSCInitialization api version: dscinitialization.opendatahub.io/v2 [ocp_resources.resource] /workspace/tests-shared/tests-payload/.tools/python/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( ============================= test session starts ============================== platform linux -- Python 3.14.6, pytest-9.1.1, pluggy-1.6.0 -- /home/odh/opendatahub-tests/.venv/bin/python3 cachedir: .pytest_cache metadata: {'Python': '3.14.6', 'Platform': 'Linux-5.14.0-570.120.1.el9_6.x86_64-x86_64-with-glibc2.42', 'Packages': {'pytest': '9.1.1', 'pluggy': '1.6.0'}, 'Plugins': {'anyio': '4.14.0', 'langsmith': '0.9.0', 'asyncio': '1.4.0', 'dependency': '0.6.1', 'html': '4.2.0', 'metadata': '3.1.1', 'order': '1.5.0', 'progress': '1.4.0', 'testconfig': '0.2.0', 'xdist': '3.8.0', 'syrupy': '5.3.2'}} rootdir: /home/odh/opendatahub-tests configfile: pytest.ini plugins: anyio-4.14.0, langsmith-0.9.0, asyncio-1.4.0, dependency-0.6.1, html-4.2.0, metadata-3.1.1, order-1.5.0, progress-1.4.0, testconfig-0.2.0, xdist-3.8.0, syrupy-5.3.2 asyncio: mode=Mode.STRICT, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function collecting ... collected 175 items / 162 deselected / 13 selected tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_envoy_filter.py::TestBBREnvoyFilter::test_bbr_envoy_filter_has_pre_and_post_auth_stages  ---------------------------------- test_bbr_envoy_filter_has_pre_and_post_auth_stages ---------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-07-09T15:35:06.913197Z [info ] Executing session fixture: event_loop_policy [conftest] 2026-07-09T15:35:06.915080Z [info ] Executing session fixture: _syrupy_apply_ide_patches [conftest] 2026-07-09T15:35:06.915397Z [info ] Executing session fixture: admin_client [conftest] 2026-07-09T15:35:06.915725Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] 2026-07-09T15:35:06.915954Z [info ] Executing session fixture: dsc_resource [conftest] 2026-07-09T15:35:06.916060Z [info ] kind: DataScienceCluster api version: datasciencecluster.opendatahub.io/v2 [ocp_resources.resource] 2026-07-09T15:35:06.992949Z [info ] Executing session fixture: tmp_path_factory [conftest] 2026-07-09T15:35:06.993130Z [info ] Executing session fixture: tests_tmp_dir [conftest] 2026-07-09T15:35:06.994344Z [info ] Executing session fixture: os_path_environment [conftest] 2026-07-09T15:35:06.994819Z [info ] Executing session fixture: tmpdir_factory [conftest] 2026-07-09T15:35:06.995757Z [info ] Executing session fixture: bin_directory [conftest] 2026-07-09T15:35:06.995918Z [info ] Executing session fixture: oc_binary_path [conftest] 2026-07-09T15:35:07.120503Z [info ] kind: ConsoleCLIDownload api version: console.openshift.io/v1 [ocp_resources.resource] 2026-07-09T15:35:07.154453Z [info ] All oc console cli download links: ['https://downloads-openshift-console.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com/amd64/linux/oc.tar'] [utilities.infra] name=utilities.infra 2026-07-09T15:35:07.154562Z [info ] Downloading archive using: url=https://downloads-openshift-console.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com/amd64/linux/oc.tar [utilities.infra] name=utilities.infra 2026-07-09T15:35:07.155639Z [info ] Waiting for 120 seconds [0:02:00], retry every 10 seconds. (Function: utilities.infra._download_with_retry Kwargs: {'url': 'https://downloads-openshift-console.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com/amd64/linux/oc.tar'}) [timeout_sampler] 2026-07-09T15:35:07.229558Z [info ] Elapsed time: 5.4836273193359375e-05 [0:00:00.000055] [timeout_sampler] 2026-07-09T15:35:07.986096Z [info ] Extract the downloaded archive. [utilities.infra] name=utilities.infra 2026-07-09T15:35:08.071537Z [info ] Downloaded file: ['oc']  [utilities.infra] name=utilities.infra 2026-07-09T15:35:08.090504Z [info ] Executing session fixture: bin_directory_to_os_path [conftest] 2026-07-09T15:35:08.088851Z [info ] OC binary path: /tmp/pytest-XCi8PgSi8GD8UdARcnz9Aa/bin0/oc [tests.conftest] name=tests.conftest 2026-07-09T15:35:08.088912Z [info ] Adding /tmp/pytest-XCi8PgSi8GD8UdARcnz9Aa/bin0 to $PATH [tests.conftest] name=tests.conftest 2026-07-09T15:35:08.091169Z [info ] Executing session fixture: nodes [conftest] 2026-07-09T15:35:09.500216Z [info ] Executing session fixture: dsci_resource [conftest] 2026-07-09T15:35:09.500434Z [info ] kind: DSCInitialization api version: dscinitialization.opendatahub.io/v2 [ocp_resources.resource] 2026-07-09T15:35:09.518233Z [info ] Executing session fixture: record_testsuite_property [conftest] 2026-07-09T15:35:09.518397Z [info ] Executing session fixture: junitxml_plugin [conftest] 2026-07-09T15:35:09.518569Z [info ] Executing session fixture: cluster_sanity_scope_session [conftest] 2026-07-09T15:35:09.517607Z [info ] Check cluster sanity.  [utilities.infra] name=utilities.infra 2026-07-09T15:35:09.518863Z [info ] Verify all nodes are in a healthy condition. [ocp_utilities.infra] 2026-07-09T15:35:09.571540Z [info ] Verify all nodes are schedulable. [ocp_utilities.infra] 2026-07-09T15:35:09.624676Z [warning ] Skipping RHOAI resource checks, got --cluster-sanity-skip-rhoai-check [utilities.infra] name=utilities.infra 2026-07-09T15:35:09.626020Z [info ] Executing session fixture: autouse_fixtures [conftest] 2026-07-09T15:35:09.626149Z [info ] Executing session fixture: maas_gateway_api_hostname [conftest] 2026-07-09T15:35:09.626268Z [info ] kind: Ingress api version: config.openshift.io/v1 [ocp_resources.resource] 2026-07-09T15:35:09.662178Z [info ] Executing session fixture: maas_gateway_api [conftest] 2026-07-09T15:35:09.806332Z [info ] kind: Gateway api version: gateway.networking.k8s.io/v1 [ocp_resources.resource] 2026-07-09T15:35:09.825535Z [info ] Reusing existing gateway openshift-ingress/maas-default-gateway [conftest] name=conftest 2026-07-09T15:35:09.826556Z [info ] Wait for Gateway/maas-default-gateway's 'Programmed' condition to be 'True' [ocp_resources Gateway] 2026-07-09T15:35:09.826711Z [info ] Wait until Gateway maas-default-gateway is created [ocp_resources Gateway] 2026-07-09T15:35:09.826863Z [info ] Waiting for 300 seconds [0:05:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:09.845872Z [info ] Elapsed time: 5.53131103515625e-05 [0:00:00.000055] [timeout_sampler] 2026-07-09T15:35:09.846021Z [info ] Waiting for 299.9802985191345 seconds [0:04:59.980299], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-09T15:35:09.865255Z [info ] Elapsed time: 3.314018249511719e-05 [0:00:00.000033] [timeout_sampler] 2026-07-09T15:35:09.865449Z [info ] ResourceEdit: Backing up old data [ocp_resources.resource] 2026-07-09T15:35:09.885178Z [info ] ResourceEdits: Updating data for resource Gateway maas-default-gateway [ocp_resources.resource] 2026-07-09T15:35:09.885344Z [info ] Update Gateway maas-default-gateway: {'metadata': {'annotations': {'security.opendatahub.io/authorino-tls-bootstrap': 'true'}, 'name': 'maas-default-gateway'}} [ocp_resources Gateway] 2026-07-09T15:35:09.912571Z [info ] Executing session fixture: pytestconfig [conftest] 2026-07-09T15:35:09.912741Z [info ] Executing session fixture: use_unprivileged_client [conftest] 2026-07-09T15:35:09.912877Z [info ] Executing session fixture: kubconfig_filepath [conftest] 2026-07-09T15:35:09.912999Z [info ] Executing session fixture: cluster_authentication [conftest] 2026-07-09T15:35:09.913107Z [info ] kind: Authentication api version: config.openshift.io/v1 [ocp_resources.resource] 2026-07-09T15:35:09.929602Z [info ] Executing session fixture: is_byoidc [conftest] 2026-07-09T15:35:09.947715Z [info ] Executing session fixture: non_admin_user_password [conftest] 2026-07-09T15:35:09.982898Z [info ] Executing session fixture: unprivileged_client [conftest] 2026-07-09T15:35:09.983047Z [info ] Running oc whoami command  [pyhelper_utils.shell] 2026-07-09T15:35:10.106522Z [info ] Running Hide By User command  [pyhelper_utils.shell] 2026-07-09T15:35:11.369537Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] 2026-07-09T15:35:12.018001Z [info ] Executing session fixture: maas_subscription_namespace [conftest] 2026-07-09T15:35:12.036744Z [info ] Namespace models-as-a-service already exists, reusing it [conftest] name=conftest 2026-07-09T15:35:12.037585Z [info ] Executing session fixture: maas_subscription_controller_enabled_latest [conftest] 2026-07-09T15:35:12.037715Z [info ] ResourceEdit: Backing up old data [ocp_resources.resource] 2026-07-09T15:35:12.074629Z [info ] ResourceEdits: Updating data for resource DataScienceCluster default-dsc [ocp_resources.resource] 2026-07-09T15:35:12.074785Z [info ] Update DataScienceCluster default-dsc: {'spec': {'components': {'kserve': {'modelsAsService': {'managementState': 'Managed'}}}}, 'metadata': {'name': 'default-dsc'}} [ocp_resources DataScienceCluster] 2026-07-09T15:35:12.151604Z [info ] Wait for DataScienceCluster/default-dsc's 'ModelsAsServiceReady' condition to be 'True' [ocp_resources DataScienceCluster] 2026-07-09T15:35:12.151755Z [info ] Wait until DataScienceCluster default-dsc is created [ocp_resources DataScienceCluster] 2026-07-09T15:35:12.151866Z [info ] Waiting for 900 seconds [0:15:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:12.173698Z [info ] Elapsed time: 4.6253204345703125e-05 [0:00:00.000046] [timeout_sampler] 2026-07-09T15:35:12.173855Z [info ] Waiting for 899.9779889583588 seconds [0:14:59.977989], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-09T15:35:12.194277Z [info ] Elapsed time: 3.600120544433594e-05 [0:00:00.000036] [timeout_sampler] 2026-07-09T15:35:12.194462Z [info ] Wait for DataScienceCluster/default-dsc's 'Ready' condition to be 'True' [ocp_resources DataScienceCluster] 2026-07-09T15:35:12.194602Z [info ] Wait until DataScienceCluster default-dsc is created [ocp_resources DataScienceCluster] 2026-07-09T15:35:12.194734Z [info ] Waiting for 600 seconds [0:10:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:12.216517Z [info ] Elapsed time: 3.24249267578125e-05 [0:00:00.000032] [timeout_sampler] 2026-07-09T15:35:12.216671Z [info ] Waiting for 599.9776504039764 seconds [0:09:59.977650], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-09T15:35:12.237549Z [info ] Elapsed time: 3.337860107421875e-05 [0:00:00.000033] [timeout_sampler] 2026-07-09T15:35:12.237727Z [info ] Executing session fixture: bbr_gateway_namespace [conftest] 2026-07-09T15:35:12.255626Z [info ] Executing class fixture: bbr_envoy_filter_config_patches [conftest] 2026-07-09T15:35:12.466303Z [info ] kind: EnvoyFilter api version: networking.istio.io/v1alpha3 [ocp_resources.resource] PASSED--------------------------------------------------------- CALL --------------------------------------------------------- 2026-07-09T15:35:12.503063Z [info ] EnvoyFilter 'openshift-ingress/payload-processing' has pre-auth and post-auth stages: ['envoy.filters.http.ext_proc.ipp-pre', 'envoy.filters.http.ext_proc.ipp'] [tests.model_serving.maas_billing.body_base_routing.pre_auth_model_header.utils] name=tests.model_serving.maas_billing.body_base_routing.pre_auth_model_header.utils  TEST: TestBBREnvoyFilter.test_bbr_envoy_filter_has_pre_and_post_auth_stages STATUS: PASSED ------------------------------------------------------- TEARDOWN ------------------------------------------------------- _ 1 of 13 completed, 1 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _ tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_envoy_filter.py::TestBBREnvoyFilter::test_bbr_post_auth_processing_deployment_ready  ------------------------------------ test_bbr_post_auth_processing_deployment_ready ------------------------------------ -------------------------------------------------------- SETUP -------------------------------------------------------- --------------------------------------------------------- CALL --------------------------------------------------------- 2026-07-09T15:35:12.512564Z [info ] kind: Deployment api version: apps/v1 [ocp_resources.resource] PASSED _ 2 of 13 completed, 2 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _ tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_pre_auth_inference.py::TestBBRPreAuthInference::test_inference_model_in_body_only_returns_200[ocp_token_for_actor0] 2026-07-09T15:35:12.587972Z [info ] Deployment 'openshift-ingress/payload-processing' is ready (1/1 replicas) [tests.model_serving.maas_billing.body_base_routing.pre_auth_model_header.utils] name=tests.model_serving.maas_billing.body_base_routing.pre_auth_model_header.utils  TEST: TestBBREnvoyFilter.test_bbr_post_auth_processing_deployment_ready STATUS: PASSED ------------------------------------------------------- TEARDOWN -------------------------------------------------------  ------------------------- test_inference_model_in_body_only_returns_200[ocp_token_for_actor0] ------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-07-09T15:35:12.591706Z [info ] Executing session fixture: request_session_http [conftest] 2026-07-09T15:35:12.591821Z [info ] Executing session fixture: authorino_tls_configured [conftest] 2026-07-09T15:35:12.632640Z [info ] authorino_tls_configured: configuring TLS in kuadrant-system [conftest] name=conftest 2026-07-09T15:35:12.811041Z [info ] kind: Authorino api version: operator.authorino.kuadrant.io/v1beta1 --- [DuplicateFilter: Last log `kind: Deployment api version: apps/v1` repeated 3 times] [ocp_resources.resource] 2026-07-09T15:35:12.811201Z [info ] ResourceEdit: Backing up old data [ocp_resources.resource] 2026-07-09T15:35:12.865973Z [info ] ResourceEdits: Updating data for resource Service authorino-authorino-authorization [ocp_resources.resource] 2026-07-09T15:35:12.866137Z [info ] Update Service authorino-authorino-authorization: {'metadata': {'annotations': {'service.beta.openshift.io/serving-cert-secret-name': 'authorino-server-cert'}, 'name': 'authorino-authorino-authorization'}} [ocp_resources Service] 2026-07-09T15:35:12.889960Z [info ] ResourceEdits: Updating data for resource Deployment authorino [ocp_resources.resource] 2026-07-09T15:35:12.890406Z [info ] Update Deployment authorino: {'spec': {'template': {'spec': {'containers': [{'name': 'authorino', 'image': 'registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a', 'env': [{'name': 'SSL_CERT_FILE', 'value': '/etc/ssl/certs/openshift-service-ca/service-ca-bundle.crt'}, {'name': 'REQUESTS_CA_BUNDLE', 'value': '/etc/ssl/certs/openshift-service-ca/service-ca-bundle.crt'}]}]}}}, 'metadata': {'name': 'authorino'}} [ocp_resources Deployment] 2026-07-09T15:35:12.916975Z [info ] ResourceEdits: Updating data for resource Authorino authorino [ocp_resources.resource] 2026-07-09T15:35:12.917139Z [info ] Update Authorino authorino: {'spec': {'listener': {'tls': {'enabled': True, 'certSecretRef': {'name': 'authorino-server-cert'}}}}, 'metadata': {'name': 'authorino'}} [ocp_resources Authorino] 2026-07-09T15:35:12.944760Z [info ] Wait for Deployment/authorino's 'Available' condition to be 'True' [ocp_resources Deployment] 2026-07-09T15:35:12.944918Z [info ] Wait until Deployment authorino is created [ocp_resources Deployment] 2026-07-09T15:35:12.945062Z [info ] Waiting for 120 seconds [0:02:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:12.962890Z [info ] Elapsed time: 6.0558319091796875e-05 [0:00:00.000061] [timeout_sampler] 2026-07-09T15:35:12.963033Z [info ] Waiting for 119.98178911209106 seconds [0:01:59.981789], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-09T15:35:12.982030Z [info ] Elapsed time: 5.53131103515625e-05 [0:00:00.000055] [timeout_sampler] 2026-07-09T15:35:12.981243Z [info ] authorino_tls_configured: TLS configuration applied, rollout complete [conftest] name=conftest 2026-07-09T15:35:12.982296Z [info ] Executing session fixture: original_user [conftest] 2026-07-09T15:35:12.982463Z [info ] Running oc whoami command  [pyhelper_utils.shell] 2026-07-09T15:35:13.125720Z [info ] Original user: htpasswd-cluster-admin-user [tests.conftest] name=tests.conftest 2026-07-09T15:35:13.127315Z [info ] Executing session fixture: maas_api_server_url [conftest] 2026-07-09T15:35:13.127489Z [info ] kind: Infrastructure api version: config.openshift.io/v1 [ocp_resources.resource] 2026-07-09T15:35:13.165523Z [info ] Executing session fixture: maas_user_credentials_both [conftest] 2026-07-09T15:35:13.165667Z [info ] Executing session fixture: maas_htpasswd_files [conftest] 2026-07-09T15:35:13.655451Z [info ] Executing session fixture: maas_htpasswd_oauth_idp [conftest] 2026-07-09T15:35:13.655638Z [info ] kind: OAuth api version: config.openshift.io/v1 [ocp_resources.resource] 2026-07-09T15:35:13.672538Z [info ] MaaS RBAC: creating shared htpasswd Secret 'maas-htpasswd-secret-ec03753c' for users 'maas-free-user-ec03753c' and 'maas-premium-user-ec03753c' [conftest] name=conftest 2026-07-09T15:35:13.679679Z [info ] Create Secret maas-htpasswd-secret-ec03753c [ocp_resources Secret] 2026-07-09T15:35:13.679814Z [info ] Posting {'apiVersion': 'v1', 'kind': 'Secret', 'metadata': {'name': 'maas-htpasswd-secret-ec03753c', 'namespace': 'openshift-config'}, 'data': '*******', 'type': 'Opaque'} [ocp_resources Secret] 2026-07-09T15:35:13.722621Z [info ] Wait until Secret maas-htpasswd-secret-ec03753c is created [ocp_resources Secret] 2026-07-09T15:35:13.722788Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:13.740176Z [info ] Elapsed time: 6.4849853515625e-05 [0:00:00.000065] [timeout_sampler] 2026-07-09T15:35:13.740343Z [info ] ResourceEdit: Backing up old data [ocp_resources.resource] 2026-07-09T15:35:13.758205Z [info ] ResourceEdits: Updating data for resource OAuth cluster [ocp_resources.resource] 2026-07-09T15:35:13.758355Z [info ] Update OAuth cluster: {'spec': {'identityProviders': [{'name': 'maas-htpasswd-idp-ec03753c', 'mappingMethod': 'claim', 'type': 'HTPasswd', 'challenge': True, 'login': True, 'htpasswd': {'fileData': {'name': 'maas-htpasswd-secret-ec03753c'}}}]}, 'metadata': {'name': 'cluster'}} [ocp_resources OAuth] 2026-07-09T15:35:13.778757Z [info ] Delete Secret maas-htpasswd-secret-ec03753c [ocp_resources Secret] 2026-07-09T15:35:13.816291Z [info ] Deleting {'kind': 'Secret', 'apiVersion': 'v1', 'metadata': {'name': 'maas-htpasswd-secret-ec03753c', 'namespace': 'openshift-config', 'uid': 'ee95c27f-3120-4f34-862c-1f0f9d8f4ce3', 'resourceVersion': '22044388', 'creationTimestamp': '2026-07-09T15:35:13Z', 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-09T15:35:13Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:data': {'.': {}, 'f:htpasswd': {}}, 'f:type': {}}}]}, 'data': '*******', 'type': 'Opaque'} [ocp_resources Secret] 2026-07-09T15:35:13.840555Z [info ] Wait until Secret maas-htpasswd-secret-ec03753c is deleted [ocp_resources Secret] 2026-07-09T15:35:13.840714Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:13.860945Z [info ] Elapsed time: 4.839897155761719e-05 [0:00:00.000048] [timeout_sampler] ERROR _ ERROR at setup of TestBBRPreAuthInference.test_inference_model_in_body_only_returns_200[ocp_token_for_actor0] _ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1171, in retry_cluster_exceptions for sample in sampler: ^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 171, in __iter__ raise TimeoutExpiredError( self._get_exception_log(exp=last_exp), last_exp=last_exp, elapsed_time=elapsed_time ) timeout_sampler.TimeoutExpiredError: Timed Out: 30 Function: ocp_resources.resource._apply_patches Kwargs: {'patches': {: {'spec': {'identityProviders': [{'name': 'maas-htpasswd-idp-ec03753c', 'mappingMethod': 'claim', 'type': 'HTPasswd', 'challenge': True, 'login': True, 'htpasswd': {'fileData': {'name': 'maas-htpasswd-secret-ec03753c'}}}]}, 'metadata': {'name': 'cluster'}}}, 'action_text': 'Updating', 'action': 'update'} Last exception: UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) . Elapsed time: 0.021053314208984375 [0:00:00.021053] The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 170, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 536, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1710, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 806, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 630, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1232, in execute result: FixtureValue = ihook.pytest_fixture_setup( ~~~~~~~~~~~~~~~~~~~~~~~~~~^ fixturedef=self, request=request ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pytest_asyncio/plugin.py", line 924, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/setuponly.py", line 36, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1328, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 998, in call_fixture_func fixture_result = next(generator) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 330, in maas_htpasswd_oauth_idp ResourceEditor(patches={oauth_resource: {"spec": {"identityProviders": updated_idps}}}), ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1839, in __enter__ self.update(backup_resources=True) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1833, in update self._apply_patches_sampler(patches=patches_to_apply, action_text="Updating", action=self.action) ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1949, in _apply_patches_sampler return Resource.retry_cluster_exceptions( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ func=self._apply_patches, ^^^^^^^^^^^^^^^^^^^^^^^^^ ...<5 lines>... sleep_time=TIMEOUT_5SEC, ^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1176, in retry_cluster_exceptions raise exp.last_exp from exp File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 162, in __iter__ yield self.func(*self.func_args, **self.func_kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1931, in _apply_patches resource.update(resource_dict=patch) # update the resource ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1132, in update self.api.patch( ~~~~~~~~~~~~~~^ body=resource_dict, ^^^^^^^^^^^^^^^^^^^ namespace=self.namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^ content_type="application/merge-patch+json", ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 150, in patch return self.request('patch', path, body=body, content_type=content_type, **kwargs) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 57, in inner raise api_exception(e) kubernetes.dynamic.exceptions.UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) _ 3 of 13 completed, 2 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 1 Error, 0 ReRun _ tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_pre_auth_inference.py::TestBBRPreAuthInference::test_list_models_returns_200_with_api_key[ocp_token_for_actor0]  TEST: TestBBRPreAuthInference.test_inference_model_in_body_only_returns_200[ocp_token_for_actor0] [setup] STATUS: ERROR 2026-07-09T15:35:13.871501Z [error ] Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1171, in retry_cluster_exceptions for sample in sampler: ^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 171, in __iter__ raise TimeoutExpiredError( self._get_exception_log(exp=last_exp), last_exp=last_exp, elapsed_time=elapsed_time ) timeout_sampler.TimeoutExpiredError: Timed Out: 30 Function: ocp_resources.resource._apply_patches Kwargs: {'patches': {: {'spec': {'identityProviders': [{'name': 'maas-htpasswd-idp-ec03753c', 'mappingMethod': 'claim', 'type': 'HTPasswd', 'challenge': True, 'login': True, 'htpasswd': {'fileData': {'name': 'maas-htpasswd-secret-ec03753c'}}}]}, 'metadata': {'name': 'cluster'}}}, 'action_text': 'Updating', 'action': 'update'} Last exception: UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) . Elapsed time: 0.021053314208984375 [0:00:00.021053] The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 170, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 536, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1710, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 806, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 630, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1232, in execute result: FixtureValue = ihook.pytest_fixture_setup( ~~~~~~~~~~~~~~~~~~~~~~~~~~^ fixturedef=self, request=request ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pytest_asyncio/plugin.py", line 924, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/setuponly.py", line 36, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1328, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 998, in call_fixture_func fixture_result = next(generator) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 330, in maas_htpasswd_oauth_idp ResourceEditor(patches={oauth_resource: {"spec": {"identityProviders": updated_idps}}}), ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1839, in __enter__ self.update(backup_resources=True) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1833, in update self._apply_patches_sampler(patches=patches_to_apply, action_text="Updating", action=self.action) ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1949, in _apply_patches_sampler return Resource.retry_cluster_exceptions( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ func=self._apply_patches, ^^^^^^^^^^^^^^^^^^^^^^^^^ ...<5 lines>... sleep_time=TIMEOUT_5SEC, ^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1176, in retry_cluster_exceptions raise exp.last_exp from exp File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 162, in __iter__ yield self.func(*self.func_args, **self.func_kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1931, in _apply_patches resource.update(resource_dict=patch) # update the resource ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1132, in update self.api.patch( ~~~~~~~~~~~~~~^ body=resource_dict, ^^^^^^^^^^^^^^^^^^^ namespace=self.namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^ content_type="application/merge-patch+json", ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 150, in patch return self.request('patch', path, body=body, content_type=content_type, **kwargs) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 57, in inner raise api_exception(e) kubernetes.dynamic.exceptions.UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) [conftest] ------------------------------------------------------- TEARDOWN -------------------------------------------------------  --------------------------- test_list_models_returns_200_with_api_key[ocp_token_for_actor0] --------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- ERROR _ ERROR at setup of TestBBRPreAuthInference.test_list_models_returns_200_with_api_key[ocp_token_for_actor0] _ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1171, in retry_cluster_exceptions for sample in sampler: ^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 171, in __iter__ raise TimeoutExpiredError( self._get_exception_log(exp=last_exp), last_exp=last_exp, elapsed_time=elapsed_time ) timeout_sampler.TimeoutExpiredError: Timed Out: 30 Function: ocp_resources.resource._apply_patches Kwargs: {'patches': {: {'spec': {'identityProviders': [{'name': 'maas-htpasswd-idp-ec03753c', 'mappingMethod': 'claim', 'type': 'HTPasswd', 'challenge': True, 'login': True, 'htpasswd': {'fileData': {'name': 'maas-htpasswd-secret-ec03753c'}}}]}, 'metadata': {'name': 'cluster'}}}, 'action_text': 'Updating', 'action': 'update'} Last exception: UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) . Elapsed time: 0.021053314208984375 [0:00:00.021053] The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 170, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 536, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1710, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 806, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 630, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1204, in execute raise exc.with_traceback(exc_tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1328, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 998, in call_fixture_func fixture_result = next(generator) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 330, in maas_htpasswd_oauth_idp ResourceEditor(patches={oauth_resource: {"spec": {"identityProviders": updated_idps}}}), ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1839, in __enter__ self.update(backup_resources=True) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1833, in update self._apply_patches_sampler(patches=patches_to_apply, action_text="Updating", action=self.action) ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1949, in _apply_patches_sampler return Resource.retry_cluster_exceptions( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ func=self._apply_patches, ^^^^^^^^^^^^^^^^^^^^^^^^^ ...<5 lines>... sleep_time=TIMEOUT_5SEC, ^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1176, in retry_cluster_exceptions raise exp.last_exp from exp File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 162, in __iter__ yield self.func(*self.func_args, **self.func_kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1931, in _apply_patches resource.update(resource_dict=patch) # update the resource ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1132, in update self.api.patch( ~~~~~~~~~~~~~~^ body=resource_dict, ^^^^^^^^^^^^^^^^^^^ namespace=self.namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^ content_type="application/merge-patch+json", ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 150, in patch return self.request('patch', path, body=body, content_type=content_type, **kwargs) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 57, in inner raise api_exception(e) kubernetes.dynamic.exceptions.UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) _ 4 of 13 completed, 2 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 2 Error, 0 ReRun _ tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_pre_auth_inference.py::TestBBRPreAuthInference::test_maas_api_endpoint_not_broken_by_bbr[ocp_token_for_actor0]  TEST: TestBBRPreAuthInference.test_list_models_returns_200_with_api_key[ocp_token_for_actor0] [setup] STATUS: ERROR 2026-07-09T15:35:13.877374Z [error ] Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1171, in retry_cluster_exceptions for sample in sampler: ^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 171, in __iter__ raise TimeoutExpiredError( self._get_exception_log(exp=last_exp), last_exp=last_exp, elapsed_time=elapsed_time ) timeout_sampler.TimeoutExpiredError: Timed Out: 30 Function: ocp_resources.resource._apply_patches Kwargs: {'patches': {: {'spec': {'identityProviders': [{'name': 'maas-htpasswd-idp-ec03753c', 'mappingMethod': 'claim', 'type': 'HTPasswd', 'challenge': True, 'login': True, 'htpasswd': {'fileData': {'name': 'maas-htpasswd-secret-ec03753c'}}}]}, 'metadata': {'name': 'cluster'}}}, 'action_text': 'Updating', 'action': 'update'} Last exception: UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) . Elapsed time: 0.021053314208984375 [0:00:00.021053] The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 170, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 536, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1710, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 806, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 630, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1204, in execute raise exc.with_traceback(exc_tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1328, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 998, in call_fixture_func fixture_result = next(generator) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 330, in maas_htpasswd_oauth_idp ResourceEditor(patches={oauth_resource: {"spec": {"identityProviders": updated_idps}}}), ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1839, in __enter__ self.update(backup_resources=True) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1833, in update self._apply_patches_sampler(patches=patches_to_apply, action_text="Updating", action=self.action) ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1949, in _apply_patches_sampler return Resource.retry_cluster_exceptions( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ func=self._apply_patches, ^^^^^^^^^^^^^^^^^^^^^^^^^ ...<5 lines>... sleep_time=TIMEOUT_5SEC, ^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1176, in retry_cluster_exceptions raise exp.last_exp from exp File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 162, in __iter__ yield self.func(*self.func_args, **self.func_kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1931, in _apply_patches resource.update(resource_dict=patch) # update the resource ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1132, in update self.api.patch( ~~~~~~~~~~~~~~^ body=resource_dict, ^^^^^^^^^^^^^^^^^^^ namespace=self.namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^ content_type="application/merge-patch+json", ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 150, in patch return self.request('patch', path, body=body, content_type=content_type, **kwargs) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 57, in inner raise api_exception(e) kubernetes.dynamic.exceptions.UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) [conftest] ------------------------------------------------------- TEARDOWN -------------------------------------------------------  ---------------------------- test_maas_api_endpoint_not_broken_by_bbr[ocp_token_for_actor0] ---------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- ERROR _ ERROR at setup of TestBBRPreAuthInference.test_maas_api_endpoint_not_broken_by_bbr[ocp_token_for_actor0] _ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1171, in retry_cluster_exceptions for sample in sampler: ^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 171, in __iter__ raise TimeoutExpiredError( self._get_exception_log(exp=last_exp), last_exp=last_exp, elapsed_time=elapsed_time ) timeout_sampler.TimeoutExpiredError: Timed Out: 30 Function: ocp_resources.resource._apply_patches Kwargs: {'patches': {: {'spec': {'identityProviders': [{'name': 'maas-htpasswd-idp-ec03753c', 'mappingMethod': 'claim', 'type': 'HTPasswd', 'challenge': True, 'login': True, 'htpasswd': {'fileData': {'name': 'maas-htpasswd-secret-ec03753c'}}}]}, 'metadata': {'name': 'cluster'}}}, 'action_text': 'Updating', 'action': 'update'} Last exception: UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) . Elapsed time: 0.021053314208984375 [0:00:00.021053] The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 170, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 536, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1710, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 806, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 630, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1204, in execute raise exc.with_traceback(exc_tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1328, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 998, in call_fixture_func fixture_result = next(generator) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 330, in maas_htpasswd_oauth_idp ResourceEditor(patches={oauth_resource: {"spec": {"identityProviders": updated_idps}}}), ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1839, in __enter__ self.update(backup_resources=True) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1833, in update self._apply_patches_sampler(patches=patches_to_apply, action_text="Updating", action=self.action) ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1949, in _apply_patches_sampler return Resource.retry_cluster_exceptions( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ func=self._apply_patches, ^^^^^^^^^^^^^^^^^^^^^^^^^ ...<5 lines>... sleep_time=TIMEOUT_5SEC, ^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1176, in retry_cluster_exceptions raise exp.last_exp from exp File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 162, in __iter__ yield self.func(*self.func_args, **self.func_kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1931, in _apply_patches resource.update(resource_dict=patch) # update the resource ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1132, in update self.api.patch( ~~~~~~~~~~~~~~^ body=resource_dict, ^^^^^^^^^^^^^^^^^^^ namespace=self.namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^ content_type="application/merge-patch+json", ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 150, in patch return self.request('patch', path, body=body, content_type=content_type, **kwargs) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 57, in inner raise api_exception(e) kubernetes.dynamic.exceptions.UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) _ 5 of 13 completed, 2 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 3 Error, 0 ReRun _ tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::TestBBRSetup::test_bbr_pre_processing_deployment_ready  TEST: TestBBRPreAuthInference.test_maas_api_endpoint_not_broken_by_bbr[ocp_token_for_actor0] [setup] STATUS: ERROR 2026-07-09T15:35:14.079112Z [error ] Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1171, in retry_cluster_exceptions for sample in sampler: ^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 171, in __iter__ raise TimeoutExpiredError( self._get_exception_log(exp=last_exp), last_exp=last_exp, elapsed_time=elapsed_time ) timeout_sampler.TimeoutExpiredError: Timed Out: 30 Function: ocp_resources.resource._apply_patches Kwargs: {'patches': {: {'spec': {'identityProviders': [{'name': 'maas-htpasswd-idp-ec03753c', 'mappingMethod': 'claim', 'type': 'HTPasswd', 'challenge': True, 'login': True, 'htpasswd': {'fileData': {'name': 'maas-htpasswd-secret-ec03753c'}}}]}, 'metadata': {'name': 'cluster'}}}, 'action_text': 'Updating', 'action': 'update'} Last exception: UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) . Elapsed time: 0.021053314208984375 [0:00:00.021053] The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 170, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 536, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1710, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 806, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 630, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1204, in execute raise exc.with_traceback(exc_tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1328, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 998, in call_fixture_func fixture_result = next(generator) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 330, in maas_htpasswd_oauth_idp ResourceEditor(patches={oauth_resource: {"spec": {"identityProviders": updated_idps}}}), ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1839, in __enter__ self.update(backup_resources=True) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1833, in update self._apply_patches_sampler(patches=patches_to_apply, action_text="Updating", action=self.action) ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1949, in _apply_patches_sampler return Resource.retry_cluster_exceptions( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ func=self._apply_patches, ^^^^^^^^^^^^^^^^^^^^^^^^^ ...<5 lines>... sleep_time=TIMEOUT_5SEC, ^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1176, in retry_cluster_exceptions raise exp.last_exp from exp File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 162, in __iter__ yield self.func(*self.func_args, **self.func_kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1931, in _apply_patches resource.update(resource_dict=patch) # update the resource ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1132, in update self.api.patch( ~~~~~~~~~~~~~~^ body=resource_dict, ^^^^^^^^^^^^^^^^^^^ namespace=self.namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^ content_type="application/merge-patch+json", ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 150, in patch return self.request('patch', path, body=body, content_type=content_type, **kwargs) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 57, in inner raise api_exception(e) kubernetes.dynamic.exceptions.UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) [conftest] ------------------------------------------------------- TEARDOWN -------------------------------------------------------  --------------------------------------- test_bbr_pre_processing_deployment_ready --------------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- --------------------------------------------------------- CALL --------------------------------------------------------- 2026-07-09T15:35:14.079883Z [info ] kind: Deployment api version: apps/v1 [ocp_resources.resource] PASSED _ 6 of 13 completed, 3 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 3 Error, 0 ReRun _ tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::TestBBRSetup::test_bbr_pre_processing_service_exposes_port_9004 2026-07-09T15:35:14.149986Z [info ] Deployment 'openshift-ingress/payload-pre-processing' is ready (1/1 replicas) [tests.model_serving.maas_billing.body_base_routing.pre_auth_model_header.utils] name=tests.model_serving.maas_billing.body_base_routing.pre_auth_model_header.utils  TEST: TestBBRSetup.test_bbr_pre_processing_deployment_ready STATUS: PASSED ------------------------------------------------------- TEARDOWN -------------------------------------------------------  ---------------------------------- test_bbr_pre_processing_service_exposes_port_9004 ---------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- --------------------------------------------------------- CALL --------------------------------------------------------- PASSED _ 7 of 13 completed, 4 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 3 Error, 0 ReRun _ tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py::TestBBRSetup::test_bbr_pre_processing_destination_rule_exists 2026-07-09T15:35:14.188986Z [info ] Service 'openshift-ingress/payload-pre-processing' exposes gRPC port 9004 [tests.model_serving.maas_billing.body_base_routing.pre_auth_model_header.utils] name=tests.model_serving.maas_billing.body_base_routing.pre_auth_model_header.utils  TEST: TestBBRSetup.test_bbr_pre_processing_service_exposes_port_9004 STATUS: PASSED ------------------------------------------------------- TEARDOWN -------------------------------------------------------  ----------------------------------- test_bbr_pre_processing_destination_rule_exists ----------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- --------------------------------------------------------- CALL --------------------------------------------------------- 2026-07-09T15:35:14.192364Z [info ] kind: DestinationRule api version: networking.istio.io/v1 [ocp_resources.resource] PASSED _ 8 of 13 completed, 5 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 3 Error, 0 ReRun _ tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::TestAuthPolicyApiKeyValidation::test_auth_policy_callback_url_uses_correct_namespace 2026-07-09T15:35:14.212167Z [info ] DestinationRule 'openshift-ingress/payload-pre-processing' exists [tests.model_serving.maas_billing.body_base_routing.pre_auth_model_header.utils] name=tests.model_serving.maas_billing.body_base_routing.pre_auth_model_header.utils  TEST: TestBBRSetup.test_bbr_pre_processing_destination_rule_exists STATUS: PASSED ------------------------------------------------------- TEARDOWN -------------------------------------------------------  --------------------------------- test_auth_policy_callback_url_uses_correct_namespace --------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- ERROR _ ERROR at setup of TestAuthPolicyApiKeyValidation.test_auth_policy_callback_url_uses_correct_namespace _ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1171, in retry_cluster_exceptions for sample in sampler: ^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 171, in __iter__ raise TimeoutExpiredError( self._get_exception_log(exp=last_exp), last_exp=last_exp, elapsed_time=elapsed_time ) timeout_sampler.TimeoutExpiredError: Timed Out: 30 Function: ocp_resources.resource._apply_patches Kwargs: {'patches': {: {'spec': {'identityProviders': [{'name': 'maas-htpasswd-idp-ec03753c', 'mappingMethod': 'claim', 'type': 'HTPasswd', 'challenge': True, 'login': True, 'htpasswd': {'fileData': {'name': 'maas-htpasswd-secret-ec03753c'}}}]}, 'metadata': {'name': 'cluster'}}}, 'action_text': 'Updating', 'action': 'update'} Last exception: UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) . Elapsed time: 0.021053314208984375 [0:00:00.021053] The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 170, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 536, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1710, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 806, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 630, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1204, in execute raise exc.with_traceback(exc_tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1328, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 998, in call_fixture_func fixture_result = next(generator) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 330, in maas_htpasswd_oauth_idp ResourceEditor(patches={oauth_resource: {"spec": {"identityProviders": updated_idps}}}), ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1839, in __enter__ self.update(backup_resources=True) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1833, in update self._apply_patches_sampler(patches=patches_to_apply, action_text="Updating", action=self.action) ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1949, in _apply_patches_sampler return Resource.retry_cluster_exceptions( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ func=self._apply_patches, ^^^^^^^^^^^^^^^^^^^^^^^^^ ...<5 lines>... sleep_time=TIMEOUT_5SEC, ^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1176, in retry_cluster_exceptions raise exp.last_exp from exp File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 162, in __iter__ yield self.func(*self.func_args, **self.func_kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1931, in _apply_patches resource.update(resource_dict=patch) # update the resource ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1132, in update self.api.patch( ~~~~~~~~~~~~~~^ body=resource_dict, ^^^^^^^^^^^^^^^^^^^ namespace=self.namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^ content_type="application/merge-patch+json", ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 150, in patch return self.request('patch', path, body=body, content_type=content_type, **kwargs) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 57, in inner raise api_exception(e) kubernetes.dynamic.exceptions.UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) _ 9 of 13 completed, 5 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 4 Error, 0 ReRun _ tests/model_serving/maas_billing/multitenancy/aitenant/test_tenant_setup.py::TestAITenantTenantSetup::test_aitenant_crd_exists  TEST: TestAuthPolicyApiKeyValidation.test_auth_policy_callback_url_uses_correct_namespace [setup] STATUS: ERROR 2026-07-09T15:35:14.220789Z [error ] Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1171, in retry_cluster_exceptions for sample in sampler: ^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 171, in __iter__ raise TimeoutExpiredError( self._get_exception_log(exp=last_exp), last_exp=last_exp, elapsed_time=elapsed_time ) timeout_sampler.TimeoutExpiredError: Timed Out: 30 Function: ocp_resources.resource._apply_patches Kwargs: {'patches': {: {'spec': {'identityProviders': [{'name': 'maas-htpasswd-idp-ec03753c', 'mappingMethod': 'claim', 'type': 'HTPasswd', 'challenge': True, 'login': True, 'htpasswd': {'fileData': {'name': 'maas-htpasswd-secret-ec03753c'}}}]}, 'metadata': {'name': 'cluster'}}}, 'action_text': 'Updating', 'action': 'update'} Last exception: UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) . Elapsed time: 0.021053314208984375 [0:00:00.021053] The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 170, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 536, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1710, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 806, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 630, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1204, in execute raise exc.with_traceback(exc_tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1328, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 998, in call_fixture_func fixture_result = next(generator) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 330, in maas_htpasswd_oauth_idp ResourceEditor(patches={oauth_resource: {"spec": {"identityProviders": updated_idps}}}), ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1839, in __enter__ self.update(backup_resources=True) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1833, in update self._apply_patches_sampler(patches=patches_to_apply, action_text="Updating", action=self.action) ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1949, in _apply_patches_sampler return Resource.retry_cluster_exceptions( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ func=self._apply_patches, ^^^^^^^^^^^^^^^^^^^^^^^^^ ...<5 lines>... sleep_time=TIMEOUT_5SEC, ^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1176, in retry_cluster_exceptions raise exp.last_exp from exp File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 162, in __iter__ yield self.func(*self.func_args, **self.func_kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1931, in _apply_patches resource.update(resource_dict=patch) # update the resource ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1132, in update self.api.patch( ~~~~~~~~~~~~~~^ body=resource_dict, ^^^^^^^^^^^^^^^^^^^ namespace=self.namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^ content_type="application/merge-patch+json", ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 150, in patch return self.request('patch', path, body=body, content_type=content_type, **kwargs) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 57, in inner raise api_exception(e) kubernetes.dynamic.exceptions.UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) [conftest] ------------------------------------------------------- TEARDOWN -------------------------------------------------------  ----------------------------------------------- test_aitenant_crd_exists ----------------------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- --------------------------------------------------------- CALL --------------------------------------------------------- 2026-07-09T15:35:14.222884Z [info ] kind: CustomResourceDefinition api version: apiextensions.k8s.io/v1 [ocp_resources.resource] PASSED _ 10 of 13 completed, 6 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 4 Error, 0 ReRun _ tests/model_serving/maas_billing/multitenancy/aitenant/test_tenant_setup.py::TestAITenantTenantSetup::test_aitenant_bootstrap_creates_tenant_environment 2026-07-09T15:35:14.261233Z [info ] AITenant CRD 'aitenants.maas.opendatahub.io' exists [_pytest.compat] name=multitenancy.aitenant.test_tenant_setup  TEST: TestAITenantTenantSetup.test_aitenant_crd_exists STATUS: PASSED ------------------------------------------------------- TEARDOWN -------------------------------------------------------  ---------------------------------- test_aitenant_bootstrap_creates_tenant_environment ---------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-07-09T15:35:14.263805Z [info ] Executing session fixture: aitenant_infra_namespace [conftest] 2026-07-09T15:35:14.282214Z [info ] Executing session fixture: teardown_resources [conftest] 2026-07-09T15:35:14.282349Z [info ] Executing function fixture: aitenant_test_params [conftest] 2026-07-09T15:35:14.282505Z [info ] Executing function fixture: aitenant_bootstrap_gateway [conftest] 2026-07-09T15:35:14.282629Z [info ] kind: Gateway api version: gateway.networking.k8s.io/v1 [ocp_resources.resource] 2026-07-09T15:35:14.282747Z [info ] Create Gateway e2e-aigw-a124ef78 [ocp_resources Gateway] 2026-07-09T15:35:14.282866Z [info ] Posting {'apiVersion': 'gateway.networking.k8s.io/v1', 'kind': 'Gateway', 'metadata': {'name': 'e2e-aigw-a124ef78', 'namespace': 'openshift-ingress'}, 'spec': {'gatewayClassName': 'openshift-default', 'listeners': [{'name': 'http', 'port': 80, 'protocol': 'HTTP'}]}} [ocp_resources Gateway] 2026-07-09T15:35:14.322579Z [info ] Executing function fixture: aitenant [conftest] 2026-07-09T15:35:14.461545Z [info ] kind: AITenant api version: maas.opendatahub.io/v1alpha1 [ocp_resources.resource] 2026-07-09T15:35:14.461733Z [info ] Create AITenant e2e-aigw-a124ef78 [ocp_resources AITenant] 2026-07-09T15:35:14.461991Z [info ] Posting {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'kind': 'AITenant', 'metadata': {'name': 'e2e-aigw-a124ef78', 'namespace': 'ai-tenants'}, 'spec': {'gateway': {'name': 'e2e-aigw-a124ef78'}}} [ocp_resources AITenant] 2026-07-09T15:35:14.541625Z [info ] Wait until AITenant e2e-aigw-a124ef78 is created [ocp_resources AITenant] 2026-07-09T15:35:14.541806Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:14.566465Z [info ] Elapsed time: 4.9114227294921875e-05 [0:00:00.000049] [timeout_sampler] 2026-07-09T15:35:14.566630Z [info ] Executing function fixture: ready_aitenant [conftest] 2026-07-09T15:35:14.625493Z [info ] Wait for AITenant/e2e-aigw-a124ef78's 'Ready' condition to be 'True' [ocp_resources AITenant] 2026-07-09T15:35:14.625678Z [info ] Wait until AITenant e2e-aigw-a124ef78 is created [ocp_resources AITenant] 2026-07-09T15:35:14.626340Z [info ] Waiting for 300 seconds [0:05:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:14.650691Z [info ] Elapsed time: 3.409385681152344e-05 [0:00:00.000034] [timeout_sampler] 2026-07-09T15:35:14.650841Z [info ] Waiting for 299.9747848510742 seconds [0:04:59.974785], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-09T15:35:15.727078Z [info ] Elapsed time: 1.0460455417633057 [0:00:01.046046] [timeout_sampler] 2026-07-09T15:35:15.753549Z [info ] Executing function fixture: aitenant_for_test [conftest] --------------------------------------------------------- CALL --------------------------------------------------------- 2026-07-09T15:35:15.801500Z [info ] Wait for AITenant/e2e-aigw-a124ef78's 'Ready' condition to be 'True' [ocp_resources AITenant] 2026-07-09T15:35:15.801678Z [info ] Wait until AITenant e2e-aigw-a124ef78 is created [ocp_resources AITenant] 2026-07-09T15:35:15.801824Z [info ] Waiting for 300 seconds [0:05:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:15.827229Z [info ] Elapsed time: 4.3392181396484375e-05 [0:00:00.000043] [timeout_sampler] 2026-07-09T15:35:15.827368Z [info ] Waiting for 299.97428727149963 seconds [0:04:59.974287], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-09T15:35:15.851606Z [info ] Elapsed time: 3.695487976074219e-05 [0:00:00.000037] [timeout_sampler] 2026-07-09T15:35:15.986814Z [info ] kind: Gateway api version: gateway.networking.k8s.io/v1 --- [DuplicateFilter: Last log `kind: AITenant api version: maas.opendatahub.io/v1alpha1` repeated 2 times] [ocp_resources.resource] 2026-07-09T15:35:16.098817Z [info ] Wait for Gateway/e2e-aigw-a124ef78's 'Programmed' condition to be 'True' [ocp_resources Gateway] 2026-07-09T15:35:16.098975Z [info ] Wait until Gateway e2e-aigw-a124ef78 is created [ocp_resources Gateway] 2026-07-09T15:35:16.099091Z [info ] Waiting for 300 seconds [0:05:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:16.119126Z [info ] Elapsed time: 6.985664367675781e-05 [0:00:00.000070] [timeout_sampler] 2026-07-09T15:35:16.119294Z [info ] Waiting for 299.9795482158661 seconds [0:04:59.979548], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-09T15:35:18.189071Z [info ] Elapsed time: 2.050661563873291 [0:00:02.050662] [timeout_sampler] 2026-07-09T15:35:18.189264Z [info ] kind: Tenant api version: maas.opendatahub.io/v1alpha1 [ocp_resources.resource] FAILED TEST: TestAITenantTenantSetup.test_aitenant_bootstrap_creates_tenant_environment STATUS: FAILED 2026-07-09T15:35:18.274816Z [error ] Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 184, in pytest_runtest_call item.runtest() ~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1707, in runtest self.ihook.pytest_pyfunc_call(pyfuncitem=self) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 167, in pytest_pyfunc_call result = testfunction(**testargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aitenant/test_tenant_setup.py", line 41, in test_aitenant_bootstrap_creates_tenant_environment verify_aitenant_bootstrap_children( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ admin_client=admin_client, ^^^^^^^^^^^^^^^^^^^^^^^^^^ test_context=aitenant_for_test, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aitenant/utils.py", line 323, in verify_aitenant_bootstrap_children assert tenant_gateway_ref.name == MAAS_GATEWAY_NAME, ( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: Tenant gatewayRef.name expected 'maas-default-gateway', got 'e2e-aigw-a124ef78' [conftest] ------------------------------------------------------- TEARDOWN ------------------------------------------------------- 2026-07-09T15:35:18.275110Z [info ] Delete AITenant e2e-aigw-a124ef78 [ocp_resources AITenant] 2026-07-09T15:35:18.313575Z [info ] Deleting {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'kind': 'AITenant', 'metadata': {'creationTimestamp': '2026-07-09T15:35:14Z', 'finalizers': ['maas.opendatahub.io/aitenant-cleanup'], 'generation': 1, 'managedFields': [{'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'.': {}, 'f:gateway': {'.': {}, 'f:name': {}}}}, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': '2026-07-09T15:35:14Z'}, {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:finalizers': {'.': {}, 'v:"maas.opendatahub.io/aitenant-cleanup"': {}}}}, 'manager': 'manager', 'operation': 'Update', 'time': '2026-07-09T15:35:14Z'}, {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'.': {}, 'f:conditions': {}, 'f:gatewayRef': {'.': {}, 'f:name': {}, 'f:namespace': {}}, 'f:phase': {}, 'f:tenantNamespace': {}}}, 'manager': 'manager', 'operation': 'Update', 'subresource': 'status', 'time': '2026-07-09T15:35:15Z'}], 'name': 'e2e-aigw-a124ef78', 'namespace': 'ai-tenants', 'resourceVersion': '22044602', 'uid': '14251cf2-14ff-4aac-9bcf-623dc5f18c74'}, 'spec': {'gateway': {'name': 'e2e-aigw-a124ef78'}}, 'status': {'conditions': [{'lastTransitionTime': '2026-07-09T15:35:15Z', 'message': 'AITenant bootstrap resources are reconciled', 'observedGeneration': 1, 'reason': 'Reconciled', 'status': 'True', 'type': 'Ready'}], 'gatewayRef': {'name': 'e2e-aigw-a124ef78', 'namespace': 'openshift-ingress'}, 'phase': 'Active', 'tenantNamespace': 'ai-tenant-e2e-aigw-a124ef78'}} [ocp_resources AITenant] 2026-07-09T15:35:18.337613Z [info ] Wait until AITenant e2e-aigw-a124ef78 is deleted [ocp_resources AITenant] 2026-07-09T15:35:18.337747Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:19.381442Z [info ] Elapsed time: 1.0224215984344482 [0:00:01.022422] [timeout_sampler] 2026-07-09T15:35:19.381679Z [info ] Delete Gateway e2e-aigw-a124ef78 [ocp_resources Gateway] 2026-07-09T15:35:19.436376Z [info ] Deleting {'apiVersion': 'gateway.networking.k8s.io/v1', 'kind': 'Gateway', 'metadata': {'creationTimestamp': '2026-07-09T15:35:14Z', 'generation': 1, 'labels': {'istio.io/rev': 'openshift-gateway'}, 'managedFields': [{'apiVersion': 'gateway.networking.k8s.io/v1beta1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:gateway.istio.io/controller-version': {}}}}, 'manager': 'openshift.io/gateway-controller/v1', 'operation': 'Apply', 'subresource': 'status', 'time': '2026-07-09T15:35:14Z'}, {'apiVersion': 'gateway.networking.k8s.io/v1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {}}, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': '2026-07-09T15:35:14Z'}, {'apiVersion': 'gateway.networking.k8s.io/v1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:labels': {'.': {}, 'f:istio.io/rev': {}}}}, 'manager': 'ingress-operator', 'operation': 'Update', 'time': '2026-07-09T15:35:14Z'}, {'apiVersion': 'gateway.networking.k8s.io/v1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'f:conditions': {'k:{"type":"kuadrant.io/TokenRateLimitPolicyAffected"}': {'.': {}, 'f:lastTransitionTime': {}, 'f:message': {}, 'f:observedGeneration': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}}, 'f:listeners': {'k:{"name":"http"}': {'f:conditions': {'k:{"type":"kuadrant.io/TokenRateLimitPolicyAffected"}': {'.': {}, 'f:lastTransitionTime': {}, 'f:message': {}, 'f:observedGeneration': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}}}}}}, 'manager': 'manager', 'operation': 'Update', 'subresource': 'status', 'time': '2026-07-09T15:35:17Z'}, {'apiVersion': 'gateway.networking.k8s.io/v1beta1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'f:addresses': {}, 'f:conditions': {'k:{"type":"Accepted"}': {'f:lastTransitionTime': {}, 'f:message': {}, 'f:observedGeneration': {}, 'f:reason': {}, 'f:status': {}}, 'k:{"type":"Programmed"}': {'f:lastTransitionTime': {}, 'f:message': {}, 'f:observedGeneration': {}, 'f:reason': {}, 'f:status': {}}}, 'f:listeners': {'.': {}, 'k:{"name":"http"}': {'.': {}, 'f:attachedRoutes': {}, 'f:conditions': {'.': {}, 'k:{"type":"Accepted"}': {'.': {}, 'f:lastTransitionTime': {}, 'f:message': {}, 'f:observedGeneration': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}, 'k:{"type":"Conflicted"}': {'.': {}, 'f:lastTransitionTime': {}, 'f:message': {}, 'f:observedGeneration': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}, 'k:{"type":"Programmed"}': {'.': {}, 'f:lastTransitionTime': {}, 'f:message': {}, 'f:observedGeneration': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}, 'k:{"type":"ResolvedRefs"}': {'.': {}, 'f:lastTransitionTime': {}, 'f:message': {}, 'f:observedGeneration': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}}, 'f:name': {}, 'f:supportedKinds': {}}}}}, 'manager': 'pilot-discovery', 'operation': 'Update', 'subresource': 'status', 'time': '2026-07-09T15:35:17Z'}], 'name': 'e2e-aigw-a124ef78', 'namespace': 'openshift-ingress', 'resourceVersion': '22044725', 'uid': '266bfb82-e954-43b9-ba59-a712fcfb91f8'}, 'spec': {'gatewayClassName': 'openshift-default', 'listeners': [{'allowedRoutes': {'namespaces': {'from': 'Same'}}, 'name': 'http', 'port': 80, 'protocol': 'HTTP'}]}, 'status': {'addresses': [{'type': 'Hostname', 'value': 'af67b36f00f9d46c3b5e7accfbb4cf46-252362028.us-east-2.elb.amazonaws.com'}], 'conditions': [{'lastTransitionTime': '2026-07-09T15:35:14Z', 'message': 'Resource accepted', 'observedGeneration': 1, 'reason': 'Accepted', 'status': 'True', 'type': 'Accepted'}, {'lastTransitionTime': '2026-07-09T15:35:17Z', 'message': 'Resource programmed, assigned to service(s) e2e-aigw-a124ef78-openshift-default.openshift-ingress.svc.cluster.local:80', 'observedGeneration': 1, 'reason': 'Programmed', 'status': 'True', 'type': 'Programmed'}, {'lastTransitionTime': '2026-07-09T15:35:17Z', 'message': 'Object affected by TokenRateLimitPolicy [openshift-ingress/gateway-default-deny-e2e-aigw-a124ef78]', 'observedGeneration': 1, 'reason': 'Accepted', 'status': 'True', 'type': 'kuadrant.io/TokenRateLimitPolicyAffected'}], 'listeners': [{'attachedRoutes': 0, 'conditions': [{'lastTransitionTime': '2026-07-09T15:35:14Z', 'message': 'No errors found', 'observedGeneration': 1, 'reason': 'Accepted', 'status': 'True', 'type': 'Accepted'}, {'lastTransitionTime': '2026-07-09T15:35:14Z', 'message': 'No errors found', 'observedGeneration': 1, 'reason': 'NoConflicts', 'status': 'False', 'type': 'Conflicted'}, {'lastTransitionTime': '2026-07-09T15:35:14Z', 'message': 'No errors found', 'observedGeneration': 1, 'reason': 'Programmed', 'status': 'True', 'type': 'Programmed'}, {'lastTransitionTime': '2026-07-09T15:35:14Z', 'message': 'No errors found', 'observedGeneration': 1, 'reason': 'ResolvedRefs', 'status': 'True', 'type': 'ResolvedRefs'}, {'lastTransitionTime': '2026-07-09T15:35:17Z', 'message': 'Object affected by TokenRateLimitPolicy [openshift-ingress/gateway-default-deny-e2e-aigw-a124ef78]', 'observedGeneration': 1, 'reason': 'Accepted', 'status': 'True', 'type': 'kuadrant.io/TokenRateLimitPolicyAffected'}], 'name': 'http', 'supportedKinds': [{'group': 'gateway.networking.k8s.io', 'kind': 'HTTPRoute'}, {'group': 'gateway.networking.k8s.io', 'kind': 'GRPCRoute'}]}]}} [ocp_resources Gateway] 2026-07-09T15:35:19.466781Z [info ] Wait until Gateway e2e-aigw-a124ef78 is deleted [ocp_resources Gateway] 2026-07-09T15:35:19.466946Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] __ TestAITenantTenantSetup.test_aitenant_bootstrap_creates_tenant_environment __ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 184, in pytest_runtest_call item.runtest() ~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1707, in runtest self.ihook.pytest_pyfunc_call(pyfuncitem=self) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 167, in pytest_pyfunc_call result = testfunction(**testargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aitenant/test_tenant_setup.py", line 41, in test_aitenant_bootstrap_creates_tenant_environment verify_aitenant_bootstrap_children( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ admin_client=admin_client, ^^^^^^^^^^^^^^^^^^^^^^^^^^ test_context=aitenant_for_test, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aitenant/utils.py", line 323, in verify_aitenant_bootstrap_children assert tenant_gateway_ref.name == MAAS_GATEWAY_NAME, ( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: Tenant gatewayRef.name expected 'maas-default-gateway', got 'e2e-aigw-a124ef78' _ 11 of 13 completed, 6 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 4 Error, 0 ReRun _ tests/model_serving/maas_billing/multitenancy/aitenant/test_tenant_setup.py::TestAITenantTenantSetup::test_aitenant_bootstrap_does_not_break_default_tenant 2026-07-09T15:35:19.489887Z [info ] Elapsed time: 5.340576171875e-05 [0:00:00.000053] [timeout_sampler]  -------------------------------- test_aitenant_bootstrap_does_not_break_default_tenant -------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-07-09T15:35:19.490577Z [info ] Executing function fixture: aitenant_test_params [conftest] 2026-07-09T15:35:19.490690Z [info ] Executing function fixture: aitenant_bootstrap_gateway [conftest] 2026-07-09T15:35:19.490801Z [info ] kind: Gateway api version: gateway.networking.k8s.io/v1 [ocp_resources.resource] 2026-07-09T15:35:19.490907Z [info ] Create Gateway e2e-aigw-4f20af59 [ocp_resources Gateway] 2026-07-09T15:35:19.491019Z [info ] Posting {'apiVersion': 'gateway.networking.k8s.io/v1', 'kind': 'Gateway', 'metadata': {'name': 'e2e-aigw-4f20af59', 'namespace': 'openshift-ingress'}, 'spec': {'gatewayClassName': 'openshift-default', 'listeners': [{'name': 'http', 'port': 80, 'protocol': 'HTTP'}]}} [ocp_resources Gateway] 2026-07-09T15:35:19.538002Z [info ] Executing function fixture: aitenant [conftest] 2026-07-09T15:35:19.538381Z [info ] kind: AITenant api version: maas.opendatahub.io/v1alpha1 [ocp_resources.resource] 2026-07-09T15:35:19.538530Z [info ] Create AITenant e2e-aigw-4f20af59 [ocp_resources AITenant] 2026-07-09T15:35:19.538645Z [info ] Posting {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'kind': 'AITenant', 'metadata': {'name': 'e2e-aigw-4f20af59', 'namespace': 'ai-tenants'}, 'spec': {'gateway': {'name': 'e2e-aigw-4f20af59'}}} [ocp_resources AITenant] 2026-07-09T15:35:19.598616Z [info ] Wait until AITenant e2e-aigw-4f20af59 is created [ocp_resources AITenant] 2026-07-09T15:35:19.598777Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:19.618056Z [info ] Elapsed time: 5.888938903808594e-05 [0:00:00.000059] [timeout_sampler] 2026-07-09T15:35:19.618331Z [info ] Executing function fixture: ready_aitenant [conftest] 2026-07-09T15:35:19.662635Z [info ] Wait for AITenant/e2e-aigw-4f20af59's 'Ready' condition to be 'True' [ocp_resources AITenant] 2026-07-09T15:35:19.662798Z [info ] Wait until AITenant e2e-aigw-4f20af59 is created [ocp_resources AITenant] 2026-07-09T15:35:19.662944Z [info ] Waiting for 300 seconds [0:05:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:19.683730Z [info ] Elapsed time: 4.6253204345703125e-05 [0:00:00.000046] [timeout_sampler] 2026-07-09T15:35:19.684023Z [info ] Waiting for 299.9790644645691 seconds [0:04:59.979064], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-09T15:35:21.760112Z [info ] Elapsed time: 2.0482842922210693 [0:00:02.048284] [timeout_sampler] 2026-07-09T15:35:21.785216Z [info ] Executing function fixture: aitenant_for_test [conftest] --------------------------------------------------------- CALL --------------------------------------------------------- 2026-07-09T15:35:21.842942Z [info ] Wait for AITenant/e2e-aigw-4f20af59's 'Ready' condition to be 'True' [ocp_resources AITenant] 2026-07-09T15:35:21.843104Z [info ] Wait until AITenant e2e-aigw-4f20af59 is created [ocp_resources AITenant] 2026-07-09T15:35:21.843257Z [info ] Waiting for 300 seconds [0:05:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:21.862360Z [info ] Elapsed time: 4.482269287109375e-05 [0:00:00.000045] [timeout_sampler] 2026-07-09T15:35:21.862539Z [info ] Waiting for 299.9806880950928 seconds [0:04:59.980688], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-09T15:35:21.892865Z [info ] Elapsed time: 3.314018249511719e-05 [0:00:00.000033] [timeout_sampler] 2026-07-09T15:35:21.919805Z [info ] kind: Tenant api version: maas.opendatahub.io/v1alpha1 [ocp_resources.resource] 2026-07-09T15:35:21.944338Z [info ] Wait for Tenant/default-tenant's 'Ready' condition to be 'True' [ocp_resources Tenant] 2026-07-09T15:35:21.944517Z [info ] Wait until Tenant default-tenant is created [ocp_resources Tenant] 2026-07-09T15:35:21.944650Z [info ] Waiting for 300 seconds [0:05:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:21.966287Z [info ] Elapsed time: 4.076957702636719e-05 [0:00:00.000041] [timeout_sampler] 2026-07-09T15:35:21.966444Z [info ] Waiting for 299.978022813797 seconds [0:04:59.978023], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] PASSED2026-07-09T15:35:21.987498Z [info ] Elapsed time: 3.147125244140625e-05 [0:00:00.000031] [timeout_sampler] 2026-07-09T15:35:21.986923Z [info ] Regression check passed: Tenant/default-tenant in 'models-as-a-service' is still Ready [tests.model_serving.maas_billing.multitenancy.aitenant.utils] name=tests.model_serving.maas_billing.multitenancy.aitenant.utils  TEST: TestAITenantTenantSetup.test_aitenant_bootstrap_does_not_break_default_tenant STATUS: PASSED ------------------------------------------------------- TEARDOWN ------------------------------------------------------- 2026-07-09T15:35:21.988877Z [info ] Delete AITenant e2e-aigw-4f20af59 [ocp_resources AITenant] 2026-07-09T15:35:22.033029Z [info ] Deleting {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'kind': 'AITenant', 'metadata': {'creationTimestamp': '2026-07-09T15:35:19Z', 'finalizers': ['maas.opendatahub.io/aitenant-cleanup'], 'generation': 1, 'managedFields': [{'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'.': {}, 'f:gateway': {'.': {}, 'f:name': {}}}}, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': '2026-07-09T15:35:19Z'}, {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:finalizers': {'.': {}, 'v:"maas.opendatahub.io/aitenant-cleanup"': {}}}}, 'manager': 'manager', 'operation': 'Update', 'time': '2026-07-09T15:35:19Z'}, {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'.': {}, 'f:conditions': {}, 'f:gatewayRef': {'.': {}, 'f:name': {}, 'f:namespace': {}}, 'f:phase': {}, 'f:tenantNamespace': {}}}, 'manager': 'manager', 'operation': 'Update', 'subresource': 'status', 'time': '2026-07-09T15:35:20Z'}], 'name': 'e2e-aigw-4f20af59', 'namespace': 'ai-tenants', 'resourceVersion': '22044985', 'uid': '0aa33aaa-1a4b-4c90-b755-69c20da5deb8'}, 'spec': {'gateway': {'name': 'e2e-aigw-4f20af59'}}, 'status': {'conditions': [{'lastTransitionTime': '2026-07-09T15:35:20Z', 'message': 'AITenant bootstrap resources are reconciled', 'observedGeneration': 1, 'reason': 'Reconciled', 'status': 'True', 'type': 'Ready'}], 'gatewayRef': {'name': 'e2e-aigw-4f20af59', 'namespace': 'openshift-ingress'}, 'phase': 'Active', 'tenantNamespace': 'ai-tenant-e2e-aigw-4f20af59'}} [ocp_resources AITenant] 2026-07-09T15:35:22.060142Z [info ] Wait until AITenant e2e-aigw-4f20af59 is deleted [ocp_resources AITenant] 2026-07-09T15:35:22.060324Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:23.108307Z [info ] Elapsed time: 1.0272958278656006 [0:00:01.027296] [timeout_sampler] 2026-07-09T15:35:23.108509Z [info ] Delete Gateway e2e-aigw-4f20af59 [ocp_resources Gateway] 2026-07-09T15:35:23.156286Z [info ] Deleting {'apiVersion': 'gateway.networking.k8s.io/v1', 'kind': 'Gateway', 'metadata': {'creationTimestamp': '2026-07-09T15:35:19Z', 'generation': 1, 'labels': {'istio.io/rev': 'openshift-gateway'}, 'managedFields': [{'apiVersion': 'gateway.networking.k8s.io/v1beta1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:gateway.istio.io/controller-version': {}}}}, 'manager': 'openshift.io/gateway-controller/v1', 'operation': 'Apply', 'subresource': 'status', 'time': '2026-07-09T15:35:19Z'}, {'apiVersion': 'gateway.networking.k8s.io/v1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {}}, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': '2026-07-09T15:35:19Z'}, {'apiVersion': 'gateway.networking.k8s.io/v1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:labels': {'.': {}, 'f:istio.io/rev': {}}}}, 'manager': 'ingress-operator', 'operation': 'Update', 'time': '2026-07-09T15:35:19Z'}, {'apiVersion': 'gateway.networking.k8s.io/v1beta1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'f:conditions': {'k:{"type":"Accepted"}': {'f:lastTransitionTime': {}, 'f:message': {}, 'f:observedGeneration': {}, 'f:reason': {}, 'f:status': {}}, 'k:{"type":"Programmed"}': {'f:lastTransitionTime': {}, 'f:message': {}, 'f:observedGeneration': {}, 'f:reason': {}, 'f:status': {}}}, 'f:listeners': {'.': {}, 'k:{"name":"http"}': {'.': {}, 'f:attachedRoutes': {}, 'f:conditions': {'.': {}, 'k:{"type":"Accepted"}': {'.': {}, 'f:lastTransitionTime': {}, 'f:message': {}, 'f:observedGeneration': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}, 'k:{"type":"Conflicted"}': {'.': {}, 'f:lastTransitionTime': {}, 'f:message': {}, 'f:observedGeneration': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}, 'k:{"type":"Programmed"}': {'.': {}, 'f:lastTransitionTime': {}, 'f:message': {}, 'f:observedGeneration': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}, 'k:{"type":"ResolvedRefs"}': {'.': {}, 'f:lastTransitionTime': {}, 'f:message': {}, 'f:observedGeneration': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}}, 'f:name': {}, 'f:supportedKinds': {}}}}}, 'manager': 'pilot-discovery', 'operation': 'Update', 'subresource': 'status', 'time': '2026-07-09T15:35:21Z'}, {'apiVersion': 'gateway.networking.k8s.io/v1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'f:conditions': {'k:{"type":"kuadrant.io/TokenRateLimitPolicyAffected"}': {'.': {}, 'f:lastTransitionTime': {}, 'f:message': {}, 'f:observedGeneration': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}}, 'f:listeners': {'k:{"name":"http"}': {'f:conditions': {'k:{"type":"kuadrant.io/TokenRateLimitPolicyAffected"}': {'.': {}, 'f:lastTransitionTime': {}, 'f:message': {}, 'f:observedGeneration': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}}}}}}, 'manager': 'manager', 'operation': 'Update', 'subresource': 'status', 'time': '2026-07-09T15:35:22Z'}], 'name': 'e2e-aigw-4f20af59', 'namespace': 'openshift-ingress', 'resourceVersion': '22045120', 'uid': '2f7c5013-d650-404b-a286-eac276a0f4ba'}, 'spec': {'gatewayClassName': 'openshift-default', 'listeners': [{'allowedRoutes': {'namespaces': {'from': 'Same'}}, 'name': 'http', 'port': 80, 'protocol': 'HTTP'}]}, 'status': {'conditions': [{'lastTransitionTime': '2026-07-09T15:35:19Z', 'message': 'Resource accepted', 'observedGeneration': 1, 'reason': 'Accepted', 'status': 'True', 'type': 'Accepted'}, {'lastTransitionTime': '2026-07-09T15:35:19Z', 'message': 'Assigned to service(s) e2e-aigw-4f20af59-openshift-default.openshift-ingress.svc.cluster.local:80, but failed to assign to all requested addresses: address pending for hostname "e2e-aigw-4f20af59-openshift-default.openshift-ingress.svc.cluster.local"', 'observedGeneration': 1, 'reason': 'AddressNotAssigned', 'status': 'False', 'type': 'Programmed'}, {'lastTransitionTime': '2026-07-09T15:35:22Z', 'message': 'Object affected by TokenRateLimitPolicy [openshift-ingress/gateway-default-deny-e2e-aigw-4f20af59]', 'observedGeneration': 1, 'reason': 'Accepted', 'status': 'True', 'type': 'kuadrant.io/TokenRateLimitPolicyAffected'}], 'listeners': [{'attachedRoutes': 0, 'conditions': [{'lastTransitionTime': '2026-07-09T15:35:19Z', 'message': 'No errors found', 'observedGeneration': 1, 'reason': 'Accepted', 'status': 'True', 'type': 'Accepted'}, {'lastTransitionTime': '2026-07-09T15:35:19Z', 'message': 'No errors found', 'observedGeneration': 1, 'reason': 'NoConflicts', 'status': 'False', 'type': 'Conflicted'}, {'lastTransitionTime': '2026-07-09T15:35:19Z', 'message': 'No errors found', 'observedGeneration': 1, 'reason': 'Programmed', 'status': 'True', 'type': 'Programmed'}, {'lastTransitionTime': '2026-07-09T15:35:19Z', 'message': 'No errors found', 'observedGeneration': 1, 'reason': 'ResolvedRefs', 'status': 'True', 'type': 'ResolvedRefs'}, {'lastTransitionTime': '2026-07-09T15:35:22Z', 'message': 'Object affected by TokenRateLimitPolicy [openshift-ingress/gateway-default-deny-e2e-aigw-4f20af59]', 'observedGeneration': 1, 'reason': 'Accepted', 'status': 'True', 'type': 'kuadrant.io/TokenRateLimitPolicyAffected'}], 'name': 'http', 'supportedKinds': [{'group': 'gateway.networking.k8s.io', 'kind': 'HTTPRoute'}, {'group': 'gateway.networking.k8s.io', 'kind': 'GRPCRoute'}]}]}} [ocp_resources Gateway] 2026-07-09T15:35:23.184827Z [info ] Wait until Gateway e2e-aigw-4f20af59 is deleted [ocp_resources Gateway] 2026-07-09T15:35:23.185004Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] _ 12 of 13 completed, 7 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 4 Error, 0 ReRun _ tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py::TestOIDCTokenFlow::test_oidc_token_creates_api_key 2026-07-09T15:35:23.227644Z [info ] Elapsed time: 5.936622619628906e-05 [0:00:00.000059] [timeout_sampler]  ------------------------------------------- test_oidc_token_creates_api_key ------------------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-07-09T15:35:23.228101Z [info ] Executing class fixture: maas_unprivileged_model_namespace [conftest] 2026-07-09T15:35:23.228239Z [info ] kind: ProjectRequest api version: project.openshift.io/v1 [ocp_resources.resource] 2026-07-09T15:35:23.228385Z [info ] Create ProjectRequest llm  [ocp_resources ProjectRequest] 2026-07-09T15:35:23.228541Z [info ] Posting {'apiVersion': 'project.openshift.io/v1', 'kind': 'ProjectRequest', 'metadata': {'name': 'llm'}} [ocp_resources ProjectRequest] 2026-07-09T15:35:23.477962Z [info ] kind: Project api version: project.openshift.io/v1 [ocp_resources.resource] 2026-07-09T15:35:23.478159Z [info ] Wait for Project llm status to be Active [ocp_resources Project] 2026-07-09T15:35:23.478307Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_status.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:23.556439Z [info ] Status of Project llm is Active [ocp_resources Project] 2026-07-09T15:35:23.556623Z [info ] Elapsed time: 4.100799560546875e-05 [0:00:00.000041] [timeout_sampler] 2026-07-09T15:35:23.556777Z [info ] Executing class fixture: oidc_subscription [conftest] 2026-07-09T15:35:23.556922Z [info ] kind: MaaSModelRef api version: maas.opendatahub.io/v1alpha1 [ocp_resources.resource] 2026-07-09T15:35:23.557070Z [info ] Create MaaSModelRef e2e-authz-model-a8ba28d9 [ocp_resources MaaSModelRef] 2026-07-09T15:35:23.557212Z [info ] Posting {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'kind': 'MaaSModelRef', 'metadata': {'name': 'e2e-authz-model-a8ba28d9', 'namespace': 'llm'}, 'spec': {'modelRef': {'name': 'e2e-authz-model-a8ba28d9', 'namespace': 'llm', 'kind': 'LLMInferenceService'}}} [ocp_resources MaaSModelRef] 2026-07-09T15:35:23.606202Z [info ] Wait until MaaSModelRef e2e-authz-model-a8ba28d9 is created [ocp_resources MaaSModelRef] 2026-07-09T15:35:23.606365Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:23.628249Z [info ] Elapsed time: 5.173683166503906e-05 [0:00:00.000052] [timeout_sampler] 2026-07-09T15:35:23.628485Z [info ] kind: MaaSSubscription api version: maas.opendatahub.io/v1alpha1 [ocp_resources.resource] 2026-07-09T15:35:23.628622Z [info ] Create MaaSSubscription e2e-oidc-sub-f1d2cb41 [ocp_resources MaaSSubscription] 2026-07-09T15:35:23.628760Z [info ] Posting {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'kind': 'MaaSSubscription', 'metadata': {'name': 'e2e-oidc-sub-f1d2cb41', 'namespace': 'models-as-a-service'}, 'spec': {'modelRefs': [{'name': 'e2e-authz-model-a8ba28d9', 'namespace': 'llm', 'tokenRateLimits': [{'limit': 1000, 'window': '1m'}]}], 'owner': {'groups': [{'name': 'maas-users'}]}, 'priority': 0}} [ocp_resources MaaSSubscription] 2026-07-09T15:35:23.720317Z [info ] Wait until MaaSSubscription e2e-oidc-sub-f1d2cb41 is created [ocp_resources MaaSSubscription] 2026-07-09T15:35:23.720495Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:23.744648Z [info ] Elapsed time: 4.935264587402344e-05 [0:00:00.000049] [timeout_sampler] 2026-07-09T15:35:23.745508Z [info ] Executing class fixture: maas_scheme [conftest] 2026-07-09T15:35:23.904065Z [info ] kind: LLMInferenceService api version: serving.kserve.io/v1alpha2 [ocp_resources.resource] 2026-07-09T15:35:23.932026Z [info ] Executing class fixture: maas_host [conftest] 2026-07-09T15:35:23.932207Z [info ] kind: Ingress api version: config.openshift.io/v1 [ocp_resources.resource] 2026-07-09T15:35:23.977085Z [info ] Executing class fixture: base_url [conftest] 2026-07-09T15:35:23.977258Z [info ] Executing class fixture: maas_api_deployment_available [conftest] 2026-07-09T15:35:23.977397Z [info ] kind: Deployment api version: apps/v1 [ocp_resources.resource] 2026-07-09T15:35:24.005538Z [info ] Wait for Deployment/maas-api's 'Available' condition to be 'True' [ocp_resources Deployment] 2026-07-09T15:35:24.005707Z [info ] Wait until Deployment maas-api is created [ocp_resources Deployment] 2026-07-09T15:35:24.005859Z [info ] Waiting for 600 seconds [0:10:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:24.035856Z [info ] Elapsed time: 4.315376281738281e-05 [0:00:00.000043] [timeout_sampler] 2026-07-09T15:35:24.036029Z [info ] Waiting for 599.9696459770203 seconds [0:09:59.969646], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-09T15:35:24.067369Z [info ] Elapsed time: 4.1961669921875e-05 [0:00:00.000042] [timeout_sampler] 2026-07-09T15:35:24.067549Z [info ] Executing class fixture: maas_api_endpoints_ready [conftest] 2026-07-09T15:35:24.067684Z [info ] Waiting for 300 seconds [0:05:00], retry every 5 seconds. (Function: tests.model_serving.maas_billing.utils.endpoints_have_ready_addresses Kwargs: {'admin_client': , 'namespace': 'redhat-ods-applications', 'name': 'maas-api'}) [timeout_sampler] 2026-07-09T15:35:24.109584Z [info ] Elapsed time: 3.504753112792969e-05 [0:00:00.000035] [timeout_sampler] 2026-07-09T15:35:24.109772Z [info ] Executing class fixture: maas_gateway_auth_policy_ready [conftest] ERROR TEST: TestOIDCTokenFlow.test_oidc_token_creates_api_key [setup] STATUS: ERROR 2026-07-09T15:35:24.115727Z [error ] Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1171, in retry_cluster_exceptions for sample in sampler: ^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 171, in __iter__ raise TimeoutExpiredError( self._get_exception_log(exp=last_exp), last_exp=last_exp, elapsed_time=elapsed_time ) timeout_sampler.TimeoutExpiredError: Timed Out: 30 Function: ocp_resources.resource._apply_patches Kwargs: {'patches': {: {'spec': {'identityProviders': [{'name': 'maas-htpasswd-idp-ec03753c', 'mappingMethod': 'claim', 'type': 'HTPasswd', 'challenge': True, 'login': True, 'htpasswd': {'fileData': {'name': 'maas-htpasswd-secret-ec03753c'}}}]}, 'metadata': {'name': 'cluster'}}}, 'action_text': 'Updating', 'action': 'update'} Last exception: UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) . Elapsed time: 0.021053314208984375 [0:00:00.021053] The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 170, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 536, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1710, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 806, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 630, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1232, in execute result: FixtureValue = ihook.pytest_fixture_setup( ~~~~~~~~~~~~~~~~~~~~~~~~~~^ fixturedef=self, request=request ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pytest_asyncio/plugin.py", line 924, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/setuponly.py", line 36, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1328, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1005, in call_fixture_func fixture_result = fixturefunc(**kwargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 910, in maas_gateway_auth_policy_ready request.getfixturevalue(argname="maas_auth_policy_tinyllama_free") ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 630, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1204, in execute raise exc.with_traceback(exc_tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1328, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 998, in call_fixture_func fixture_result = next(generator) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 330, in maas_htpasswd_oauth_idp ResourceEditor(patches={oauth_resource: {"spec": {"identityProviders": updated_idps}}}), ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1839, in __enter__ self.update(backup_resources=True) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1833, in update self._apply_patches_sampler(patches=patches_to_apply, action_text="Updating", action=self.action) ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1949, in _apply_patches_sampler return Resource.retry_cluster_exceptions( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ func=self._apply_patches, ^^^^^^^^^^^^^^^^^^^^^^^^^ ...<5 lines>... sleep_time=TIMEOUT_5SEC, ^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1176, in retry_cluster_exceptions raise exp.last_exp from exp File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 162, in __iter__ yield self.func(*self.func_args, **self.func_kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1931, in _apply_patches resource.update(resource_dict=patch) # update the resource ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1132, in update self.api.patch( ~~~~~~~~~~~~~~^ body=resource_dict, ^^^^^^^^^^^^^^^^^^^ namespace=self.namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^ content_type="application/merge-patch+json", ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 150, in patch return self.request('patch', path, body=body, content_type=content_type, **kwargs) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 57, in inner raise api_exception(e) kubernetes.dynamic.exceptions.UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) [conftest] ------------------------------------------------------- TEARDOWN ------------------------------------------------------- 2026-07-09T15:35:24.116004Z [info ] Delete MaaSSubscription e2e-oidc-sub-f1d2cb41 [ocp_resources MaaSSubscription] 2026-07-09T15:35:24.168724Z [info ] Deleting {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'kind': 'MaaSSubscription', 'metadata': {'creationTimestamp': '2026-07-09T15:35:23Z', 'finalizers': ['maas.opendatahub.io/subscription-cleanup'], 'generation': 1, 'managedFields': [{'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'.': {}, 'f:modelRefs': {}, 'f:owner': {'.': {}, 'f:groups': {}}, 'f:priority': {}}}, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': '2026-07-09T15:35:23Z'}, {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:finalizers': {'.': {}, 'v:"maas.opendatahub.io/subscription-cleanup"': {}}}}, 'manager': 'manager', 'operation': 'Update', 'time': '2026-07-09T15:35:23Z'}, {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'.': {}, 'f:conditions': {}, 'f:modelRefStatuses': {}, 'f:phase': {}, 'f:tokenRateLimitStatuses': {}}}, 'manager': 'manager', 'operation': 'Update', 'subresource': 'status', 'time': '2026-07-09T15:35:23Z'}], 'name': 'e2e-oidc-sub-f1d2cb41', 'namespace': 'models-as-a-service', 'resourceVersion': '22045219', 'uid': 'd7449798-0f98-4a32-99f8-a6e920a83ab8'}, 'spec': {'modelRefs': [{'name': 'e2e-authz-model-a8ba28d9', 'namespace': 'llm', 'tokenRateLimits': [{'limit': 1000, 'window': '1m'}]}], 'owner': {'groups': [{'name': 'maas-users'}]}, 'priority': 0}, 'status': {'conditions': [{'lastTransitionTime': '2026-07-09T15:35:23Z', 'message': 'all 1 model references are invalid or unavailable', 'observedGeneration': 1, 'reason': 'ReconcileFailed', 'status': 'False', 'type': 'Ready'}], 'modelRefStatuses': [{'message': 'HTTPRoute not found yet; TokenRateLimitPolicy cannot be created: HTTPRoute not found yet: for LLMInferenceService e2e-authz-model-a8ba28d9 in namespace llm', 'name': 'e2e-authz-model-a8ba28d9', 'namespace': 'llm', 'ready': False, 'reason': 'NotFound'}], 'phase': 'Failed', 'tokenRateLimitStatuses': [{'message': 'HTTPRoute not found yet; TokenRateLimitPolicy cannot be created: HTTPRoute not found yet: for LLMInferenceService e2e-authz-model-a8ba28d9 in namespace llm', 'model': 'e2e-authz-model-a8ba28d9', 'name': 'maas-trlp-e2e-authz-model-a8ba28d9', 'namespace': 'llm', 'ready': False, 'reason': 'BackendNotReady'}]}} [ocp_resources MaaSSubscription] 2026-07-09T15:35:24.194652Z [info ] Wait until MaaSSubscription e2e-oidc-sub-f1d2cb41 is deleted [ocp_resources MaaSSubscription] 2026-07-09T15:35:24.194821Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:25.238865Z [info ] Elapsed time: 1.020198106765747 [0:00:01.020198] [timeout_sampler] 2026-07-09T15:35:25.239062Z [info ] Delete MaaSModelRef e2e-authz-model-a8ba28d9 [ocp_resources MaaSModelRef] 2026-07-09T15:35:25.276088Z [info ] Deleting {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'kind': 'MaaSModelRef', 'metadata': {'creationTimestamp': '2026-07-09T15:35:23Z', 'finalizers': ['maas.opendatahub.io/model-cleanup'], 'generation': 1, 'managedFields': [{'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'.': {}, 'f:modelRef': {'.': {}, 'f:kind': {}, 'f:name': {}}}}, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': '2026-07-09T15:35:23Z'}, {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:finalizers': {'.': {}, 'v:"maas.opendatahub.io/model-cleanup"': {}}}}, 'manager': 'manager', 'operation': 'Update', 'time': '2026-07-09T15:35:23Z'}, {'apiVersion': 'maas.opendatahub.io/v1alpha1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'.': {}, 'f:conditions': {}, 'f:phase': {}}}, 'manager': 'manager', 'operation': 'Update', 'subresource': 'status', 'time': '2026-07-09T15:35:23Z'}], 'name': 'e2e-authz-model-a8ba28d9', 'namespace': 'llm', 'resourceVersion': '22045207', 'uid': 'cc37d2c8-3e0a-4849-940e-1b52936ff719'}, 'spec': {'modelRef': {'kind': 'LLMInferenceService', 'name': 'e2e-authz-model-a8ba28d9'}}, 'status': {'conditions': [{'lastTransitionTime': '2026-07-09T15:35:23Z', 'message': 'Waiting for HTTPRoute to be created', 'observedGeneration': 1, 'reason': 'BackendNotReady', 'status': 'False', 'type': 'Ready'}], 'phase': 'Pending'}} [ocp_resources MaaSModelRef] 2026-07-09T15:35:25.299748Z [info ] Wait until MaaSModelRef e2e-authz-model-a8ba28d9 is deleted [ocp_resources MaaSModelRef] 2026-07-09T15:35:25.299894Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:26.341095Z [info ] Elapsed time: 1.0215435028076172 [0:00:01.021544] [timeout_sampler] 2026-07-09T15:35:26.359145Z [info ] Delete Project llm  [ocp_resources Project] 2026-07-09T15:35:26.416543Z [info ] Deleting {'kind': 'Project', 'apiVersion': 'project.openshift.io/v1', 'metadata': {'name': 'llm', 'uid': '8bbd2db7-0b66-4de3-a8cd-c07bcc5a69c4', 'resourceVersion': '22045194', 'creationTimestamp': '2026-07-09T15:35:23Z', 'labels': {'kubernetes.io/metadata.name': 'llm', 'pod-security.kubernetes.io/audit': 'restricted', 'pod-security.kubernetes.io/audit-version': 'latest', 'pod-security.kubernetes.io/warn': 'restricted', 'pod-security.kubernetes.io/warn-version': 'latest'}, 'annotations': {'openshift.io/description': '', 'openshift.io/display-name': '', 'openshift.io/requester': 'htpasswd-cluster-admin-user', 'openshift.io/sa.scc.mcs': 's0:c41,c5', 'openshift.io/sa.scc.supplemental-groups': '1001650000/10000', 'openshift.io/sa.scc.uid-range': '1001650000/10000', 'security.openshift.io/MinimallySufficientPodSecurityStandard': 'restricted'}, 'managedFields': [{'manager': 'cluster-policy-controller', 'operation': 'Apply', 'apiVersion': 'v1', 'time': '2026-07-09T15:35:23Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:openshift.io/sa.scc.mcs': {}, 'f:openshift.io/sa.scc.supplemental-groups': {}, 'f:openshift.io/sa.scc.uid-range': {}}}}}, {'manager': 'pod-security-admission-label-synchronization-controller', 'operation': 'Apply', 'apiVersion': 'v1', 'time': '2026-07-09T15:35:23Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:security.openshift.io/MinimallySufficientPodSecurityStandard': {}}, 'f:labels': {'f:pod-security.kubernetes.io/audit': {}, 'f:pod-security.kubernetes.io/audit-version': {}, 'f:pod-security.kubernetes.io/warn': {}, 'f:pod-security.kubernetes.io/warn-version': {}}}}}, {'manager': 'openshift-apiserver', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-09T15:35:23Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:openshift.io/description': {}, 'f:openshift.io/display-name': {}, 'f:openshift.io/requester': {}}, 'f:labels': {'.': {}, 'f:kubernetes.io/metadata.name': {}}}}}, {'manager': 'openshift-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-09T15:35:23Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'f:finalizers': {}}}, 'subresource': 'finalize'}]}, 'spec': {'finalizers': ['kubernetes']}, 'status': {'phase': 'Active'}} [ocp_resources Project] 2026-07-09T15:35:26.475341Z [info ] Wait until Project llm is deleted [ocp_resources Project] 2026-07-09T15:35:26.475579Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:35.749862Z [info ] Elapsed time: 9.241005420684814 [0:00:09.241005] [timeout_sampler] 2026-07-09T15:35:35.750995Z [info ] ResourceEdits: Restoring data for resource Service authorino-authorino-authorization [ocp_resources.resource] 2026-07-09T15:35:35.751142Z [info ] Update Service authorino-authorino-authorization: {'metadata': {'annotations': {}, 'name': 'authorino-authorino-authorization'}} [ocp_resources Service] 2026-07-09T15:35:35.777258Z [info ] ResourceEdits: Restoring data for resource Deployment authorino [ocp_resources.resource] 2026-07-09T15:35:35.777472Z [info ] Update Deployment authorino: {'spec': {'template': {'spec': {'containers': [{'name': 'authorino', 'image': 'registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a', 'args': ['--allow-superseding-host-subsets', '--tls-cert=/etc/ssl/certs/tls.crt', '--tls-cert-key=/etc/ssl/private/tls.key'], 'resources': {}, 'volumeMounts': [{'name': 'tls-cert', 'readOnly': True, 'mountPath': '/etc/ssl/certs/tls.crt', 'subPath': 'tls.crt'}, {'name': 'tls-cert', 'readOnly': True, 'mountPath': '/etc/ssl/private/tls.key', 'subPath': 'tls.key'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}]}}}, 'metadata': {'name': 'authorino'}} [ocp_resources Deployment] 2026-07-09T15:35:35.806386Z [info ] ResourceEdits: Restoring data for resource Authorino authorino [ocp_resources.resource] 2026-07-09T15:35:35.806780Z [info ] Update Authorino authorino: {'spec': {'listener': {'tls': {'certSecretRef': {}}}}, 'metadata': {'name': 'authorino'}} [ocp_resources Authorino] 2026-07-09T15:35:35.840203Z [info ] Wait for Deployment/authorino's 'Available' condition to be 'True' [ocp_resources Deployment] 2026-07-09T15:35:35.840578Z [info ] Wait until Deployment authorino is created [ocp_resources Deployment] 2026-07-09T15:35:35.840835Z [info ] Waiting for 120 seconds [0:02:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:35.861491Z [info ] Elapsed time: 4.839897155761719e-05 [0:00:00.000048] [timeout_sampler] 2026-07-09T15:35:35.861654Z [info ] Waiting for 119.97833800315857 seconds [0:01:59.978338], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-09T15:35:35.881268Z [info ] Elapsed time: 3.266334533691406e-05 [0:00:00.000033] [timeout_sampler] 2026-07-09T15:35:35.880162Z [info ] authorino_tls_configured: TLS configuration removed, rollout complete [conftest] name=conftest 2026-07-09T15:35:35.881668Z [info ] ResourceEdits: Restoring data for resource DataScienceCluster default-dsc [ocp_resources.resource] 2026-07-09T15:35:35.881816Z [info ] Update DataScienceCluster default-dsc: {'spec': {'components': {'kserve': {'modelsAsService': {}}}}, 'metadata': {'name': 'default-dsc'}} [ocp_resources DataScienceCluster] 2026-07-09T15:35:35.951245Z [info ] Wait for DataScienceCluster/default-dsc's 'Ready' condition to be 'True' [ocp_resources DataScienceCluster] 2026-07-09T15:35:35.951625Z [info ] Wait until DataScienceCluster default-dsc is created [ocp_resources DataScienceCluster] 2026-07-09T15:35:35.951849Z [info ] Waiting for 600 seconds [0:10:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-09T15:35:35.978168Z [info ] Elapsed time: 4.38690185546875e-05 [0:00:00.000044] [timeout_sampler] 2026-07-09T15:35:35.978334Z [info ] Waiting for 599.9727172851562 seconds [0:09:59.972717], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-09T15:35:36.001688Z [info ] Elapsed time: 3.218650817871094e-05 [0:00:00.000032] [timeout_sampler] 2026-07-09T15:35:36.001941Z [info ] ResourceEdits: Restoring data for resource Gateway maas-default-gateway [ocp_resources.resource] 2026-07-09T15:35:36.002056Z [info ] Update Gateway maas-default-gateway: {'metadata': {'annotations': {}, 'name': 'maas-default-gateway'}} [ocp_resources Gateway] _____ ERROR at setup of TestOIDCTokenFlow.test_oidc_token_creates_api_key ______ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1171, in retry_cluster_exceptions for sample in sampler: ^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 171, in __iter__ raise TimeoutExpiredError( self._get_exception_log(exp=last_exp), last_exp=last_exp, elapsed_time=elapsed_time ) timeout_sampler.TimeoutExpiredError: Timed Out: 30 Function: ocp_resources.resource._apply_patches Kwargs: {'patches': {: {'spec': {'identityProviders': [{'name': 'maas-htpasswd-idp-ec03753c', 'mappingMethod': 'claim', 'type': 'HTPasswd', 'challenge': True, 'login': True, 'htpasswd': {'fileData': {'name': 'maas-htpasswd-secret-ec03753c'}}}]}, 'metadata': {'name': 'cluster'}}}, 'action_text': 'Updating', 'action': 'update'} Last exception: UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) . Elapsed time: 0.021053314208984375 [0:00:00.021053] The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 170, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 536, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1710, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 806, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 630, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1232, in execute result: FixtureValue = ihook.pytest_fixture_setup( ~~~~~~~~~~~~~~~~~~~~~~~~~~^ fixturedef=self, request=request ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pytest_asyncio/plugin.py", line 924, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/setuponly.py", line 36, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1328, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1005, in call_fixture_func fixture_result = fixturefunc(**kwargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 910, in maas_gateway_auth_policy_ready request.getfixturevalue(argname="maas_auth_policy_tinyllama_free") ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 630, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1204, in execute raise exc.with_traceback(exc_tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1328, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 998, in call_fixture_func fixture_result = next(generator) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 330, in maas_htpasswd_oauth_idp ResourceEditor(patches={oauth_resource: {"spec": {"identityProviders": updated_idps}}}), ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1839, in __enter__ self.update(backup_resources=True) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1833, in update self._apply_patches_sampler(patches=patches_to_apply, action_text="Updating", action=self.action) ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1949, in _apply_patches_sampler return Resource.retry_cluster_exceptions( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ func=self._apply_patches, ^^^^^^^^^^^^^^^^^^^^^^^^^ ...<5 lines>... sleep_time=TIMEOUT_5SEC, ^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1176, in retry_cluster_exceptions raise exp.last_exp from exp File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 162, in __iter__ yield self.func(*self.func_args, **self.func_kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1931, in _apply_patches resource.update(resource_dict=patch) # update the resource ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1132, in update self.api.patch( ~~~~~~~~~~~~~~^ body=resource_dict, ^^^^^^^^^^^^^^^^^^^ namespace=self.namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^ content_type="application/merge-patch+json", ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 150, in patch return self.request('patch', path, body=body, content_type=content_type, **kwargs) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 57, in inner raise api_exception(e) kubernetes.dynamic.exceptions.UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) _ 13 of 13 completed, 7 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 5 Error, 0 ReRun _ ===== 1 failed, 7 passed, 162 deselected, 168 warnings, 5 errors in 30.39s ===== ==================================== ERRORS ==================================== _ ERROR at setup of TestBBRPreAuthInference.test_inference_model_in_body_only_returns_200[ocp_token_for_actor0] _ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1171, in retry_cluster_exceptions for sample in sampler: ^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 171, in __iter__ raise TimeoutExpiredError( self._get_exception_log(exp=last_exp), last_exp=last_exp, elapsed_time=elapsed_time ) timeout_sampler.TimeoutExpiredError: Timed Out: 30 Function: ocp_resources.resource._apply_patches Kwargs: {'patches': {: {'spec': {'identityProviders': [{'name': 'maas-htpasswd-idp-ec03753c', 'mappingMethod': 'claim', 'type': 'HTPasswd', 'challenge': True, 'login': True, 'htpasswd': {'fileData': {'name': 'maas-htpasswd-secret-ec03753c'}}}]}, 'metadata': {'name': 'cluster'}}}, 'action_text': 'Updating', 'action': 'update'} Last exception: UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) . Elapsed time: 0.021053314208984375 [0:00:00.021053] The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 170, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 536, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1710, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 806, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 630, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1232, in execute result: FixtureValue = ihook.pytest_fixture_setup( ~~~~~~~~~~~~~~~~~~~~~~~~~~^ fixturedef=self, request=request ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pytest_asyncio/plugin.py", line 924, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/setuponly.py", line 36, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1328, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 998, in call_fixture_func fixture_result = next(generator) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 330, in maas_htpasswd_oauth_idp ResourceEditor(patches={oauth_resource: {"spec": {"identityProviders": updated_idps}}}), ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1839, in __enter__ self.update(backup_resources=True) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1833, in update self._apply_patches_sampler(patches=patches_to_apply, action_text="Updating", action=self.action) ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1949, in _apply_patches_sampler return Resource.retry_cluster_exceptions( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ func=self._apply_patches, ^^^^^^^^^^^^^^^^^^^^^^^^^ ...<5 lines>... sleep_time=TIMEOUT_5SEC, ^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1176, in retry_cluster_exceptions raise exp.last_exp from exp File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 162, in __iter__ yield self.func(*self.func_args, **self.func_kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1931, in _apply_patches resource.update(resource_dict=patch) # update the resource ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1132, in update self.api.patch( ~~~~~~~~~~~~~~^ body=resource_dict, ^^^^^^^^^^^^^^^^^^^ namespace=self.namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^ content_type="application/merge-patch+json", ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 150, in patch return self.request('patch', path, body=body, content_type=content_type, **kwargs) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 57, in inner raise api_exception(e) kubernetes.dynamic.exceptions.UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) _ ERROR at setup of TestBBRPreAuthInference.test_list_models_returns_200_with_api_key[ocp_token_for_actor0] _ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1171, in retry_cluster_exceptions for sample in sampler: ^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 171, in __iter__ raise TimeoutExpiredError( self._get_exception_log(exp=last_exp), last_exp=last_exp, elapsed_time=elapsed_time ) timeout_sampler.TimeoutExpiredError: Timed Out: 30 Function: ocp_resources.resource._apply_patches Kwargs: {'patches': {: {'spec': {'identityProviders': [{'name': 'maas-htpasswd-idp-ec03753c', 'mappingMethod': 'claim', 'type': 'HTPasswd', 'challenge': True, 'login': True, 'htpasswd': {'fileData': {'name': 'maas-htpasswd-secret-ec03753c'}}}]}, 'metadata': {'name': 'cluster'}}}, 'action_text': 'Updating', 'action': 'update'} Last exception: UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) . Elapsed time: 0.021053314208984375 [0:00:00.021053] The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 170, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 536, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1710, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 806, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 630, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1204, in execute raise exc.with_traceback(exc_tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1328, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 998, in call_fixture_func fixture_result = next(generator) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 330, in maas_htpasswd_oauth_idp ResourceEditor(patches={oauth_resource: {"spec": {"identityProviders": updated_idps}}}), ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1839, in __enter__ self.update(backup_resources=True) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1833, in update self._apply_patches_sampler(patches=patches_to_apply, action_text="Updating", action=self.action) ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1949, in _apply_patches_sampler return Resource.retry_cluster_exceptions( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ func=self._apply_patches, ^^^^^^^^^^^^^^^^^^^^^^^^^ ...<5 lines>... sleep_time=TIMEOUT_5SEC, ^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1176, in retry_cluster_exceptions raise exp.last_exp from exp File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 162, in __iter__ yield self.func(*self.func_args, **self.func_kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1931, in _apply_patches resource.update(resource_dict=patch) # update the resource ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1132, in update self.api.patch( ~~~~~~~~~~~~~~^ body=resource_dict, ^^^^^^^^^^^^^^^^^^^ namespace=self.namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^ content_type="application/merge-patch+json", ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 150, in patch return self.request('patch', path, body=body, content_type=content_type, **kwargs) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 57, in inner raise api_exception(e) kubernetes.dynamic.exceptions.UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) _ ERROR at setup of TestBBRPreAuthInference.test_maas_api_endpoint_not_broken_by_bbr[ocp_token_for_actor0] _ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1171, in retry_cluster_exceptions for sample in sampler: ^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 171, in __iter__ raise TimeoutExpiredError( self._get_exception_log(exp=last_exp), last_exp=last_exp, elapsed_time=elapsed_time ) timeout_sampler.TimeoutExpiredError: Timed Out: 30 Function: ocp_resources.resource._apply_patches Kwargs: {'patches': {: {'spec': {'identityProviders': [{'name': 'maas-htpasswd-idp-ec03753c', 'mappingMethod': 'claim', 'type': 'HTPasswd', 'challenge': True, 'login': True, 'htpasswd': {'fileData': {'name': 'maas-htpasswd-secret-ec03753c'}}}]}, 'metadata': {'name': 'cluster'}}}, 'action_text': 'Updating', 'action': 'update'} Last exception: UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) . Elapsed time: 0.021053314208984375 [0:00:00.021053] The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 170, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 536, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1710, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 806, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 630, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1204, in execute raise exc.with_traceback(exc_tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1328, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 998, in call_fixture_func fixture_result = next(generator) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 330, in maas_htpasswd_oauth_idp ResourceEditor(patches={oauth_resource: {"spec": {"identityProviders": updated_idps}}}), ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1839, in __enter__ self.update(backup_resources=True) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1833, in update self._apply_patches_sampler(patches=patches_to_apply, action_text="Updating", action=self.action) ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1949, in _apply_patches_sampler return Resource.retry_cluster_exceptions( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ func=self._apply_patches, ^^^^^^^^^^^^^^^^^^^^^^^^^ ...<5 lines>... sleep_time=TIMEOUT_5SEC, ^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1176, in retry_cluster_exceptions raise exp.last_exp from exp File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 162, in __iter__ yield self.func(*self.func_args, **self.func_kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1931, in _apply_patches resource.update(resource_dict=patch) # update the resource ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1132, in update self.api.patch( ~~~~~~~~~~~~~~^ body=resource_dict, ^^^^^^^^^^^^^^^^^^^ namespace=self.namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^ content_type="application/merge-patch+json", ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 150, in patch return self.request('patch', path, body=body, content_type=content_type, **kwargs) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 57, in inner raise api_exception(e) kubernetes.dynamic.exceptions.UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) _ ERROR at setup of TestAuthPolicyApiKeyValidation.test_auth_policy_callback_url_uses_correct_namespace _ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1171, in retry_cluster_exceptions for sample in sampler: ^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 171, in __iter__ raise TimeoutExpiredError( self._get_exception_log(exp=last_exp), last_exp=last_exp, elapsed_time=elapsed_time ) timeout_sampler.TimeoutExpiredError: Timed Out: 30 Function: ocp_resources.resource._apply_patches Kwargs: {'patches': {: {'spec': {'identityProviders': [{'name': 'maas-htpasswd-idp-ec03753c', 'mappingMethod': 'claim', 'type': 'HTPasswd', 'challenge': True, 'login': True, 'htpasswd': {'fileData': {'name': 'maas-htpasswd-secret-ec03753c'}}}]}, 'metadata': {'name': 'cluster'}}}, 'action_text': 'Updating', 'action': 'update'} Last exception: UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) . Elapsed time: 0.021053314208984375 [0:00:00.021053] The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 170, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 536, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1710, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 806, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 630, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1204, in execute raise exc.with_traceback(exc_tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1328, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 998, in call_fixture_func fixture_result = next(generator) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 330, in maas_htpasswd_oauth_idp ResourceEditor(patches={oauth_resource: {"spec": {"identityProviders": updated_idps}}}), ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1839, in __enter__ self.update(backup_resources=True) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1833, in update self._apply_patches_sampler(patches=patches_to_apply, action_text="Updating", action=self.action) ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1949, in _apply_patches_sampler return Resource.retry_cluster_exceptions( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ func=self._apply_patches, ^^^^^^^^^^^^^^^^^^^^^^^^^ ...<5 lines>... sleep_time=TIMEOUT_5SEC, ^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1176, in retry_cluster_exceptions raise exp.last_exp from exp File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 162, in __iter__ yield self.func(*self.func_args, **self.func_kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1931, in _apply_patches resource.update(resource_dict=patch) # update the resource ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1132, in update self.api.patch( ~~~~~~~~~~~~~~^ body=resource_dict, ^^^^^^^^^^^^^^^^^^^ namespace=self.namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^ content_type="application/merge-patch+json", ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 150, in patch return self.request('patch', path, body=body, content_type=content_type, **kwargs) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 57, in inner raise api_exception(e) kubernetes.dynamic.exceptions.UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) _____ ERROR at setup of TestOIDCTokenFlow.test_oidc_token_creates_api_key ______ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1171, in retry_cluster_exceptions for sample in sampler: ^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 171, in __iter__ raise TimeoutExpiredError( self._get_exception_log(exp=last_exp), last_exp=last_exp, elapsed_time=elapsed_time ) timeout_sampler.TimeoutExpiredError: Timed Out: 30 Function: ocp_resources.resource._apply_patches Kwargs: {'patches': {: {'spec': {'identityProviders': [{'name': 'maas-htpasswd-idp-ec03753c', 'mappingMethod': 'claim', 'type': 'HTPasswd', 'challenge': True, 'login': True, 'htpasswd': {'fileData': {'name': 'maas-htpasswd-secret-ec03753c'}}}]}, 'metadata': {'name': 'cluster'}}}, 'action_text': 'Updating', 'action': 'update'} Last exception: UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) . Elapsed time: 0.021053314208984375 [0:00:00.021053] The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 895, in pytest_runtest_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 170, in pytest_runtest_setup item.session._setupstate.setup(item) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 536, in setup col.setup() ~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1710, in setup self._request._fillfixtures() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 806, in _fillfixtures item.funcargs[argname] = self.getfixturevalue(argname) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 630, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1232, in execute result: FixtureValue = ihook.pytest_fixture_setup( ~~~~~~~~~~~~~~~~~~~~~~~~~~^ fixturedef=self, request=request ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pytest_asyncio/plugin.py", line 924, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/setuponly.py", line 36, in pytest_fixture_setup return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1328, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1005, in call_fixture_func fixture_result = fixturefunc(**kwargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 910, in maas_gateway_auth_policy_ready request.getfixturevalue(argname="maas_auth_policy_tinyllama_free") ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 630, in getfixturevalue fixturedef = self._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1181, in execute fixturedef = request._get_active_fixturedef(argname) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 726, in _get_active_fixturedef fixturedef.execute(request=subrequest) ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1204, in execute raise exc.with_traceback(exc_tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1328, in pytest_fixture_setup result = call_fixture_func(fixturefunc, request, kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 998, in call_fixture_func fixture_result = next(generator) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/conftest.py", line 330, in maas_htpasswd_oauth_idp ResourceEditor(patches={oauth_resource: {"spec": {"identityProviders": updated_idps}}}), ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1839, in __enter__ self.update(backup_resources=True) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1833, in update self._apply_patches_sampler(patches=patches_to_apply, action_text="Updating", action=self.action) ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1949, in _apply_patches_sampler return Resource.retry_cluster_exceptions( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ func=self._apply_patches, ^^^^^^^^^^^^^^^^^^^^^^^^^ ...<5 lines>... sleep_time=TIMEOUT_5SEC, ^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1176, in retry_cluster_exceptions raise exp.last_exp from exp File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 162, in __iter__ yield self.func(*self.func_args, **self.func_kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1931, in _apply_patches resource.update(resource_dict=patch) # update the resource ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1132, in update self.api.patch( ~~~~~~~~~~~~~~^ body=resource_dict, ^^^^^^^^^^^^^^^^^^^ namespace=self.namespace, ^^^^^^^^^^^^^^^^^^^^^^^^^ content_type="application/merge-patch+json", ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 150, in patch return self.request('patch', path, body=body, content_type=content_type, **kwargs) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 57, in inner raise api_exception(e) kubernetes.dynamic.exceptions.UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) =================================== FAILURES =================================== __ TestAITenantTenantSetup.test_aitenant_bootstrap_creates_tenant_environment __ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 184, in pytest_runtest_call item.runtest() ~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1707, in runtest self.ihook.pytest_pyfunc_call(pyfuncitem=self) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 167, in pytest_pyfunc_call result = testfunction(**testargs) File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aitenant/test_tenant_setup.py", line 41, in test_aitenant_bootstrap_creates_tenant_environment verify_aitenant_bootstrap_children( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ admin_client=admin_client, ^^^^^^^^^^^^^^^^^^^^^^^^^^ test_context=aitenant_for_test, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/tests/model_serving/maas_billing/multitenancy/aitenant/utils.py", line 323, in verify_aitenant_bootstrap_children assert tenant_gateway_ref.name == MAAS_GATEWAY_NAME, ( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: Tenant gatewayRef.name expected 'maas-default-gateway', got 'e2e-aigw-a124ef78' =============================== warnings summary =============================== tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_envoy_filter.py: 8 warnings tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_pre_auth_inference.py: 24 warnings tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_setup.py: 7 warnings tests/model_serving/maas_billing/multitenancy/aitenant/test_tenant_setup.py: 76 warnings tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py: 53 warnings /workspace/tests-shared/tests-payload/.tools/python/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: /workspace/tests-shared/tests-payload/results/maas_billing-smoke.xml - =========================== short test summary info ============================ FAILED tests/model_serving/maas_billing/multitenancy/aitenant/test_tenant_setup.py::TestAITenantTenantSetup::test_aitenant_bootstrap_creates_tenant_environment - AssertionError: Tenant gatewayRef.name expected 'maas-default-gateway', got 'e2e-aigw-a124ef78' ERROR tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_pre_auth_inference.py::TestBBRPreAuthInference::test_inference_model_in_body_only_returns_200[ocp_token_for_actor0] - kubernetes.dynamic.exceptions.UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) ERROR tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_pre_auth_inference.py::TestBBRPreAuthInference::test_list_models_returns_200_with_api_key[ocp_token_for_actor0] - kubernetes.dynamic.exceptions.UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) ERROR tests/model_serving/maas_billing/body_base_routing/pre_auth_model_header/test_bbr_pre_auth_inference.py::TestBBRPreAuthInference::test_maas_api_endpoint_not_broken_by_bbr[ocp_token_for_actor0] - kubernetes.dynamic.exceptions.UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) ERROR tests/model_serving/maas_billing/maas_api_key/test_api_key_auth_policy_validation.py::TestAuthPolicyApiKeyValidation::test_auth_policy_callback_url_uses_correct_namespace - kubernetes.dynamic.exceptions.UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) ERROR tests/model_serving/maas_billing/oidc_tests/test_oidc_token_flow.py::TestOIDCTokenFlow::test_oidc_token_creates_api_key - kubernetes.dynamic.exceptions.UnprocessibleEntityError: 422 Reason: Unprocessable Entity HTTP response headers: HTTPHeaderDict({'Audit-Id': '89893d42-b2d0-48a2-a2b0-eda03cffde2c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Warning': '299 - "unknown field \\"spec.identityProviders[0].challenge\\"", 299 - "unknown field \\"spec.identityProviders[0].login\\""', 'X-Kubernetes-Pf-Flowschema-Uid': '6f47a801-4a3b-4297-aba4-eb229e919e4e', 'X-Kubernetes-Pf-Prioritylevel-Uid': '795af040-ca8e-4676-9e51-6ac99a8caaed', 'Date': 'Thu, 09 Jul 2026 15:35:13 GMT', 'Content-Length': '698'}) HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"oauths.config.openshift.io \\"cluster\\" is forbidden: ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object.","reason":"Invalid","details":{"name":"cluster","group":"config.openshift.io","kind":"oauths","causes":[{"message":"ValidatingAdmissionPolicy \'config\' with binding \'config-binding\' denied request: This resource cannot be created, updated, or deleted. Please ask your administrator to modify the resource in the HostedCluster object."}]},"code":422}\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 407, in request return self.rest_client.PATCH(url, ~~~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 299, in PATCH return self.request("PATCH", url, ~~~~~~~~~~~~^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ ...<3 lines>... _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ body=body) ^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) ===== 1 failed, 7 passed, 162 deselected, 168 warnings, 5 errors in 30.39s =====