
--- BVT pytest attempt 2026-07-02T06:13:08.768795+00:00 (/.local/bin/uv --directory /home/odh/opendatahub-tests...) ---
2026-07-02 06:13:11 [info     ] Running model registry tests against default namespace name=tests.ai_hub.conftest
2026-07-02T06:13:11.242985+00:00 ocp_resources.resource [32mINFO[0m Trying to get client via new_client_from_config[0m
2026-07-02T06:13:11.367908+00:00 ocp_resources.resource [32mINFO[0m kind: DataScienceCluster api version: datasciencecluster.opendatahub.io/v2[0m
[2m2026-07-02T06:13:11.408909Z[0m [[32m[1minfo     [0m] [1mWriting tests log to /home/odh/opendatahub-tests/results/pytest-tests.log[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:13:11.409131Z[0m [[32m[1minfo     [0m] [1mTrying to get client via new_client_from_config[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-07-02T06:13:11.412309Z[0m [[32m[1minfo     [0m] [1mkind: DataScienceCluster api version: datasciencecluster.opendatahub.io/v2[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-07-02T06:13:11.543263Z[0m [[32m[1minfo     [0m] [1mkind: DSCInitialization api version: dscinitialization.opendatahub.io/v2[0m [[0m[1m[34mocp_resources.resource[0m][0m
============================= test session starts ==============================
platform linux -- Python 3.14.5, pytest-9.0.3, pluggy-1.6.0 -- /home/odh/opendatahub-tests/.venv/bin/python3
cachedir: .pytest_cache
metadata: {'Python': '3.14.5', 'Platform': 'Linux-5.14.0-570.120.1.el9_6.x86_64-x86_64-with-glibc2.42', 'Packages': {'pytest': '9.0.3', 'pluggy': '1.6.0'}, 'Plugins': {'anyio': '4.13.0', 'langsmith': '0.8.5', 'asyncio': '1.3.0', 'dependency': '0.6.1', 'html': '4.2.0', 'metadata': '3.1.1', 'order': '1.4.0', 'progress': '1.4.0', 'testconfig': '0.2.0', 'xdist': '3.8.0', 'syrupy': '5.2.0'}}
rootdir: /home/odh/opendatahub-tests
configfile: pytest.ini
plugins: anyio-4.13.0, langsmith-0.8.5, asyncio-1.3.0, dependency-0.6.1, html-4.2.0, metadata-3.1.1, order-1.4.0, progress-1.4.0, testconfig-0.2.0, xdist-3.8.0, syrupy-5.2.0
asyncio: mode=Mode.STRICT, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function
collecting ... [2m2026-07-02T06:13:12.187745Z[0m [[33m[1mwarning  [0m] [1mGot ConnectionError [HTTPConnectionPool(host='localhost', port=2990): Max retries exceeded with url: /jira/rest/api/2/serverInfo (Caused by NewConnectionError("HTTPConnection(host='localhost', port=2990): Failed to establish a new connection: [Errno 111] Connection refused"))] errno:None on GET http://localhost:2990/jira/rest/api/2/serverInfo
[0m [[0m[1m[34mjira.resilientsession[0m][0m
[2m2026-07-02T06:13:12.187944Z[0m [[33m[1mwarning  [0m] [1mGot ConnectionError [HTTPConnectionPool(host='localhost', port=2990): Max retries exceeded with url: /jira/rest/api/2/serverInfo (Caused by NewConnectionError("HTTPConnection(host='localhost', port=2990): Failed to establish a new connection: [Errno 111] Connection refused"))] errno:None on GET http://localhost:2990/jira/rest/api/2/serverInfo
[0m [[0m[1m[34mjira.resilientsession[0m][0m
[2m2026-07-02T06:13:12.188089Z[0m [[33m[1mwarning  [0m] [1mGot recoverable error from GET http://localhost:2990/jira/rest/api/2/serverInfo, will retry [1/3] in 16.858737464315162s. Err: HTTPConnectionPool(host='localhost', port=2990): Max retries exceeded with url: /jira/rest/api/2/serverInfo (Caused by NewConnectionError("HTTPConnection(host='localhost', port=2990): Failed to establish a new connection: [Errno 111] Connection refused"))[0m [[0m[1m[34mjira.resilientsession[0m][0m
[2m2026-07-02T06:13:12.188221Z[0m [[33m[1mwarning  [0m] [1mGot recoverable error from GET http://localhost:2990/jira/rest/api/2/serverInfo, will retry [1/3] in 16.858737464315162s. Err: HTTPConnectionPool(host='localhost', port=2990): Max retries exceeded with url: /jira/rest/api/2/serverInfo (Caused by NewConnectionError("HTTPConnection(host='localhost', port=2990): Failed to establish a new connection: [Errno 111] Connection refused"))[0m [[0m[1m[34mjira.resilientsession[0m][0m
[2m2026-07-02T06:13:29.049292Z[0m [[33m[1mwarning  [0m] [1mGot ConnectionError [HTTPConnectionPool(host='localhost', port=2990): Max retries exceeded with url: /jira/rest/api/2/serverInfo (Caused by NewConnectionError("HTTPConnection(host='localhost', port=2990): Failed to establish a new connection: [Errno 111] Connection refused"))] errno:None on GET http://localhost:2990/jira/rest/api/2/serverInfo
[0m [[0m[1m[34mjira.resilientsession[0m][0m
[2m2026-07-02T06:13:29.049540Z[0m [[33m[1mwarning  [0m] [1mGot ConnectionError [HTTPConnectionPool(host='localhost', port=2990): Max retries exceeded with url: /jira/rest/api/2/serverInfo (Caused by NewConnectionError("HTTPConnection(host='localhost', port=2990): Failed to establish a new connection: [Errno 111] Connection refused"))] errno:None on GET http://localhost:2990/jira/rest/api/2/serverInfo
[0m [[0m[1m[34mjira.resilientsession[0m][0m
[2m2026-07-02T06:13:29.049667Z[0m [[33m[1mwarning  [0m] [1mGot recoverable error from GET http://localhost:2990/jira/rest/api/2/serverInfo, will retry [2/3] in 23.258953303440293s. Err: HTTPConnectionPool(host='localhost', port=2990): Max retries exceeded with url: /jira/rest/api/2/serverInfo (Caused by NewConnectionError("HTTPConnection(host='localhost', port=2990): Failed to establish a new connection: [Errno 111] Connection refused"))[0m [[0m[1m[34mjira.resilientsession[0m][0m
[2m2026-07-02T06:13:29.049800Z[0m [[33m[1mwarning  [0m] [1mGot recoverable error from GET http://localhost:2990/jira/rest/api/2/serverInfo, will retry [2/3] in 23.258953303440293s. Err: HTTPConnectionPool(host='localhost', port=2990): Max retries exceeded with url: /jira/rest/api/2/serverInfo (Caused by NewConnectionError("HTTPConnection(host='localhost', port=2990): Failed to establish a new connection: [Errno 111] Connection refused"))[0m [[0m[1m[34mjira.resilientsession[0m][0m
[2m2026-07-02T06:13:52.309214Z[0m [[33m[1mwarning  [0m] [1mGot ConnectionError [HTTPConnectionPool(host='localhost', port=2990): Max retries exceeded with url: /jira/rest/api/2/serverInfo (Caused by NewConnectionError("HTTPConnection(host='localhost', port=2990): Failed to establish a new connection: [Errno 111] Connection refused"))] errno:None on GET http://localhost:2990/jira/rest/api/2/serverInfo
[0m [[0m[1m[34mjira.resilientsession[0m][0m
[2m2026-07-02T06:13:52.309525Z[0m [[33m[1mwarning  [0m] [1mGot ConnectionError [HTTPConnectionPool(host='localhost', port=2990): Max retries exceeded with url: /jira/rest/api/2/serverInfo (Caused by NewConnectionError("HTTPConnection(host='localhost', port=2990): Failed to establish a new connection: [Errno 111] Connection refused"))] errno:None on GET http://localhost:2990/jira/rest/api/2/serverInfo
[0m [[0m[1m[34mjira.resilientsession[0m][0m
[2m2026-07-02T06:13:52.309770Z[0m [[33m[1mwarning  [0m] [1mGot recoverable error from GET http://localhost:2990/jira/rest/api/2/serverInfo, will retry [3/3] in 53.18912631581222s. Err: HTTPConnectionPool(host='localhost', port=2990): Max retries exceeded with url: /jira/rest/api/2/serverInfo (Caused by NewConnectionError("HTTPConnection(host='localhost', port=2990): Failed to establish a new connection: [Errno 111] Connection refused"))[0m [[0m[1m[34mjira.resilientsession[0m][0m
[2m2026-07-02T06:13:52.309960Z[0m [[33m[1mwarning  [0m] [1mGot recoverable error from GET http://localhost:2990/jira/rest/api/2/serverInfo, will retry [3/3] in 53.18912631581222s. Err: HTTPConnectionPool(host='localhost', port=2990): Max retries exceeded with url: /jira/rest/api/2/serverInfo (Caused by NewConnectionError("HTTPConnection(host='localhost', port=2990): Failed to establish a new connection: [Errno 111] Connection refused"))[0m [[0m[1m[34mjira.resilientsession[0m][0m
[2m2026-07-02T06:14:45.499621Z[0m [[33m[1mwarning  [0m] [1mFailed to get Jira issue RHOAIENG-62675, assuming it is open[0m [[0m[1m[34mutilities.jira[0m][0m [36mname[0m=[35mutilities.jira[0m
collected 473 items / 441 deselected / 32 selected

tests/ai_hub/image_validation/test_verify_rhoai_images.py::TestModelRegistryImages::test_verify_model_registry_pod_images[model_registry_metadata_db_resources0-model_registry_instance0-model_registry_instance_pods_by_label0] [1m
 test_verify_model_registry_pod_images[model_registry_metadata_db_resources0-model_registry_instance0-model_registry_instance_pods_by_label0] [0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:14:45.973696Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: event_loop_policy[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:45.973910Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: _syrupy_apply_ide_patches[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:45.974110Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: admin_client[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:45.974273Z[0m [[32m[1minfo     [0m] [1mTrying to get client via new_client_from_config[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-07-02T06:14:45.975420Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: dsc_resource[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:45.975560Z[0m [[32m[1minfo     [0m] [1mkind: DataScienceCluster api version: datasciencecluster.opendatahub.io/v2[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-07-02T06:14:46.085064Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: tmp_path_factory[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:46.085490Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: tests_tmp_dir[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:46.086625Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: os_path_environment[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:46.087786Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: tmpdir_factory[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:46.088220Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: bin_directory[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:46.088480Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: oc_binary_path[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:46.126176Z[0m [[32m[1minfo     [0m] [1mkind: ConsoleCLIDownload api version: console.openshift.io/v1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-07-02T06:14:46.161202Z[0m [[32m[1minfo     [0m] [1mAll oc console cli download links: ['https://downloads-openshift-console.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com/amd64/linux/oc.tar'][0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-07-02T06:14:46.161324Z[0m [[32m[1minfo     [0m] [1mDownloading archive using: url=https://downloads-openshift-console.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com/amd64/linux/oc.tar[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-07-02T06:14:46.950253Z[0m [[32m[1minfo     [0m] [1mExtract the downloaded archive.[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-07-02T06:14:47.034490Z[0m [[32m[1minfo     [0m] [1mDownloaded file: ['oc']       [0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-07-02T06:14:47.053250Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: bin_directory_to_os_path[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:47.052020Z[0m [[32m[1minfo     [0m] [1mOC binary path: /tmp/pytest-5KNm3zeTZzTGdBigLBx6Vp/bin0/oc[0m [[0m[1m[34mtests.conftest[0m][0m [36mname[0m=[35mtests.conftest[0m
[2m2026-07-02T06:14:47.052072Z[0m [[32m[1minfo     [0m] [1mAdding /tmp/pytest-5KNm3zeTZzTGdBigLBx6Vp/bin0 to $PATH[0m [[0m[1m[34mtests.conftest[0m][0m [36mname[0m=[35mtests.conftest[0m
[2m2026-07-02T06:14:47.053851Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: nodes[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:48.354556Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: dsci_resource[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:48.354724Z[0m [[32m[1minfo     [0m] [1mkind: DSCInitialization api version: dscinitialization.opendatahub.io/v2[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-07-02T06:14:48.373170Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: record_testsuite_property[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:48.373472Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: junitxml_plugin[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:48.373642Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: cluster_sanity_scope_session[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:48.372313Z[0m [[32m[1minfo     [0m] [1mCheck cluster sanity.         [0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-07-02T06:14:48.373915Z[0m [[32m[1minfo     [0m] [1mVerify all nodes are in a healthy condition.[0m [[0m[1m[34mocp_utilities.infra[0m][0m
[2m2026-07-02T06:14:48.427180Z[0m [[32m[1minfo     [0m] [1mVerify all nodes are schedulable.[0m [[0m[1m[34mocp_utilities.infra[0m][0m
[2m2026-07-02T06:14:48.481154Z[0m [[33m[1mwarning  [0m] [1mSkipping RHOAI resource checks, got --cluster-sanity-skip-rhoai-check[0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-07-02T06:14:48.482282Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: autouse_fixtures[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:48.482442Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: pytestconfig[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:48.482581Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: updated_dsc_component_state_scope_session[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:48.482837Z[0m [[32m[1minfo     [0m] [1mkind: DataScienceCluster api version: datasciencecluster.opendatahub.io/v2[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-07-02T06:14:48.521443Z[0m [[32m[1minfo     [0m] [1mModel Registry is enabled by default and does not require any setup.[0m [[0m[1m[34mtests.ai_hub.conftest[0m][0m [36mname[0m=[35mtests.ai_hub.conftest[0m
[2m2026-07-02T06:14:48.522575Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: model_registry_namespace[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:48.541734Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: related_images_refs[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:48.602811Z[0m [[32m[1minfo     [0m] [1mkind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-07-02T06:14:48.703614Z[0m [[32m[1minfo     [0m] [1mLooking for rhods-operator.3.5.0-ea.1 CSV in namespace redhat-ods-applications[0m [[0m[1m[34mutilities.operator_utils[0m][0m [36mname[0m=[35mutilities.operator_utils[0m
[2m2026-07-02T06:14:48.740086Z[0m [[32m[1minfo     [0m] [1mFound cluster service version: rhods-operator.3.5.0-ea.1[0m [[0m[1m[34mutilities.operator_utils[0m][0m [36mname[0m=[35mutilities.operator_utils[0m
[2m2026-07-02T06:14:48.775406Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: teardown_resources[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:48.775948Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: model_registry_metadata_db_resources[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:14:48.776274Z[0m [[32m[1minfo     [0m] [1mkind: Deployment api version: apps/v1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-07-02T06:14:48.771748Z[0m [[32m[1minfo     [0m] [1mCreating 1 <class 'ocp_resources.secret.Secret'> resources[0m [[0m[1m[34mtests.ai_hub.conftest[0m][0m [36mname[0m=[35mtests.ai_hub.conftest[0m
[2m2026-07-02T06:14:48.776712Z[0m [[32m[1minfo     [0m] [1mCreate Secret db-model-registry0[0m [[0m[1m[34mocp_resources Secret[0m][0m
[2m2026-07-02T06:14:48.776903Z[0m [[32m[1minfo     [0m] [1mPosting {'apiVersion': 'v1', 'kind': 'Secret', 'metadata': {'name': 'db-model-registry0', 'labels': {'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'template.openshift.io/expose-database_name': "'{.data[''database-name'']}'", 'template.openshift.io/expose-password': "'{.data[''database-password'']}'", 'template.openshift.io/expose-username': "'{.data[''database-user'']}'"}, 'namespace': 'rhoai-model-registries'}, 'stringData': '*******'}[0m [[0m[1m[34mocp_resources Secret[0m][0m
[2m2026-07-02T06:14:48.817427Z[0m [[32m[1minfo     [0m] [1mCreating 1 <class 'ocp_resources.persistent_volume_claim.PersistentVolumeClaim'> resources[0m [[0m[1m[34mtests.ai_hub.conftest[0m][0m [36mname[0m=[35mtests.ai_hub.conftest[0m
[2m2026-07-02T06:14:48.819136Z[0m [[32m[1minfo     [0m] [1mCreate PersistentVolumeClaim db-model-registry0[0m [[0m[1m[34mocp_resources PersistentVolumeClaim[0m][0m
[2m2026-07-02T06:14:48.819313Z[0m [[32m[1minfo     [0m] [1mPosting {'apiVersion': 'v1', 'kind': 'PersistentVolumeClaim', 'metadata': {'name': 'db-model-registry0', 'labels': {'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'namespace': 'rhoai-model-registries'}, 'spec': {'volumeMode': 'Filesystem', 'accessModes': ['ReadWriteOnce'], 'resources': {'requests': {'storage': '3Gi'}}}}[0m [[0m[1m[34mocp_resources PersistentVolumeClaim[0m][0m
[2m2026-07-02T06:14:48.858422Z[0m [[32m[1minfo     [0m] [1mCreating 1 <class 'ocp_resources.service.Service'> resources[0m [[0m[1m[34mtests.ai_hub.conftest[0m][0m [36mname[0m=[35mtests.ai_hub.conftest[0m
[2m2026-07-02T06:14:48.860562Z[0m [[32m[1minfo     [0m] [1mCreate Service db-model-registry0[0m [[0m[1m[34mocp_resources Service[0m][0m
[2m2026-07-02T06:14:48.860696Z[0m [[32m[1minfo     [0m] [1mPosting {'apiVersion': 'v1', 'kind': 'Service', 'metadata': {'name': 'db-model-registry0', 'labels': {'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'template.openshift.io/expose-uri': 'mysql://{.spec.clusterIP}:{.spec.ports[?(.name==\\mysql\\)].port}'}, 'namespace': 'rhoai-model-registries'}, 'spec': {'ports': [{'name': 'mysql', 'nodePort': 0, 'port': 3306, 'protocol': 'TCP', 'appProtocol': 'tcp', 'targetPort': 3306}], 'selector': {'name': 'db-model-registry0'}}}[0m [[0m[1m[34mocp_resources Service[0m][0m
[2m2026-07-02T06:14:48.906542Z[0m [[32m[1minfo     [0m] [1mCreating 1 <class 'ocp_resources.deployment.Deployment'> resources[0m [[0m[1m[34mtests.ai_hub.conftest[0m][0m [36mname[0m=[35mtests.ai_hub.conftest[0m
[2m2026-07-02T06:14:48.910572Z[0m [[32m[1minfo     [0m] [1mCreate Deployment db-model-registry0[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:14:48.910726Z[0m [[32m[1minfo     [0m] [1mPosting {'apiVersion': 'apps/v1', 'kind': 'Deployment', 'metadata': {'name': 'db-model-registry0', 'labels': {'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'template.alpha.openshift.io/wait-for-ready': 'true'}, 'namespace': 'rhoai-model-registries'}, 'spec': {'selector': {'matchLabels': {'name': 'db-model-registry0'}}, 'template': {'metadata': {'labels': {'name': 'db-model-registry0', 'sidecar.istio.io/inject': 'false'}}, 'spec': {'containers': [{'env': [{'name': 'MYSQL_USER', 'valueFrom': {'secretKeyRef': {'key': 'database-user', 'name': 'db-model-registry0'}}}, {'name': 'MYSQL_PASSWORD', 'valueFrom': {'secretKeyRef': {'key': 'database-password', 'name': 'db-model-registry0'}}}, {'name': 'MYSQL_ROOT_PASSWORD', 'valueFrom': {'secretKeyRef': {'key': 'database-password', 'name': 'db-model-registry0'}}}, {'name': 'MYSQL_DATABASE', 'valueFrom': {'secretKeyRef': {'key': 'database-name', 'name': 'db-model-registry0'}}}], 'image': 'public.ecr.aws/docker/library/mysql@sha256:28540698ce89bd72f985044de942d65bd99c6fadb2db105327db57f3f70564f0', 'imagePullPolicy': 'IfNotPresent', 'livenessProbe': {'exec': {'command': ['/bin/bash', '-c', 'mysqladmin -u${MYSQL_USER} -p${MYSQL_ROOT_PASSWORD} ping']}, 'initialDelaySeconds': 15, 'periodSeconds': 10, 'timeoutSeconds': 5}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '-c', 'mysql -D ${MYSQL_DATABASE} -u${MYSQL_USER} -p${MYSQL_ROOT_PASSWORD} -e "SELECT 1"']}, 'initialDelaySeconds': 10, 'timeoutSeconds': 5}, 'name': 'mysql', 'ports': [{'containerPort': 3306, 'protocol': 'TCP'}], 'securityContext': {'capabilities': {}, 'privileged': False}, 'terminationMessagePath': '/dev/termination-log', 'volumeMounts': [{'mountPath': '/var/lib/mysql', 'name': 'db-model-registry0-data'}], 'args': ['--datadir', '/var/lib/mysql/datadir']}], 'dnsPolicy': 'ClusterFirst', 'restartPolicy': 'Always', 'volumes': [{'name': 'db-model-registry0-data', 'persistentVolumeClaim': {'claimName': 'db-model-registry0'}}]}}, 'replicas': 1, 'revisionHistoryLimit': 0, 'strategy': {'type': 'Recreate'}}}[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:14:48.972630Z[0m [[32m[1minfo     [0m] [1mWait until Deployment db-model-registry0 is created[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:14:48.972773Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:14:48.992347Z[0m [[32m[1minfo     [0m] [1mElapsed time: 5.841255187988281e-05 [0:00:00.000058][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:14:48.992605Z[0m [[32m[1minfo     [0m] [1mWait for Deployment db-model-registry0 to be deployed: True[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:14:48.992735Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.deployment.wait_for_replicas.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:14:49.009783Z[0m [[32m[1minfo     [0m] [1mElapsed time: 3.2901763916015625e-05 [0:00:00.000033][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:14:49.010056Z[0m [[32m[1minfo     [0m] [1mWaiting for 239.98232650756836 seconds [0:03:59.982327], retry every 1 seconds. (Function: ocp_resources.deployment.wait_for_replicas.lambda: self.instance)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:13.510100Z[0m [[32m[1minfo     [0m] [1mElapsed time: 24.48040747642517 [0:00:24.480407][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:13.510435Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: model_registry_instance[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:15:13.555470Z[0m [[32m[1minfo     [0m] [1mkind: ModelRegistry api version: modelregistry.opendatahub.io/v1beta1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-07-02T06:15:13.555646Z[0m [[32m[1minfo     [0m] [1mCreate ModelRegistry model-registry0[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:15:13.555842Z[0m [[32m[1minfo     [0m] [1mPosting {'apiVersion': 'modelregistry.opendatahub.io/v1beta1', 'kind': 'ModelRegistry', 'metadata': {'name': 'model-registry0', 'labels': {'app.kubernetes.io/name': 'model-registry0', 'app.kubernetes.io/instance': 'model-registry0', 'app.kubernetes.io/part-of': 'model-registry0', 'app.kubernetes.io/created-by': 'model-registry0'}, 'namespace': 'rhoai-model-registries'}, 'spec': {'grpc': None, 'rest': {}, 'kubeRBACProxy': {}, 'mysql': {'host': 'db-model-registry0.rhoai-model-registries.svc.cluster.local', 'database': 'model_registry', 'passwordSecret': {'key': 'database-password', 'name': 'db-model-registry0'}, 'port': 3306, 'skipDBCreation': False, 'username': 'mlmduser'}}}[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:15:13.648059Z[0m [[32m[1minfo     [0m] [1mWait until ModelRegistry model-registry0 is created[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:15:13.648254Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:13.666920Z[0m [[32m[1minfo     [0m] [1mElapsed time: 5.125999450683594e-05 [0:00:00.000051][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:13.667235Z[0m [[32m[1minfo     [0m] [1mWait for ModelRegistry/model-registry0's 'Available' condition to be 'True'[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:15:13.667404Z[0m [[32m[1minfo     [0m] [1mWait until ModelRegistry model-registry0 is created[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:15:13.667516Z[0m [[32m[1minfo     [0m] [1mWaiting for 300 seconds [0:05:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:13.685144Z[0m [[32m[1minfo     [0m] [1mElapsed time: 6.914138793945312e-05 [0:00:00.000069][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:13.685373Z[0m [[32m[1minfo     [0m] [1mWaiting for 299.981698513031 seconds [0:04:59.981699], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:30.013707Z[0m [[32m[1minfo     [0m] [1mElapsed time: 16.309659957885742 [0:00:16.309660][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:30.013944Z[0m [[32m[1minfo     [0m] [1mWait for ModelRegistry/model-registry0's 'KubeRBACProxyAvailable' condition to be 'True'[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:15:30.014087Z[0m [[32m[1minfo     [0m] [1mWait until ModelRegistry model-registry0 is created[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:15:30.014238Z[0m [[32m[1minfo     [0m] [1mWaiting for 300 seconds [0:05:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:30.032945Z[0m [[32m[1minfo     [0m] [1mElapsed time: 3.409385681152344e-05 [0:00:00.000034][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:30.033128Z[0m [[32m[1minfo     [0m] [1mWaiting for 299.9809424877167 seconds [0:04:59.980942], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:30.051007Z[0m [[32m[1minfo     [0m] [1mElapsed time: 3.552436828613281e-05 [0:00:00.000036][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:30.101764Z[0m [[32m[1minfo     [0m] [1mWaiting for 180 seconds [0:03:00], retry every 5 seconds. (Function: utilities.general.get_not_running_pods  Kwargs: {'pods': [<ocp_resources.pod.Pod object at 0x7fbcda7263c0>, <ocp_resources.pod.Pod object at 0x7fbcda726510>, <ocp_resources.pod.Pod object at 0x7fbcda726660>, <ocp_resources.pod.Pod object at 0x7fbcda7267b0>]})[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:55.992144Z[0m [[32m[1minfo     [0m] [1mElapsed time: 25.742704153060913 [0:00:25.742704][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:55.992571Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: model_registry_instance_pods_by_label[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:15:55.992704Z[0m [[32m[1minfo     [0m] [1mWaiting for 60 seconds [0:01:00], retry every 5 seconds. (Function: utilities.general.wait_for_pods_by_labels  Kwargs: {'admin_client': <kubernetes.dynamic.client.DynamicClient object at 0x7fbcda683610>, 'namespace': 'rhoai-model-registries', 'label_selector': 'app=model-registry0', 'expected_num_pods': 1})[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:56.011630Z[0m [[32m[1minfo     [0m] [1mElapsed time: 5.364418029785156e-05 [0:00:00.000054][0m [[0m[1m[34mtimeout_sampler[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:15:56.010902Z[0m [[32m[1minfo     [0m] [1mValidating model-registry0-57764fb5cf-bpvrw in rhoai-model-registries[0m [[0m[1m[34mtests.ai_hub.image_validation.utils[0m][0m [36mname[0m=[35mtests.ai_hub.image_validation.utils[0m
FAILED[1m
TEST: TestModelRegistryImages.test_verify_model_registry_pod_images[model_registry_metadata_db_resources0-model_registry_instance0-model_registry_instance_pods_by_label0] STATUS: [0;31mFAILED[0m[0m
[2m2026-07-02T06:15:56.057180Z[0m [[31m[1merror    [0m] [1mTraceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper
    return result.get_result()
           ~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result
    raise exc.with_traceback(tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper
    res = yield
          ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 179, in pytest_runtest_call
    item.runtest()
    ~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1720, in runtest
    self.ihook.pytest_pyfunc_call(pyfuncitem=self)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper
    return result.get_result()
           ~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result
    raise exc.with_traceback(tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper
    res = yield
          ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 166, in pytest_pyfunc_call
    result = testfunction(**testargs)
  File "/home/odh/opendatahub-tests/tests/ai_hub/image_validation/test_verify_rhoai_images.py", line 102, in test_verify_model_registry_pod_images
    validate_images(pods_to_validate=model_registry_instance_pods_by_label, related_images_refs=related_images_refs)
    ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/tests/ai_hub/image_validation/utils.py", line 22, in validate_images
    pytest.fail("\n".join(validation_errors))
    ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/outcomes.py", line 163, in __call__
    raise Failed(msg=reason, pytrace=pytrace)
Failed: Pod model-registry0-57764fb5cf-bpvrw in namespace: rhoai-model-registries image validation failed: Image quay.io/rhoai/odh-model-registry-rhel9@sha256:20b320f3b9c07438fd5e62eca18e5ba85f1d73e7a58159db74426211004e71af is not from registry.redhat.io
Pod model-registry0-57764fb5cf-bpvrw, namespace: rhoai-model-registries image quay.io/rhoai/odh-model-registry-rhel9@sha256:20b320f3b9c07438fd5e62eca18e5ba85f1d73e7a58159db74426211004e71af is not in valid image references
Pod model-registry0-57764fb5cf-bpvrw in namespace: rhoai-model-registries image validation failed: Image quay.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:b7cafb9561936ea45769e77f0da365043d16e2a0b3d2c74921d31dd20133e696 is not from registry.redhat.io
Pod model-registry0-57764fb5cf-bpvrw, namespace: rhoai-model-registries image quay.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:b7cafb9561936ea45769e77f0da365043d16e2a0b3d2c74921d31dd20133e696 is not in valid image references[0m [[0m[1m[34mconftest[0m][0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[2m2026-07-02T06:15:56.057620Z[0m [[32m[1minfo     [0m] [1mDelete ModelRegistry model-registry0[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:15:56.096436Z[0m [[32m[1minfo     [0m] [1mDeleting {'apiVersion': 'modelregistry.opendatahub.io/v1beta1', 'kind': 'ModelRegistry', 'metadata': {'creationTimestamp': '2026-07-02T06:15:13Z', 'finalizers': ['modelregistry.opendatahub.io/finalizer'], 'generation': 1, 'labels': {'app.kubernetes.io/created-by': 'model-registry0', 'app.kubernetes.io/instance': 'model-registry0', 'app.kubernetes.io/name': 'model-registry0', 'app.kubernetes.io/part-of': 'model-registry0'}, 'managedFields': [{'apiVersion': 'modelregistry.opendatahub.io/v1beta1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:labels': {'.': {}, 'f:app.kubernetes.io/created-by': {}, 'f:app.kubernetes.io/instance': {}, 'f:app.kubernetes.io/name': {}, 'f:app.kubernetes.io/part-of': {}}}, 'f:spec': {'.': {}, 'f:kubeRBACProxy': {'.': {}, 'f:port': {}, 'f:routePort': {}, 'f:serviceRoute': {}}, 'f:mysql': {'.': {}, 'f:database': {}, 'f:host': {}, 'f:passwordSecret': {'.': {}, 'f:key': {}, 'f:name': {}}, 'f:port': {}, 'f:skipDBCreation': {}, 'f:username': {}}, 'f:rest': {'.': {}, 'f:port': {}, 'f:serviceRoute': {}}}}, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': '2026-07-02T06:15:13Z'}, {'apiVersion': 'modelregistry.opendatahub.io/v1beta1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:finalizers': {'.': {}, 'v:"modelregistry.opendatahub.io/finalizer"': {}}}}, 'manager': 'manager', 'operation': 'Update', 'time': '2026-07-02T06:15:13Z'}, {'apiVersion': 'modelregistry.opendatahub.io/v1beta1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'.': {}, 'f:conditions': {}, 'f:hosts': {}, 'f:hostsStr': {}, 'f:specDefaults': {}}}, 'manager': 'manager', 'operation': 'Update', 'subresource': 'status', 'time': '2026-07-02T06:15:29Z'}], 'name': 'model-registry0', 'namespace': 'rhoai-model-registries', 'resourceVersion': '11060652', 'uid': '7c4b499f-25a6-4b25-9d73-94887e4917a3'}, 'spec': {'grpc': {'port': 9090}, 'kubeRBACProxy': {'port': 8443, 'routePort': 443, 'serviceRoute': 'enabled'}, 'mysql': {'database': 'model_registry', 'host': 'db-model-registry0.rhoai-model-registries.svc.cluster.local', 'passwordSecret': {'key': 'database-password', 'name': 'db-model-registry0'}, 'port': 3306, 'skipDBCreation': False, 'username': 'mlmduser'}, 'rest': {'port': 8080, 'serviceRoute': 'disabled'}}, 'status': {'conditions': [{'lastTransitionTime': '2026-07-02T06:15:14Z', 'message': 'Deployment was successfully created', 'reason': 'CreatedDeployment', 'status': 'False', 'type': 'Progressing'}, {'lastTransitionTime': '2026-07-02T06:15:29Z', 'message': 'Deployment is available', 'reason': 'DeploymentAvailable', 'status': 'True', 'type': 'Available'}, {'lastTransitionTime': '2026-07-02T06:15:29Z', 'message': 'kube-rbac-proxy was successfully created', 'reason': 'ResourcesAvailable', 'status': 'True', 'type': 'KubeRBACProxyAvailable'}], 'hosts': ['model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com', 'model-registry0.rhoai-model-registries.svc.cluster.local', 'model-registry0.rhoai-model-registries', 'model-registry0'], 'hostsStr': 'model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com,model-registry0.rhoai-model-registries.svc.cluster.local,model-registry0.rhoai-model-registries,model-registry0', 'specDefaults': '{"kubeRBACProxy":{"domain":"apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com","image":"registry.redhat.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:b7cafb9561936ea45769e77f0da365043d16e2a0b3d2c74921d31dd20133e696","tlsCertificateSecret":{"key":"tls.crt","name":"model-registry0-kube-rbac-proxy"},"tlsKeySecret":{"key":"tls.key","name":"model-registry0-kube-rbac-proxy"}},"rest":{"image":"registry.redhat.io/rhoai/odh-model-registry-rhel9@sha256:20b320f3b9c07438fd5e62eca18e5ba85f1d73e7a58159db74426211004e71af","resources":{"limits":{"memory":"256Mi"},"requests":{"cpu":"100m","memory":"256Mi"}}}}'}}[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:15:56.120147Z[0m [[32m[1minfo     [0m] [1mWait until ModelRegistry model-registry0 is deleted[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:15:56.120339Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:57.157950Z[0m [[32m[1minfo     [0m] [1mElapsed time: 1.0180175304412842 [0:00:01.018018][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:57.158269Z[0m [[32m[1minfo     [0m] [1mDelete Deployment db-model-registry0[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:15:57.202979Z[0m [[32m[1minfo     [0m] [1mDeleting {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'db-model-registry0', 'namespace': 'rhoai-model-registries', 'uid': '8bffddba-34c2-4804-8643-f22c106fbca8', 'resourceVersion': '11060288', 'generation': 1, 'creationTimestamp': '2026-07-02T06:14:48Z', 'labels': {'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'deployment.kubernetes.io/revision': '1', 'template.alpha.openshift.io/wait-for-ready': 'true'}, 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'apps/v1', 'time': '2026-07-02T06:14:48Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:template.alpha.openshift.io/wait-for-ready': {}}, 'f:labels': {'.': {}, 'f:app.kubernetes.io/instance': {}, 'f:app.kubernetes.io/name': {}, 'f:app.kubernetes.io/part-of': {}}}, 'f:spec': {'f:progressDeadlineSeconds': {}, 'f:replicas': {}, 'f:revisionHistoryLimit': {}, 'f:selector': {}, 'f:strategy': {'f:type': {}}, 'f:template': {'f:metadata': {'f:labels': {'.': {}, 'f:name': {}, 'f:sidecar.istio.io/inject': {}}}, 'f:spec': {'f:containers': {'k:{"name":"mysql"}': {'.': {}, 'f:args': {}, 'f:env': {'.': {}, 'k:{"name":"MYSQL_DATABASE"}': {'.': {}, 'f:name': {}, 'f:valueFrom': {'.': {}, 'f:secretKeyRef': {}}}, 'k:{"name":"MYSQL_PASSWORD"}': {'.': {}, 'f:name': {}, 'f:valueFrom': {'.': {}, 'f:secretKeyRef': {}}}, 'k:{"name":"MYSQL_ROOT_PASSWORD"}': {'.': {}, 'f:name': {}, 'f:valueFrom': {'.': {}, 'f:secretKeyRef': {}}}, 'k:{"name":"MYSQL_USER"}': {'.': {}, 'f:name': {}, 'f:valueFrom': {'.': {}, 'f:secretKeyRef': {}}}}, 'f:image': {}, 'f:imagePullPolicy': {}, 'f:livenessProbe': {'.': {}, 'f:exec': {'.': {}, 'f:command': {}}, 'f:failureThreshold': {}, 'f:initialDelaySeconds': {}, 'f:periodSeconds': {}, 'f:successThreshold': {}, 'f:timeoutSeconds': {}}, 'f:name': {}, 'f:ports': {'.': {}, 'k:{"containerPort":3306,"protocol":"TCP"}': {'.': {}, 'f:containerPort': {}, 'f:protocol': {}}}, 'f:readinessProbe': {'.': {}, 'f:exec': {'.': {}, 'f:command': {}}, 'f:failureThreshold': {}, 'f:initialDelaySeconds': {}, 'f:periodSeconds': {}, 'f:successThreshold': {}, 'f:timeoutSeconds': {}}, 'f:resources': {}, 'f:securityContext': {'.': {}, 'f:capabilities': {}, 'f:privileged': {}}, 'f:terminationMessagePath': {}, 'f:terminationMessagePolicy': {}, 'f:volumeMounts': {'.': {}, 'k:{"mountPath":"/var/lib/mysql"}': {'.': {}, 'f:mountPath': {}, 'f:name': {}}}}}, 'f:dnsPolicy': {}, 'f:restartPolicy': {}, 'f:schedulerName': {}, 'f:securityContext': {}, 'f:terminationGracePeriodSeconds': {}, 'f:volumes': {'.': {}, 'k:{"name":"db-model-registry0-data"}': {'.': {}, 'f:name': {}, 'f:persistentVolumeClaim': {'.': {}, 'f:claimName': {}}}}}}}}}, {'manager': 'kube-controller-manager', 'operation': 'Update', 'apiVersion': 'apps/v1', 'time': '2026-07-02T06:15:12Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:deployment.kubernetes.io/revision': {}}}, 'f:status': {'f:availableReplicas': {}, 'f:conditions': {'.': {}, 'k:{"type":"Available"}': {'.': {}, 'f:lastTransitionTime': {}, 'f:lastUpdateTime': {}, 'f:message': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}, 'k:{"type":"Progressing"}': {'.': {}, 'f:lastTransitionTime': {}, 'f:lastUpdateTime': {}, 'f:message': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}}, 'f:observedGeneration': {}, 'f:readyReplicas': {}, 'f:replicas': {}, 'f:updatedReplicas': {}}}, 'subresource': 'status'}]}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'name': 'db-model-registry0'}}, 'template': {'metadata': {'labels': {'name': 'db-model-registry0', 'sidecar.istio.io/inject': 'false'}}, 'spec': {'volumes': [{'name': 'db-model-registry0-data', 'persistentVolumeClaim': {'claimName': 'db-model-registry0'}}], 'containers': [{'name': 'mysql', 'image': 'public.ecr.aws/docker/library/mysql@sha256:28540698ce89bd72f985044de942d65bd99c6fadb2db105327db57f3f70564f0', 'args': ['--datadir', '/var/lib/mysql/datadir'], 'ports': [{'containerPort': 3306, 'protocol': 'TCP'}], 'env': [{'name': 'MYSQL_USER', 'valueFrom': {'secretKeyRef': {'name': 'db-model-registry0', 'key': 'database-user'}}}, {'name': 'MYSQL_PASSWORD', 'valueFrom': {'secretKeyRef': {'name': 'db-model-registry0', 'key': 'database-password'}}}, {'name': 'MYSQL_ROOT_PASSWORD', 'valueFrom': {'secretKeyRef': {'name': 'db-model-registry0', 'key': 'database-password'}}}, {'name': 'MYSQL_DATABASE', 'valueFrom': {'secretKeyRef': {'name': 'db-model-registry0', 'key': 'database-name'}}}], 'resources': {}, 'volumeMounts': [{'name': 'db-model-registry0-data', 'mountPath': '/var/lib/mysql'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '-c', 'mysqladmin -u${MYSQL_USER} -p${MYSQL_ROOT_PASSWORD} ping']}, 'initialDelaySeconds': 15, 'timeoutSeconds': 5, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '-c', 'mysql -D ${MYSQL_DATABASE} -u${MYSQL_USER} -p${MYSQL_ROOT_PASSWORD} -e "SELECT 1"']}, 'initialDelaySeconds': 10, 'timeoutSeconds': 5, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent', 'securityContext': {'capabilities': {}, 'privileged': False}}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'Recreate'}, 'revisionHistoryLimit': 0, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2026-07-02T06:15:12Z', 'lastTransitionTime': '2026-07-02T06:15:12Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2026-07-02T06:15:12Z', 'lastTransitionTime': '2026-07-02T06:14:48Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "db-model-registry0-865b4f5d6f" has successfully progressed.'}]}}[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:15:57.223712Z[0m [[32m[1minfo     [0m] [1mWait until Deployment db-model-registry0 is deleted[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:15:57.223880Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:57.242320Z[0m [[32m[1minfo     [0m] [1mElapsed time: 5.7220458984375e-05 [0:00:00.000057][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:57.242605Z[0m [[32m[1minfo     [0m] [1mDelete Service db-model-registry0[0m [[0m[1m[34mocp_resources Service[0m][0m
[2m2026-07-02T06:15:57.281879Z[0m [[32m[1minfo     [0m] [1mDeleting {'kind': 'Service', 'apiVersion': 'v1', 'metadata': {'name': 'db-model-registry0', 'namespace': 'rhoai-model-registries', 'uid': '8a03fe75-bcdc-4ea1-9e76-03d7dbabf3da', 'resourceVersion': '11059698', 'creationTimestamp': '2026-07-02T06:14:48Z', 'labels': {'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'template.openshift.io/expose-uri': 'mysql://{.spec.clusterIP}:{.spec.ports[?(.name==\\mysql\\)].port}'}, 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-02T06:14:48Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:template.openshift.io/expose-uri': {}}, 'f:labels': {'.': {}, 'f:app.kubernetes.io/instance': {}, 'f:app.kubernetes.io/name': {}, 'f:app.kubernetes.io/part-of': {}}}, 'f:spec': {'f:internalTrafficPolicy': {}, 'f:ports': {'.': {}, 'k:{"port":3306,"protocol":"TCP"}': {'.': {}, 'f:appProtocol': {}, 'f:name': {}, 'f:port': {}, 'f:protocol': {}, 'f:targetPort': {}}}, 'f:selector': {}, 'f:sessionAffinity': {}, 'f:type': {}}}}]}, 'spec': {'ports': [{'name': 'mysql', 'protocol': 'TCP', 'appProtocol': 'tcp', 'port': 3306, 'targetPort': 3306}], 'selector': {'name': 'db-model-registry0'}, 'clusterIP': '172.30.82.16', 'clusterIPs': ['172.30.82.16'], 'type': 'ClusterIP', 'sessionAffinity': 'None', 'ipFamilies': ['IPv4'], 'ipFamilyPolicy': 'SingleStack', 'internalTrafficPolicy': 'Cluster'}, 'status': {'loadBalancer': {}}}[0m [[0m[1m[34mocp_resources Service[0m][0m
[2m2026-07-02T06:15:57.313004Z[0m [[32m[1minfo     [0m] [1mWait until Service db-model-registry0 is deleted[0m [[0m[1m[34mocp_resources Service[0m][0m
[2m2026-07-02T06:15:57.313179Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:57.331959Z[0m [[32m[1minfo     [0m] [1mElapsed time: 5.030632019042969e-05 [0:00:00.000050][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:15:57.332295Z[0m [[32m[1minfo     [0m] [1mDelete PersistentVolumeClaim db-model-registry0[0m [[0m[1m[34mocp_resources PersistentVolumeClaim[0m][0m
[2m2026-07-02T06:15:57.369639Z[0m [[32m[1minfo     [0m] [1mDeleting {'kind': 'PersistentVolumeClaim', 'apiVersion': 'v1', 'metadata': {'name': 'db-model-registry0', 'namespace': 'rhoai-model-registries', 'uid': 'b9ab36a5-bc21-4d3d-a2fa-36a0e0815be7', 'resourceVersion': '11059898', 'creationTimestamp': '2026-07-02T06:14:48Z', 'labels': {'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'pv.kubernetes.io/bind-completed': 'yes', 'pv.kubernetes.io/bound-by-controller': 'yes', 'volume.beta.kubernetes.io/storage-provisioner': 'ebs.csi.aws.com', 'volume.kubernetes.io/selected-node': 'ip-10-0-1-105.us-east-2.compute.internal', 'volume.kubernetes.io/storage-provisioner': 'ebs.csi.aws.com'}, 'finalizers': ['kubernetes.io/pvc-protection'], 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-02T06:14:48Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:labels': {'.': {}, 'f:app.kubernetes.io/instance': {}, 'f:app.kubernetes.io/name': {}, 'f:app.kubernetes.io/part-of': {}}}, 'f:spec': {'f:accessModes': {}, 'f:resources': {'f:requests': {'.': {}, 'f:storage': {}}}, 'f:volumeMode': {}}}}, {'manager': 'kube-scheduler', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-02T06:14:54Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:volume.kubernetes.io/selected-node': {}}}}}, {'manager': 'kube-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-02T06:14:56Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:pv.kubernetes.io/bind-completed': {}, 'f:pv.kubernetes.io/bound-by-controller': {}, 'f:volume.beta.kubernetes.io/storage-provisioner': {}, 'f:volume.kubernetes.io/storage-provisioner': {}}}, 'f:spec': {'f:volumeName': {}}}}, {'manager': 'kube-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-02T06:14:56Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'f:accessModes': {}, 'f:capacity': {'.': {}, 'f:storage': {}}, 'f:phase': {}}}, 'subresource': 'status'}]}, 'spec': {'accessModes': ['ReadWriteOnce'], 'resources': {'requests': {'storage': '3Gi'}}, 'volumeName': 'pvc-b9ab36a5-bc21-4d3d-a2fa-36a0e0815be7', 'storageClassName': 'gp3-csi', 'volumeMode': 'Filesystem'}, 'status': {'phase': 'Bound', 'accessModes': ['ReadWriteOnce'], 'capacity': {'storage': '3Gi'}}}[0m [[0m[1m[34mocp_resources PersistentVolumeClaim[0m][0m
[2m2026-07-02T06:15:57.393300Z[0m [[32m[1minfo     [0m] [1mWait until PersistentVolumeClaim db-model-registry0 is deleted[0m [[0m[1m[34mocp_resources PersistentVolumeClaim[0m][0m
[2m2026-07-02T06:15:57.393618Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:16:00.467758Z[0m [[32m[1minfo     [0m] [1mElapsed time: 3.0547263622283936 [0:00:03.054726][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:16:00.468089Z[0m [[32m[1minfo     [0m] [1mDelete Secret db-model-registry0[0m [[0m[1m[34mocp_resources Secret[0m][0m
[2m2026-07-02T06:16:00.512366Z[0m [[32m[1minfo     [0m] [1mDeleting {'kind': 'Secret', 'apiVersion': 'v1', 'metadata': {'name': 'db-model-registry0', 'namespace': 'rhoai-model-registries', 'uid': '864f3632-2157-4c4d-991d-2d82826f274a', 'resourceVersion': '11059694', 'creationTimestamp': '2026-07-02T06:14:48Z', 'labels': {'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'template.openshift.io/expose-database_name': "'{.data[''database-name'']}'", 'template.openshift.io/expose-password': "'{.data[''database-password'']}'", 'template.openshift.io/expose-username': "'{.data[''database-user'']}'"}, 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-02T06:14:48Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:data': {'.': {}, 'f:database-name': {}, 'f:database-password': {}, 'f:database-user': {}}, 'f:metadata': {'f:annotations': {'.': {}, 'f:template.openshift.io/expose-database_name': {}, 'f:template.openshift.io/expose-password': {}, 'f:template.openshift.io/expose-username': {}}, 'f:labels': {'.': {}, 'f:app.kubernetes.io/instance': {}, 'f:app.kubernetes.io/name': {}, 'f:app.kubernetes.io/part-of': {}}}, 'f:type': {}}}]}, 'data': '*******', 'type': 'Opaque'}[0m [[0m[1m[34mocp_resources Secret[0m][0m
[2m2026-07-02T06:16:00.540140Z[0m [[32m[1minfo     [0m] [1mWait until Secret db-model-registry0 is deleted[0m [[0m[1m[34mocp_resources Secret[0m][0m
[2m2026-07-02T06:16:00.540397Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m

_ TestModelRegistryImages.test_verify_model_registry_pod_images[model_registry_metadata_db_resources0-model_registry_instance0-model_registry_instance_pods_by_label0] _
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper
    return result.get_result()
           ~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result
    raise exc.with_traceback(tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper
    res = yield
          ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 179, in pytest_runtest_call
    item.runtest()
    ~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1720, in runtest
    self.ihook.pytest_pyfunc_call(pyfuncitem=self)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper
    return result.get_result()
           ~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result
    raise exc.with_traceback(tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper
    res = yield
          ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 166, in pytest_pyfunc_call
    result = testfunction(**testargs)
  File "/home/odh/opendatahub-tests/tests/ai_hub/image_validation/test_verify_rhoai_images.py", line 102, in test_verify_model_registry_pod_images
    validate_images(pods_to_validate=model_registry_instance_pods_by_label, related_images_refs=related_images_refs)
    ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/tests/ai_hub/image_validation/utils.py", line 22, in validate_images
    pytest.fail("\n".join(validation_errors))
    ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/outcomes.py", line 163, in __call__
    raise Failed(msg=reason, pytrace=pytrace)
Failed: Pod model-registry0-57764fb5cf-bpvrw in namespace: rhoai-model-registries image validation failed: Image quay.io/rhoai/odh-model-registry-rhel9@sha256:20b320f3b9c07438fd5e62eca18e5ba85f1d73e7a58159db74426211004e71af is not from registry.redhat.io
Pod model-registry0-57764fb5cf-bpvrw, namespace: rhoai-model-registries image quay.io/rhoai/odh-model-registry-rhel9@sha256:20b320f3b9c07438fd5e62eca18e5ba85f1d73e7a58159db74426211004e71af is not in valid image references
Pod model-registry0-57764fb5cf-bpvrw in namespace: rhoai-model-registries image validation failed: Image quay.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:b7cafb9561936ea45769e77f0da365043d16e2a0b3d2c74921d31dd20133e696 is not from registry.redhat.io
Pod model-registry0-57764fb5cf-bpvrw, namespace: rhoai-model-registries image quay.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:b7cafb9561936ea45769e77f0da365043d16e2a0b3d2c74921d31dd20133e696 is not in valid image references
_ 1 of 32 completed, 0 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/mcp_servers/config/test_default_mcp.py::TestDefaultMCPCatalogSourceConfigMap::test_default_mcp_catalog_entry[test_redhat_catalog] [2m2026-07-02T06:16:00.560221Z[0m [[32m[1minfo     [0m] [1mElapsed time: 8.821487426757812e-05 [0:00:00.000088][0m [[0m[1m[34mtimeout_sampler[0m][0m
[1m
--------------------------------- test_default_mcp_catalog_entry[test_redhat_catalog] ---------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:16:00.561735Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: mcp_catalog_rest_urls_scope_session[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:16:00.561972Z[0m [[32m[1minfo     [0m] [1mkind: Route api version: route.openshift.io/v1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-07-02T06:16:00.609487Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: current_client_token[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:16:00.608676Z[0m [[32m[1minfo     [0m] [1mGetting OpenShift token       [0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-07-02T06:16:00.609813Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: model_registry_rest_headers_scope_session[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:16:00.609999Z[0m [[32m[1minfo     [0m] [1mExecuting session fixture: default_mcp_servers[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:16:00.609066Z[0m [[32m[1minfo     [0m] [1mExecuting get call: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/mcp_catalog/v1alpha1/mcp_servers[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:00.609114Z[0m [[32m[1minfo     [0m] [1mparams: {'pageSize': 1000}    [0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:00.733562Z[0m [[32m[1minfo     [0m] [1mEncoded url from requests library: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/mcp_catalog/v1alpha1/mcp_servers?pageSize=1000[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:00.737058Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: default_catalog_sources_data[0m [[0m[1m[34mconftest[0m][0m
PASSED[2m2026-07-02T06:16:00.760080Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: default_mcp_catalogs[0m [[0m[1m[34mconftest[0m][0m

_ 2 of 32 completed, 1 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/mcp_servers/config/test_default_mcp.py::TestDefaultMCPCatalogSourceConfigMap::test_default_mcp_catalog_entry[test_partner_catalog] PASSED
_ 3 of 32 completed, 2 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/mcp_servers/config/test_default_mcp.py::TestDefaultMCPCatalogSourceConfigMap::test_default_mcp_catalog_entry[test_community_catalog] PASSED
_ 4 of 32 completed, 3 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/mcp_servers/config/test_default_mcp.py::TestDefaultMCPCatalogSourceConfigMap::test_default_mcp_label_definition[test_redhat_label] PASSED
_ 5 of 32 completed, 4 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/mcp_servers/config/test_default_mcp.py::TestDefaultMCPCatalogSourceConfigMap::test_default_mcp_label_definition[test_partner_label] PASSED
_ 6 of 32 completed, 5 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/mcp_servers/config/test_source_label.py::TestMCPServerSourceLabel::test_mcp_server_source_label[test_null_label] [2m2026-07-02T06:16:00.766592Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_catalog[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[1m
TEST: TestDefaultMCPCatalogSourceConfigMap.test_default_mcp_catalog_entry[test_redhat_catalog] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
--------------------------------- test_default_mcp_catalog_entry[test_partner_catalog] ---------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:16:00.767481Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_catalog[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[1m
TEST: TestDefaultMCPCatalogSourceConfigMap.test_default_mcp_catalog_entry[test_partner_catalog] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
-------------------------------- test_default_mcp_catalog_entry[test_community_catalog] --------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:16:00.768324Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_catalog[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[1m
TEST: TestDefaultMCPCatalogSourceConfigMap.test_default_mcp_catalog_entry[test_community_catalog] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
--------------------------------- test_default_mcp_label_definition[test_redhat_label] ---------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:16:00.769144Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: default_mcp_label_definitions[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:16:00.769282Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_label[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[1m
TEST: TestDefaultMCPCatalogSourceConfigMap.test_default_mcp_label_definition[test_redhat_label] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
-------------------------------- test_default_mcp_label_definition[test_partner_label] --------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:16:00.770075Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_label[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[1m
TEST: TestDefaultMCPCatalogSourceConfigMap.test_default_mcp_label_definition[test_partner_label] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
------------------------------------ test_mcp_server_source_label[test_null_label] ------------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:16:00.771362Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: model_catalog_routes[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:16:00.787786Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: mcp_catalog_rest_urls[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:16:00.813614Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: model_registry_rest_headers[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:16:00.813795Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: source_label_param[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:16:00.812642Z[0m [[32m[1minfo     [0m] [1mExecuting get call: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/mcp_catalog/v1alpha1/mcp_servers[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:00.812703Z[0m [[32m[1minfo     [0m] [1mparams: {'sourceLabel': 'null'}[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
PASSED[2m2026-07-02T06:16:00.916553Z[0m [[32m[1minfo     [0m] [1mEncoded url from requests library: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/mcp_catalog/v1alpha1/mcp_servers?sourceLabel=null[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m

_ 7 of 32 completed, 6 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/mcp_servers/config/test_source_label.py::TestMCPServerSourceLabel::test_mcp_server_source_label[test_no_filter] [2m2026-07-02T06:16:00.917669Z[0m [[32m[1minfo     [0m] [1mSource label filter {'sourceLabel': 'null'}: size=2[0m [[0m[1m[34m_pytest.compat[0m][0m [36mname[0m=[35mtests.ai_hub.mcp_servers.config.test_source_label[0m
[1m
TEST: TestMCPServerSourceLabel.test_mcp_server_source_label[test_null_label] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
------------------------------------- test_mcp_server_source_label[test_no_filter] -------------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:16:00.921268Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: source_label_param[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:16:00.919685Z[0m [[32m[1minfo     [0m] [1mExecuting get call: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/mcp_catalog/v1alpha1/mcp_servers[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
PASSED[2m2026-07-02T06:16:01.090609Z[0m [[32m[1minfo     [0m] [1mEncoded url from requests library: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/mcp_catalog/v1alpha1/mcp_servers[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m

_ 8 of 32 completed, 7 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/mcp_servers/config/test_source_label.py::TestMCPServerSourceLabel::test_mcp_server_source_label[test_default_label] [2m2026-07-02T06:16:01.092506Z[0m [[32m[1minfo     [0m] [1mSource label filter {}: size=10[0m [[0m[1m[34m_pytest.compat[0m][0m [36mname[0m=[35mtests.ai_hub.mcp_servers.config.test_source_label[0m
[1m
TEST: TestMCPServerSourceLabel.test_mcp_server_source_label[test_no_filter] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
----------------------------------- test_mcp_server_source_label[test_default_label] -----------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:16:01.096285Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: source_label_param[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:16:01.094739Z[0m [[32m[1minfo     [0m] [1mExecuting get call: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/mcp_catalog/v1alpha1/mcp_servers[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:01.094793Z[0m [[32m[1minfo     [0m] [1mparams: {'sourceLabel': 'Red Hat'}[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
PASSED[2m2026-07-02T06:16:01.214554Z[0m [[32m[1minfo     [0m] [1mEncoded url from requests library: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/mcp_catalog/v1alpha1/mcp_servers?sourceLabel=Red+Hat[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m

_ 9 of 32 completed, 8 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/mcp_servers/config/test_source_label.py::TestMCPServerSourceLabel::test_mcp_server_source_label[test_partner_label] [2m2026-07-02T06:16:01.215770Z[0m [[32m[1minfo     [0m] [1mSource label filter {'sourceLabel': 'Red Hat'}: size=3[0m [[0m[1m[34m_pytest.compat[0m][0m [36mname[0m=[35mtests.ai_hub.mcp_servers.config.test_source_label[0m
[1m
TEST: TestMCPServerSourceLabel.test_mcp_server_source_label[test_default_label] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
----------------------------------- test_mcp_server_source_label[test_partner_label] -----------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:16:01.220418Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: source_label_param[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:16:01.218654Z[0m [[32m[1minfo     [0m] [1mExecuting get call: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/mcp_catalog/v1alpha1/mcp_servers[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:01.218731Z[0m [[32m[1minfo     [0m] [1mparams: {'sourceLabel': 'Red Hat Partners'}[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
PASSED[2m2026-07-02T06:16:01.302589Z[0m [[32m[1minfo     [0m] [1mEncoded url from requests library: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/mcp_catalog/v1alpha1/mcp_servers?sourceLabel=Red+Hat+Partners[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m

_ 10 of 32 completed, 9 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_catalog/metadata/test_labels_endpoint.py::TestLabelsEndpoint::test_labels_endpoint_default_data[test_models] [2m2026-07-02T06:16:01.304183Z[0m [[32m[1minfo     [0m] [1mSource label filter {'sourceLabel': 'Red Hat Partners'}: size=5[0m [[0m[1m[34m_pytest.compat[0m][0m [36mname[0m=[35mtests.ai_hub.mcp_servers.config.test_source_label[0m
[1m
TEST: TestMCPServerSourceLabel.test_mcp_server_source_label[test_partner_label] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
------------------------------------ test_labels_endpoint_default_data[test_models] ------------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:16:01.308088Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: model_catalog_routes[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:16:01.329895Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: model_catalog_rest_url[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:16:01.351171Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_labels_by_asset_type[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:16:01.392702Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: asset_type[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:16:01.390358Z[0m [[32m[1minfo     [0m] [1mTesting labels endpoint with default data for asset type: models[0m [[0m[1m[34m_pytest.compat[0m][0m [36mname[0m=[35mtests.ai_hub.model_catalog.metadata.test_labels_endpoint[0m
[2m2026-07-02T06:16:01.397889Z[0m [[32m[1minfo     [0m] [1mTrying to get client via new_client_from_config[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-07-02T06:16:01.396677Z[0m [[32m[1minfo     [0m] [1mGetting OpenShift token       [0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-07-02T06:16:01.396762Z[0m [[32m[1minfo     [0m] [1mExecuting get call: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_catalog/v1alpha1/labels[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:01.396803Z[0m [[32m[1minfo     [0m] [1mparams: {'assetType': 'models'}[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
PASSED[2m2026-07-02T06:16:01.464067Z[0m [[32m[1minfo     [0m] [1mEncoded url from requests library: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_catalog/v1alpha1/labels?assetType=models[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m

_ 11 of 32 completed, 10 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_catalog/metadata/test_labels_endpoint.py::TestLabelsEndpoint::test_labels_endpoint_default_data[test_mcp_servers] [2m2026-07-02T06:16:01.464954Z[0m [[32m[1minfo     [0m] [1mVerifying 3 expected labels against 3 API labels[0m [[0m[1m[34mtests.ai_hub.model_catalog.metadata.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_catalog.metadata.utils[0m
[1m
TEST: TestLabelsEndpoint.test_labels_endpoint_default_data[test_models] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
--------------------------------- test_labels_endpoint_default_data[test_mcp_servers] ---------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:16:01.468211Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_labels_by_asset_type[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:16:01.509003Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: asset_type[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:16:01.506770Z[0m [[32m[1minfo     [0m] [1mTesting labels endpoint with default data for asset type: mcp_servers[0m [[0m[1m[34m_pytest.compat[0m][0m [36mname[0m=[35mtests.ai_hub.model_catalog.metadata.test_labels_endpoint[0m
[2m2026-07-02T06:16:01.512676Z[0m [[32m[1minfo     [0m] [1mGetting OpenShift token       [0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-07-02T06:16:01.512767Z[0m [[32m[1minfo     [0m] [1mExecuting get call: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_catalog/v1alpha1/labels[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:01.512809Z[0m [[32m[1minfo     [0m] [1mparams: {'assetType': 'mcp_servers'}[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
PASSED[2m2026-07-02T06:16:01.638373Z[0m [[32m[1minfo     [0m] [1mEncoded url from requests library: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_catalog/v1alpha1/labels?assetType=mcp_servers[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:01.639461Z[0m [[32m[1minfo     [0m] [1mVerifying 2 expected labels against 2 API labels[0m [[0m[1m[34mtests.ai_hub.model_catalog.metadata.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_catalog.metadata.utils[0m

_ 12 of 32 completed, 11 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_catalog/metadata/test_labels_endpoint.py::TestLabelsEndpoint::test_labels_endpoint_default_no_asset_type [1m
TEST: TestLabelsEndpoint.test_labels_endpoint_default_data[test_mcp_servers] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
-------------------------------------- test_labels_endpoint_default_no_asset_type --------------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:16:01.642376Z[0m [[32m[1minfo     [0m] [1mTesting labels endpoint with no asset type parameter[0m [[0m[1m[34m_pytest.compat[0m][0m [36mname[0m=[35mtests.ai_hub.model_catalog.metadata.test_labels_endpoint[0m
[2m2026-07-02T06:16:01.649194Z[0m [[32m[1minfo     [0m] [1mGetting OpenShift token       [0m [[0m[1m[34mutilities.infra[0m][0m [36mname[0m=[35mutilities.infra[0m
[2m2026-07-02T06:16:01.649293Z[0m [[32m[1minfo     [0m] [1mExecuting get call: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_catalog/v1alpha1/labels[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
PASSED[2m2026-07-02T06:16:01.717142Z[0m [[32m[1minfo     [0m] [1mEncoded url from requests library: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_catalog/v1alpha1/labels[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m

_ 13 of 32 completed, 12 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_catalog/rbac/test_catalog_rbac.py::TestCatalogRBAC::test_admin_can_read_catalog_configmaps[default-catalog-sources] [1m
TEST: TestLabelsEndpoint.test_labels_endpoint_default_no_asset_type STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
--------------------------- test_admin_can_read_catalog_configmaps[default-catalog-sources] ---------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:16:01.723190Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: configmap_name[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
PASSED
_ 14 of 32 completed, 13 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_catalog/search/test_model_search.py::TestSearchModelCatalog::test_search_model_catalog_source_label [2m2026-07-02T06:16:01.757601Z[0m [[32m[1minfo     [0m] [1mAdmin successfully read ConfigMap 'default-catalog-sources'[0m [[0m[1m[34m_pytest.compat[0m][0m [36mname[0m=[35mtests.ai_hub.model_catalog.rbac.test_catalog_rbac[0m
[1m
TEST: TestCatalogRBAC.test_admin_can_read_catalog_configmaps[default-catalog-sources] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
---------------------------------------- test_search_model_catalog_source_label ----------------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:16:01.760686Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: model_catalog_routes[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:16:01.782459Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: model_catalog_rest_url[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:16:01.803944Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: model_registry_rest_headers[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:16:01.803026Z[0m [[32m[1minfo     [0m] [1mExecuting get call: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_catalog/v1alpha1/models[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:01.803085Z[0m [[32m[1minfo     [0m] [1mparams: {'pageSize': 100, 'sourceLabel': 'Red Hat AI'}[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:01.919651Z[0m [[32m[1minfo     [0m] [1mEncoded url from requests library: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_catalog/v1alpha1/models?pageSize=100&sourceLabel=Red+Hat+AI[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:01.922241Z[0m [[32m[1minfo     [0m] [1mExecuting get call: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_catalog/v1alpha1/models[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:01.922304Z[0m [[32m[1minfo     [0m] [1mparams: {'pageSize': 100, 'sourceLabel': 'Red Hat AI Validated'}[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:02.124938Z[0m [[32m[1minfo     [0m] [1mEncoded url from requests library: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_catalog/v1alpha1/models?pageSize=100&sourceLabel=Red+Hat+AI+Validated[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:02.138519Z[0m [[32m[1minfo     [0m] [1mExecuting get call: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_catalog/v1alpha1/models[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:02.138602Z[0m [[32m[1minfo     [0m] [1mparams: {'pageSize': 100, 'sourceLabel': 'null'}[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:02.226076Z[0m [[32m[1minfo     [0m] [1mEncoded url from requests library: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_catalog/v1alpha1/models?pageSize=100&sourceLabel=null[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:02.227688Z[0m [[32m[1minfo     [0m] [1mExecuting get call: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_catalog/v1alpha1/models[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:02.227740Z[0m [[32m[1minfo     [0m] [1mparams: {'pageSize': 100}     [0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:02.518268Z[0m [[32m[1minfo     [0m] [1mEncoded url from requests library: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_catalog/v1alpha1/models?pageSize=100[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:02.532981Z[0m [[32m[1minfo     [0m] [1mExecuting get call: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_catalog/v1alpha1/models[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:02.533069Z[0m [[32m[1minfo     [0m] [1mparams: {'pageSize': 100, 'sourceLabel': 'Red Hat AI Validated,Red Hat AI'}[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
[2m2026-07-02T06:16:02.819008Z[0m [[32m[1minfo     [0m] [1mEncoded url from requests library: https://model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_catalog/v1alpha1/models?pageSize=100&sourceLabel=Red+Hat+AI+Validated%2CRed+Hat+AI[0m [[0m[1m[34mtests.ai_hub.utils[0m][0m [36mname[0m=[35mtests.ai_hub.utils[0m
PASSED
_ 15 of 32 completed, 14 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_registry/python_client/test_model_registry_creation.py::TestModelRegistryCreation::test_registering_model[registered_model0] [2m2026-07-02T06:16:02.832757Z[0m [[32m[1minfo     [0m] [1mno_filtered_models_size: 91   [0m [[0m[1m[34m_pytest.compat[0m][0m [36mname[0m=[35mtests.ai_hub.model_catalog.search.test_model_search[0m
[1m
TEST: TestSearchModelCatalog.test_search_model_catalog_source_label STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
-------------------------------------- test_registering_model[registered_model0] --------------------------------------[0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:16:02.838835Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: model_registry_metadata_db_resources[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:16:02.838964Z[0m [[32m[1minfo     [0m] [1mkind: Deployment api version: apps/v1 --- [DuplicateFilter: Last log `Trying to get client via new_client_from_config` repeated 2 times][0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-07-02T06:16:02.835908Z[0m [[32m[1minfo     [0m] [1mCreating 1 <class 'ocp_resources.secret.Secret'> resources[0m [[0m[1m[34mtests.ai_hub.conftest[0m][0m [36mname[0m=[35mtests.ai_hub.conftest[0m
[2m2026-07-02T06:16:02.839198Z[0m [[32m[1minfo     [0m] [1mCreate Secret db-model-registry0[0m [[0m[1m[34mocp_resources Secret[0m][0m
[2m2026-07-02T06:16:02.839321Z[0m [[32m[1minfo     [0m] [1mPosting {'apiVersion': 'v1', 'kind': 'Secret', 'metadata': {'name': 'db-model-registry0', 'labels': {'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'template.openshift.io/expose-database_name': "'{.data[''database-name'']}'", 'template.openshift.io/expose-password': "'{.data[''database-password'']}'", 'template.openshift.io/expose-username': "'{.data[''database-user'']}'"}, 'namespace': 'rhoai-model-registries'}, 'stringData': '*******'}[0m [[0m[1m[34mocp_resources Secret[0m][0m
[2m2026-07-02T06:16:02.889499Z[0m [[32m[1minfo     [0m] [1mCreating 1 <class 'ocp_resources.persistent_volume_claim.PersistentVolumeClaim'> resources[0m [[0m[1m[34mtests.ai_hub.conftest[0m][0m [36mname[0m=[35mtests.ai_hub.conftest[0m
[2m2026-07-02T06:16:02.891035Z[0m [[32m[1minfo     [0m] [1mCreate PersistentVolumeClaim db-model-registry0[0m [[0m[1m[34mocp_resources PersistentVolumeClaim[0m][0m
[2m2026-07-02T06:16:02.891202Z[0m [[32m[1minfo     [0m] [1mPosting {'apiVersion': 'v1', 'kind': 'PersistentVolumeClaim', 'metadata': {'name': 'db-model-registry0', 'labels': {'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'namespace': 'rhoai-model-registries'}, 'spec': {'volumeMode': 'Filesystem', 'accessModes': ['ReadWriteOnce'], 'resources': {'requests': {'storage': '3Gi'}}}}[0m [[0m[1m[34mocp_resources PersistentVolumeClaim[0m][0m
[2m2026-07-02T06:16:02.933471Z[0m [[32m[1minfo     [0m] [1mCreating 1 <class 'ocp_resources.service.Service'> resources[0m [[0m[1m[34mtests.ai_hub.conftest[0m][0m [36mname[0m=[35mtests.ai_hub.conftest[0m
[2m2026-07-02T06:16:02.935229Z[0m [[32m[1minfo     [0m] [1mCreate Service db-model-registry0[0m [[0m[1m[34mocp_resources Service[0m][0m
[2m2026-07-02T06:16:02.935399Z[0m [[32m[1minfo     [0m] [1mPosting {'apiVersion': 'v1', 'kind': 'Service', 'metadata': {'name': 'db-model-registry0', 'labels': {'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'template.openshift.io/expose-uri': 'mysql://{.spec.clusterIP}:{.spec.ports[?(.name==\\mysql\\)].port}'}, 'namespace': 'rhoai-model-registries'}, 'spec': {'ports': [{'name': 'mysql', 'nodePort': 0, 'port': 3306, 'protocol': 'TCP', 'appProtocol': 'tcp', 'targetPort': 3306}], 'selector': {'name': 'db-model-registry0'}}}[0m [[0m[1m[34mocp_resources Service[0m][0m
[2m2026-07-02T06:16:02.980749Z[0m [[32m[1minfo     [0m] [1mCreating 1 <class 'ocp_resources.deployment.Deployment'> resources[0m [[0m[1m[34mtests.ai_hub.conftest[0m][0m [36mname[0m=[35mtests.ai_hub.conftest[0m
[2m2026-07-02T06:16:02.984207Z[0m [[32m[1minfo     [0m] [1mCreate Deployment db-model-registry0[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:16:02.984398Z[0m [[32m[1minfo     [0m] [1mPosting {'apiVersion': 'apps/v1', 'kind': 'Deployment', 'metadata': {'name': 'db-model-registry0', 'labels': {'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'template.alpha.openshift.io/wait-for-ready': 'true'}, 'namespace': 'rhoai-model-registries'}, 'spec': {'selector': {'matchLabels': {'name': 'db-model-registry0'}}, 'template': {'metadata': {'labels': {'name': 'db-model-registry0', 'sidecar.istio.io/inject': 'false'}}, 'spec': {'containers': [{'env': [{'name': 'MYSQL_USER', 'valueFrom': {'secretKeyRef': {'key': 'database-user', 'name': 'db-model-registry0'}}}, {'name': 'MYSQL_PASSWORD', 'valueFrom': {'secretKeyRef': {'key': 'database-password', 'name': 'db-model-registry0'}}}, {'name': 'MYSQL_ROOT_PASSWORD', 'valueFrom': {'secretKeyRef': {'key': 'database-password', 'name': 'db-model-registry0'}}}, {'name': 'MYSQL_DATABASE', 'valueFrom': {'secretKeyRef': {'key': 'database-name', 'name': 'db-model-registry0'}}}], 'image': 'public.ecr.aws/docker/library/mysql@sha256:28540698ce89bd72f985044de942d65bd99c6fadb2db105327db57f3f70564f0', 'imagePullPolicy': 'IfNotPresent', 'livenessProbe': {'exec': {'command': ['/bin/bash', '-c', 'mysqladmin -u${MYSQL_USER} -p${MYSQL_ROOT_PASSWORD} ping']}, 'initialDelaySeconds': 15, 'periodSeconds': 10, 'timeoutSeconds': 5}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '-c', 'mysql -D ${MYSQL_DATABASE} -u${MYSQL_USER} -p${MYSQL_ROOT_PASSWORD} -e "SELECT 1"']}, 'initialDelaySeconds': 10, 'timeoutSeconds': 5}, 'name': 'mysql', 'ports': [{'containerPort': 3306, 'protocol': 'TCP'}], 'securityContext': {'capabilities': {}, 'privileged': False}, 'terminationMessagePath': '/dev/termination-log', 'volumeMounts': [{'mountPath': '/var/lib/mysql', 'name': 'db-model-registry0-data'}], 'args': ['--datadir', '/var/lib/mysql/datadir']}], 'dnsPolicy': 'ClusterFirst', 'restartPolicy': 'Always', 'volumes': [{'name': 'db-model-registry0-data', 'persistentVolumeClaim': {'claimName': 'db-model-registry0'}}]}}, 'replicas': 1, 'revisionHistoryLimit': 0, 'strategy': {'type': 'Recreate'}}}[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:16:03.043244Z[0m [[32m[1minfo     [0m] [1mWait until Deployment db-model-registry0 is created[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:16:03.043417Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:16:03.065175Z[0m [[32m[1minfo     [0m] [1mElapsed time: 4.3392181396484375e-05 [0:00:00.000043][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:16:03.065348Z[0m [[32m[1minfo     [0m] [1mWait for Deployment db-model-registry0 to be deployed: True[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:16:03.065505Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.deployment.wait_for_replicas.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:16:03.083428Z[0m [[32m[1minfo     [0m] [1mElapsed time: 2.6941299438476562e-05 [0:00:00.000027][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:16:03.083587Z[0m [[32m[1minfo     [0m] [1mWaiting for 239.98170685768127 seconds [0:03:59.981707], retry every 1 seconds. (Function: ocp_resources.deployment.wait_for_replicas.lambda: self.instance)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:16:24.839437Z[0m [[32m[1minfo     [0m] [1mElapsed time: 21.724464893341064 [0:00:21.724465][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:16:24.839685Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: model_registry_instance[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:16:24.839844Z[0m [[32m[1minfo     [0m] [1mkind: ModelRegistry api version: modelregistry.opendatahub.io/v1beta1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-07-02T06:16:24.839988Z[0m [[32m[1minfo     [0m] [1mCreate ModelRegistry model-registry0[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:16:24.840125Z[0m [[32m[1minfo     [0m] [1mPosting {'apiVersion': 'modelregistry.opendatahub.io/v1beta1', 'kind': 'ModelRegistry', 'metadata': {'name': 'model-registry0', 'labels': {'app.kubernetes.io/name': 'model-registry0', 'app.kubernetes.io/instance': 'model-registry0', 'app.kubernetes.io/part-of': 'model-registry0', 'app.kubernetes.io/created-by': 'model-registry0'}, 'namespace': 'rhoai-model-registries'}, 'spec': {'grpc': None, 'rest': {}, 'kubeRBACProxy': {}, 'mysql': {'host': 'db-model-registry0.rhoai-model-registries.svc.cluster.local', 'database': 'model_registry', 'passwordSecret': {'key': 'database-password', 'name': 'db-model-registry0'}, 'port': 3306, 'skipDBCreation': False, 'username': 'mlmduser'}}}[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:16:24.906153Z[0m [[32m[1minfo     [0m] [1mWait until ModelRegistry model-registry0 is created[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:16:24.906457Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:16:24.940058Z[0m [[32m[1minfo     [0m] [1mElapsed time: 8.630752563476562e-05 [0:00:00.000086][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:16:24.940390Z[0m [[32m[1minfo     [0m] [1mWait for ModelRegistry/model-registry0's 'Available' condition to be 'True'[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:16:24.940527Z[0m [[32m[1minfo     [0m] [1mWait until ModelRegistry model-registry0 is created[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:16:24.940659Z[0m [[32m[1minfo     [0m] [1mWaiting for 300 seconds [0:05:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:16:24.970492Z[0m [[32m[1minfo     [0m] [1mElapsed time: 5.936622619628906e-05 [0:00:00.000059][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:16:24.970665Z[0m [[32m[1minfo     [0m] [1mWaiting for 299.96923899650574 seconds [0:04:59.969239], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:16:45.920517Z[0m [[32m[1minfo     [0m] [1mElapsed time: 20.895355701446533 [0:00:20.895356][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:16:45.920758Z[0m [[32m[1minfo     [0m] [1mWait for ModelRegistry/model-registry0's 'KubeRBACProxyAvailable' condition to be 'True'[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:16:45.920930Z[0m [[32m[1minfo     [0m] [1mWait until ModelRegistry model-registry0 is created[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:16:45.921057Z[0m [[32m[1minfo     [0m] [1mWaiting for 300 seconds [0:05:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:16:45.973516Z[0m [[32m[1minfo     [0m] [1mElapsed time: 3.337860107421875e-05 [0:00:00.000033][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:16:45.973692Z[0m [[32m[1minfo     [0m] [1mWaiting for 299.947053194046 seconds [0:04:59.947053], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:16:46.027645Z[0m [[32m[1minfo     [0m] [1mElapsed time: 3.695487976074219e-05 [0:00:00.000037][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:16:46.304750Z[0m [[32m[1minfo     [0m] [1mWaiting for 180 seconds [0:03:00], retry every 5 seconds. (Function: utilities.general.get_not_running_pods  Kwargs: {'pods': [<ocp_resources.pod.Pod object at 0x7fbcda725fd0>, <ocp_resources.pod.Pod object at 0x7fbcda7267b0>, <ocp_resources.pod.Pod object at 0x7fbcda726e40>, <ocp_resources.pod.Pod object at 0x7fbcda726270>]})[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:13.450913Z[0m [[32m[1minfo     [0m] [1mElapsed time: 26.88802194595337 [0:00:26.888022][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:13.451170Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: model_registry_instance_rest_endpoint[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:17:13.507984Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: model_registry_client[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:17:13.604445Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: registered_model[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
PASSED[1m
TEST: TestModelRegistryCreation.test_registering_model[registered_model0] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[2m2026-07-02T06:17:14.123559Z[0m [[32m[1minfo     [0m] [1mDelete ModelRegistry model-registry0[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:17:14.185646Z[0m [[32m[1minfo     [0m] [1mDeleting {'apiVersion': 'modelregistry.opendatahub.io/v1beta1', 'kind': 'ModelRegistry', 'metadata': {'creationTimestamp': '2026-07-02T06:16:24Z', 'finalizers': ['modelregistry.opendatahub.io/finalizer'], 'generation': 1, 'labels': {'app.kubernetes.io/created-by': 'model-registry0', 'app.kubernetes.io/instance': 'model-registry0', 'app.kubernetes.io/name': 'model-registry0', 'app.kubernetes.io/part-of': 'model-registry0'}, 'managedFields': [{'apiVersion': 'modelregistry.opendatahub.io/v1beta1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:labels': {'.': {}, 'f:app.kubernetes.io/created-by': {}, 'f:app.kubernetes.io/instance': {}, 'f:app.kubernetes.io/name': {}, 'f:app.kubernetes.io/part-of': {}}}, 'f:spec': {'.': {}, 'f:kubeRBACProxy': {'.': {}, 'f:port': {}, 'f:routePort': {}, 'f:serviceRoute': {}}, 'f:mysql': {'.': {}, 'f:database': {}, 'f:host': {}, 'f:passwordSecret': {'.': {}, 'f:key': {}, 'f:name': {}}, 'f:port': {}, 'f:skipDBCreation': {}, 'f:username': {}}, 'f:rest': {'.': {}, 'f:port': {}, 'f:serviceRoute': {}}}}, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': '2026-07-02T06:16:24Z'}, {'apiVersion': 'modelregistry.opendatahub.io/v1beta1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:finalizers': {'.': {}, 'v:"modelregistry.opendatahub.io/finalizer"': {}}}}, 'manager': 'manager', 'operation': 'Update', 'time': '2026-07-02T06:16:24Z'}, {'apiVersion': 'modelregistry.opendatahub.io/v1beta1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'.': {}, 'f:conditions': {}, 'f:hosts': {}, 'f:hostsStr': {}, 'f:specDefaults': {}}}, 'manager': 'manager', 'operation': 'Update', 'subresource': 'status', 'time': '2026-07-02T06:16:45Z'}], 'name': 'model-registry0', 'namespace': 'rhoai-model-registries', 'resourceVersion': '11061998', 'uid': '702ce32d-965c-42ac-a27d-ab3285e6eb0e'}, 'spec': {'grpc': {'port': 9090}, 'kubeRBACProxy': {'port': 8443, 'routePort': 443, 'serviceRoute': 'enabled'}, 'mysql': {'database': 'model_registry', 'host': 'db-model-registry0.rhoai-model-registries.svc.cluster.local', 'passwordSecret': {'key': 'database-password', 'name': 'db-model-registry0'}, 'port': 3306, 'skipDBCreation': False, 'username': 'mlmduser'}, 'rest': {'port': 8080, 'serviceRoute': 'disabled'}}, 'status': {'conditions': [{'lastTransitionTime': '2026-07-02T06:16:25Z', 'message': 'Deployment was successfully created', 'reason': 'CreatedDeployment', 'status': 'False', 'type': 'Progressing'}, {'lastTransitionTime': '2026-07-02T06:16:45Z', 'message': 'Deployment is available', 'reason': 'DeploymentAvailable', 'status': 'True', 'type': 'Available'}, {'lastTransitionTime': '2026-07-02T06:16:45Z', 'message': 'kube-rbac-proxy was successfully created', 'reason': 'ResourcesAvailable', 'status': 'True', 'type': 'KubeRBACProxyAvailable'}], 'hosts': ['model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com', 'model-registry0.rhoai-model-registries.svc.cluster.local', 'model-registry0.rhoai-model-registries', 'model-registry0'], 'hostsStr': 'model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com,model-registry0.rhoai-model-registries.svc.cluster.local,model-registry0.rhoai-model-registries,model-registry0', 'specDefaults': '{"kubeRBACProxy":{"domain":"apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com","image":"registry.redhat.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:b7cafb9561936ea45769e77f0da365043d16e2a0b3d2c74921d31dd20133e696","tlsCertificateSecret":{"key":"tls.crt","name":"model-registry0-kube-rbac-proxy"},"tlsKeySecret":{"key":"tls.key","name":"model-registry0-kube-rbac-proxy"}},"rest":{"image":"registry.redhat.io/rhoai/odh-model-registry-rhel9@sha256:20b320f3b9c07438fd5e62eca18e5ba85f1d73e7a58159db74426211004e71af","resources":{"limits":{"memory":"256Mi"},"requests":{"cpu":"100m","memory":"256Mi"}}}}'}}[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:17:14.220490Z[0m [[32m[1minfo     [0m] [1mWait until ModelRegistry model-registry0 is deleted[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:17:14.220657Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:15.278781Z[0m [[32m[1minfo     [0m] [1mElapsed time: 1.0285568237304688 [0:00:01.028557][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:15.279069Z[0m [[32m[1minfo     [0m] [1mDelete Deployment db-model-registry0[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:17:15.345986Z[0m [[32m[1minfo     [0m] [1mDeleting {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'db-model-registry0', 'namespace': 'rhoai-model-registries', 'uid': '0a9bf000-8a75-4e9c-8152-1ba4ba06f392', 'resourceVersion': '11061601', 'generation': 1, 'creationTimestamp': '2026-07-02T06:16:02Z', 'labels': {'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'deployment.kubernetes.io/revision': '1', 'template.alpha.openshift.io/wait-for-ready': 'true'}, 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'apps/v1', 'time': '2026-07-02T06:16:02Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:template.alpha.openshift.io/wait-for-ready': {}}, 'f:labels': {'.': {}, 'f:app.kubernetes.io/instance': {}, 'f:app.kubernetes.io/name': {}, 'f:app.kubernetes.io/part-of': {}}}, 'f:spec': {'f:progressDeadlineSeconds': {}, 'f:replicas': {}, 'f:revisionHistoryLimit': {}, 'f:selector': {}, 'f:strategy': {'f:type': {}}, 'f:template': {'f:metadata': {'f:labels': {'.': {}, 'f:name': {}, 'f:sidecar.istio.io/inject': {}}}, 'f:spec': {'f:containers': {'k:{"name":"mysql"}': {'.': {}, 'f:args': {}, 'f:env': {'.': {}, 'k:{"name":"MYSQL_DATABASE"}': {'.': {}, 'f:name': {}, 'f:valueFrom': {'.': {}, 'f:secretKeyRef': {}}}, 'k:{"name":"MYSQL_PASSWORD"}': {'.': {}, 'f:name': {}, 'f:valueFrom': {'.': {}, 'f:secretKeyRef': {}}}, 'k:{"name":"MYSQL_ROOT_PASSWORD"}': {'.': {}, 'f:name': {}, 'f:valueFrom': {'.': {}, 'f:secretKeyRef': {}}}, 'k:{"name":"MYSQL_USER"}': {'.': {}, 'f:name': {}, 'f:valueFrom': {'.': {}, 'f:secretKeyRef': {}}}}, 'f:image': {}, 'f:imagePullPolicy': {}, 'f:livenessProbe': {'.': {}, 'f:exec': {'.': {}, 'f:command': {}}, 'f:failureThreshold': {}, 'f:initialDelaySeconds': {}, 'f:periodSeconds': {}, 'f:successThreshold': {}, 'f:timeoutSeconds': {}}, 'f:name': {}, 'f:ports': {'.': {}, 'k:{"containerPort":3306,"protocol":"TCP"}': {'.': {}, 'f:containerPort': {}, 'f:protocol': {}}}, 'f:readinessProbe': {'.': {}, 'f:exec': {'.': {}, 'f:command': {}}, 'f:failureThreshold': {}, 'f:initialDelaySeconds': {}, 'f:periodSeconds': {}, 'f:successThreshold': {}, 'f:timeoutSeconds': {}}, 'f:resources': {}, 'f:securityContext': {'.': {}, 'f:capabilities': {}, 'f:privileged': {}}, 'f:terminationMessagePath': {}, 'f:terminationMessagePolicy': {}, 'f:volumeMounts': {'.': {}, 'k:{"mountPath":"/var/lib/mysql"}': {'.': {}, 'f:mountPath': {}, 'f:name': {}}}}}, 'f:dnsPolicy': {}, 'f:restartPolicy': {}, 'f:schedulerName': {}, 'f:securityContext': {}, 'f:terminationGracePeriodSeconds': {}, 'f:volumes': {'.': {}, 'k:{"name":"db-model-registry0-data"}': {'.': {}, 'f:name': {}, 'f:persistentVolumeClaim': {'.': {}, 'f:claimName': {}}}}}}}}}, {'manager': 'kube-controller-manager', 'operation': 'Update', 'apiVersion': 'apps/v1', 'time': '2026-07-02T06:16:23Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:deployment.kubernetes.io/revision': {}}}, 'f:status': {'f:availableReplicas': {}, 'f:conditions': {'.': {}, 'k:{"type":"Available"}': {'.': {}, 'f:lastTransitionTime': {}, 'f:lastUpdateTime': {}, 'f:message': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}, 'k:{"type":"Progressing"}': {'.': {}, 'f:lastTransitionTime': {}, 'f:lastUpdateTime': {}, 'f:message': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}}, 'f:observedGeneration': {}, 'f:readyReplicas': {}, 'f:replicas': {}, 'f:updatedReplicas': {}}}, 'subresource': 'status'}]}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'name': 'db-model-registry0'}}, 'template': {'metadata': {'labels': {'name': 'db-model-registry0', 'sidecar.istio.io/inject': 'false'}}, 'spec': {'volumes': [{'name': 'db-model-registry0-data', 'persistentVolumeClaim': {'claimName': 'db-model-registry0'}}], 'containers': [{'name': 'mysql', 'image': 'public.ecr.aws/docker/library/mysql@sha256:28540698ce89bd72f985044de942d65bd99c6fadb2db105327db57f3f70564f0', 'args': ['--datadir', '/var/lib/mysql/datadir'], 'ports': [{'containerPort': 3306, 'protocol': 'TCP'}], 'env': [{'name': 'MYSQL_USER', 'valueFrom': {'secretKeyRef': {'name': 'db-model-registry0', 'key': 'database-user'}}}, {'name': 'MYSQL_PASSWORD', 'valueFrom': {'secretKeyRef': {'name': 'db-model-registry0', 'key': 'database-password'}}}, {'name': 'MYSQL_ROOT_PASSWORD', 'valueFrom': {'secretKeyRef': {'name': 'db-model-registry0', 'key': 'database-password'}}}, {'name': 'MYSQL_DATABASE', 'valueFrom': {'secretKeyRef': {'name': 'db-model-registry0', 'key': 'database-name'}}}], 'resources': {}, 'volumeMounts': [{'name': 'db-model-registry0-data', 'mountPath': '/var/lib/mysql'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '-c', 'mysqladmin -u${MYSQL_USER} -p${MYSQL_ROOT_PASSWORD} ping']}, 'initialDelaySeconds': 15, 'timeoutSeconds': 5, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '-c', 'mysql -D ${MYSQL_DATABASE} -u${MYSQL_USER} -p${MYSQL_ROOT_PASSWORD} -e "SELECT 1"']}, 'initialDelaySeconds': 10, 'timeoutSeconds': 5, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent', 'securityContext': {'capabilities': {}, 'privileged': False}}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'Recreate'}, 'revisionHistoryLimit': 0, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2026-07-02T06:16:23Z', 'lastTransitionTime': '2026-07-02T06:16:23Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2026-07-02T06:16:23Z', 'lastTransitionTime': '2026-07-02T06:16:03Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "db-model-registry0-865b4f5d6f" has successfully progressed.'}]}}[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:17:15.379430Z[0m [[32m[1minfo     [0m] [1mWait until Deployment db-model-registry0 is deleted[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:17:15.379615Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:15.413445Z[0m [[32m[1minfo     [0m] [1mElapsed time: 9.441375732421875e-05 [0:00:00.000094][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:15.413671Z[0m [[32m[1minfo     [0m] [1mDelete Service db-model-registry0[0m [[0m[1m[34mocp_resources Service[0m][0m
[2m2026-07-02T06:17:15.474860Z[0m [[32m[1minfo     [0m] [1mDeleting {'kind': 'Service', 'apiVersion': 'v1', 'metadata': {'name': 'db-model-registry0', 'namespace': 'rhoai-model-registries', 'uid': 'df52a1e5-50fc-4cb2-a68a-9bb7c19c1a93', 'resourceVersion': '11061223', 'creationTimestamp': '2026-07-02T06:16:02Z', 'labels': {'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'template.openshift.io/expose-uri': 'mysql://{.spec.clusterIP}:{.spec.ports[?(.name==\\mysql\\)].port}'}, 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-02T06:16:02Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:template.openshift.io/expose-uri': {}}, 'f:labels': {'.': {}, 'f:app.kubernetes.io/instance': {}, 'f:app.kubernetes.io/name': {}, 'f:app.kubernetes.io/part-of': {}}}, 'f:spec': {'f:internalTrafficPolicy': {}, 'f:ports': {'.': {}, 'k:{"port":3306,"protocol":"TCP"}': {'.': {}, 'f:appProtocol': {}, 'f:name': {}, 'f:port': {}, 'f:protocol': {}, 'f:targetPort': {}}}, 'f:selector': {}, 'f:sessionAffinity': {}, 'f:type': {}}}}]}, 'spec': {'ports': [{'name': 'mysql', 'protocol': 'TCP', 'appProtocol': 'tcp', 'port': 3306, 'targetPort': 3306}], 'selector': {'name': 'db-model-registry0'}, 'clusterIP': '172.30.246.211', 'clusterIPs': ['172.30.246.211'], 'type': 'ClusterIP', 'sessionAffinity': 'None', 'ipFamilies': ['IPv4'], 'ipFamilyPolicy': 'SingleStack', 'internalTrafficPolicy': 'Cluster'}, 'status': {'loadBalancer': {}}}[0m [[0m[1m[34mocp_resources Service[0m][0m
[2m2026-07-02T06:17:15.519911Z[0m [[32m[1minfo     [0m] [1mWait until Service db-model-registry0 is deleted[0m [[0m[1m[34mocp_resources Service[0m][0m
[2m2026-07-02T06:17:15.520071Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:15.549338Z[0m [[32m[1minfo     [0m] [1mElapsed time: 4.863739013671875e-05 [0:00:00.000049][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:15.549560Z[0m [[32m[1minfo     [0m] [1mDelete PersistentVolumeClaim db-model-registry0[0m [[0m[1m[34mocp_resources PersistentVolumeClaim[0m][0m
[2m2026-07-02T06:17:15.608569Z[0m [[32m[1minfo     [0m] [1mDeleting {'kind': 'PersistentVolumeClaim', 'apiVersion': 'v1', 'metadata': {'name': 'db-model-registry0', 'namespace': 'rhoai-model-registries', 'uid': '042dcdd3-a99f-4478-9308-876397b88347', 'resourceVersion': '11061286', 'creationTimestamp': '2026-07-02T06:16:02Z', 'labels': {'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'pv.kubernetes.io/bind-completed': 'yes', 'pv.kubernetes.io/bound-by-controller': 'yes', 'volume.beta.kubernetes.io/storage-provisioner': 'ebs.csi.aws.com', 'volume.kubernetes.io/selected-node': 'ip-10-0-1-105.us-east-2.compute.internal', 'volume.kubernetes.io/storage-provisioner': 'ebs.csi.aws.com'}, 'finalizers': ['kubernetes.io/pvc-protection'], 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-02T06:16:02Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:labels': {'.': {}, 'f:app.kubernetes.io/instance': {}, 'f:app.kubernetes.io/name': {}, 'f:app.kubernetes.io/part-of': {}}}, 'f:spec': {'f:accessModes': {}, 'f:resources': {'f:requests': {'.': {}, 'f:storage': {}}}, 'f:volumeMode': {}}}}, {'manager': 'kube-scheduler', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-02T06:16:03Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:volume.kubernetes.io/selected-node': {}}}}}, {'manager': 'kube-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-02T06:16:05Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:pv.kubernetes.io/bind-completed': {}, 'f:pv.kubernetes.io/bound-by-controller': {}, 'f:volume.beta.kubernetes.io/storage-provisioner': {}, 'f:volume.kubernetes.io/storage-provisioner': {}}}, 'f:spec': {'f:volumeName': {}}}}, {'manager': 'kube-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-02T06:16:05Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'f:accessModes': {}, 'f:capacity': {'.': {}, 'f:storage': {}}, 'f:phase': {}}}, 'subresource': 'status'}]}, 'spec': {'accessModes': ['ReadWriteOnce'], 'resources': {'requests': {'storage': '3Gi'}}, 'volumeName': 'pvc-042dcdd3-a99f-4478-9308-876397b88347', 'storageClassName': 'gp3-csi', 'volumeMode': 'Filesystem'}, 'status': {'phase': 'Bound', 'accessModes': ['ReadWriteOnce'], 'capacity': {'storage': '3Gi'}}}[0m [[0m[1m[34mocp_resources PersistentVolumeClaim[0m][0m
[2m2026-07-02T06:17:15.641778Z[0m [[32m[1minfo     [0m] [1mWait until PersistentVolumeClaim db-model-registry0 is deleted[0m [[0m[1m[34mocp_resources PersistentVolumeClaim[0m][0m
[2m2026-07-02T06:17:15.642052Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:17.732431Z[0m [[32m[1minfo     [0m] [1mElapsed time: 2.0598549842834473 [0:00:02.059855][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:17.732614Z[0m [[32m[1minfo     [0m] [1mDelete Secret db-model-registry0[0m [[0m[1m[34mocp_resources Secret[0m][0m
[2m2026-07-02T06:17:17.798554Z[0m [[32m[1minfo     [0m] [1mDeleting {'kind': 'Secret', 'apiVersion': 'v1', 'metadata': {'name': 'db-model-registry0', 'namespace': 'rhoai-model-registries', 'uid': 'ce4077da-0f11-4096-bcc8-3cd8ca0c3d55', 'resourceVersion': '11061216', 'creationTimestamp': '2026-07-02T06:16:02Z', 'labels': {'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'template.openshift.io/expose-database_name': "'{.data[''database-name'']}'", 'template.openshift.io/expose-password': "'{.data[''database-password'']}'", 'template.openshift.io/expose-username': "'{.data[''database-user'']}'"}, 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-02T06:16:02Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:data': {'.': {}, 'f:database-name': {}, 'f:database-password': {}, 'f:database-user': {}}, 'f:metadata': {'f:annotations': {'.': {}, 'f:template.openshift.io/expose-database_name': {}, 'f:template.openshift.io/expose-password': {}, 'f:template.openshift.io/expose-username': {}}, 'f:labels': {'.': {}, 'f:app.kubernetes.io/instance': {}, 'f:app.kubernetes.io/name': {}, 'f:app.kubernetes.io/part-of': {}}}, 'f:type': {}}}]}, 'data': '*******', 'type': 'Opaque'}[0m [[0m[1m[34mocp_resources Secret[0m][0m
[2m2026-07-02T06:17:17.838085Z[0m [[32m[1minfo     [0m] [1mWait until Secret db-model-registry0 is deleted[0m [[0m[1m[34mocp_resources Secret[0m][0m
[2m2026-07-02T06:17:17.838268Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m

_ 16 of 32 completed, 15 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_registry/rest_api/test_model_registry_rest_api.py::TestModelRegistryCreationRest::test_validate_model_registry_resource[test_validate_registered_model-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [2m2026-07-02T06:17:17.868459Z[0m [[32m[1minfo     [0m] [1mElapsed time: 5.602836608886719e-05 [0:00:00.000056][0m [[0m[1m[34mtimeout_sampler[0m][0m
[1m
 test_validate_model_registry_resource[test_validate_registered_model-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:17:17.872669Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: model_registry_metadata_db_resources[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:17:17.872993Z[0m [[32m[1minfo     [0m] [1mkind: Deployment api version: apps/v1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-07-02T06:17:17.869905Z[0m [[32m[1minfo     [0m] [1mCreating 1 <class 'ocp_resources.secret.Secret'> resources[0m [[0m[1m[34mtests.ai_hub.conftest[0m][0m [36mname[0m=[35mtests.ai_hub.conftest[0m
[2m2026-07-02T06:17:17.873271Z[0m [[32m[1minfo     [0m] [1mCreate Secret db-model-registry0[0m [[0m[1m[34mocp_resources Secret[0m][0m
[2m2026-07-02T06:17:17.873401Z[0m [[32m[1minfo     [0m] [1mPosting {'apiVersion': 'v1', 'kind': 'Secret', 'metadata': {'name': 'db-model-registry0', 'labels': {'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'template.openshift.io/expose-database_name': "'{.data[''database-name'']}'", 'template.openshift.io/expose-password': "'{.data[''database-password'']}'", 'template.openshift.io/expose-username': "'{.data[''database-user'']}'"}, 'namespace': 'rhoai-model-registries'}, 'stringData': '*******'}[0m [[0m[1m[34mocp_resources Secret[0m][0m
[2m2026-07-02T06:17:17.937648Z[0m [[32m[1minfo     [0m] [1mCreating 1 <class 'ocp_resources.persistent_volume_claim.PersistentVolumeClaim'> resources[0m [[0m[1m[34mtests.ai_hub.conftest[0m][0m [36mname[0m=[35mtests.ai_hub.conftest[0m
[2m2026-07-02T06:17:17.940031Z[0m [[32m[1minfo     [0m] [1mCreate PersistentVolumeClaim db-model-registry0[0m [[0m[1m[34mocp_resources PersistentVolumeClaim[0m][0m
[2m2026-07-02T06:17:17.940219Z[0m [[32m[1minfo     [0m] [1mPosting {'apiVersion': 'v1', 'kind': 'PersistentVolumeClaim', 'metadata': {'name': 'db-model-registry0', 'labels': {'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'namespace': 'rhoai-model-registries'}, 'spec': {'volumeMode': 'Filesystem', 'accessModes': ['ReadWriteOnce'], 'resources': {'requests': {'storage': '3Gi'}}}}[0m [[0m[1m[34mocp_resources PersistentVolumeClaim[0m][0m
[2m2026-07-02T06:17:18.003005Z[0m [[32m[1minfo     [0m] [1mCreating 1 <class 'ocp_resources.service.Service'> resources[0m [[0m[1m[34mtests.ai_hub.conftest[0m][0m [36mname[0m=[35mtests.ai_hub.conftest[0m
[2m2026-07-02T06:17:18.005440Z[0m [[32m[1minfo     [0m] [1mCreate Service db-model-registry0[0m [[0m[1m[34mocp_resources Service[0m][0m
[2m2026-07-02T06:17:18.005622Z[0m [[32m[1minfo     [0m] [1mPosting {'apiVersion': 'v1', 'kind': 'Service', 'metadata': {'name': 'db-model-registry0', 'labels': {'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'template.openshift.io/expose-uri': 'postgres://{.spec.clusterIP}:{.spec.ports[?(.name==\\postgres\\)].port}'}, 'namespace': 'rhoai-model-registries'}, 'spec': {'ports': [{'name': 'postgres', 'nodePort': 0, 'port': 5432, 'protocol': 'TCP', 'appProtocol': 'tcp', 'targetPort': 5432}], 'selector': {'name': 'db-model-registry0'}}}[0m [[0m[1m[34mocp_resources Service[0m][0m
[2m2026-07-02T06:17:18.073314Z[0m [[32m[1minfo     [0m] [1mCreating 1 <class 'ocp_resources.deployment.Deployment'> resources[0m [[0m[1m[34mtests.ai_hub.conftest[0m][0m [36mname[0m=[35mtests.ai_hub.conftest[0m
[2m2026-07-02T06:17:18.077127Z[0m [[32m[1minfo     [0m] [1mCreate Deployment db-model-registry0[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:17:18.077298Z[0m [[32m[1minfo     [0m] [1mPosting {'apiVersion': 'apps/v1', 'kind': 'Deployment', 'metadata': {'name': 'db-model-registry0', 'labels': {'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'template.alpha.openshift.io/wait-for-ready': 'true'}, 'namespace': 'rhoai-model-registries'}, 'spec': {'selector': {'matchLabels': {'name': 'db-model-registry0'}}, 'template': {'metadata': {'labels': {'name': 'db-model-registry0', 'sidecar.istio.io/inject': 'false'}}, 'spec': {'containers': [{'env': [{'name': 'POSTGRES_USER', 'valueFrom': {'secretKeyRef': {'key': 'database-user', 'name': 'db-model-registry0'}}}, {'name': 'POSTGRES_PASSWORD', 'valueFrom': {'secretKeyRef': {'key': 'database-password', 'name': 'db-model-registry0'}}}, {'name': 'POSTGRES_DB', 'valueFrom': {'secretKeyRef': {'key': 'database-name', 'name': 'db-model-registry0'}}}, {'name': 'PGDATA', 'value': '/var/lib/postgresql/data/pgdata'}], 'image': 'public.ecr.aws/docker/library/postgres@sha256:6e9bbed548cc1ca776dd4685cfea9efe60d58df91186ec6bad7328fd03b388a5', 'imagePullPolicy': 'IfNotPresent', 'livenessProbe': {'exec': {'command': ['bash', '-c', '/usr/bin/pg_isready -U $POSTGRES_USER -d $POSTGRES_DB']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 2}, 'readinessProbe': {'exec': {'command': ['bash', '-c', "psql -w -U $POSTGRES_USER -d $POSTGRES_DB -c 'SELECT 1'"]}, 'initialDelaySeconds': 10, 'timeoutSeconds': 5}, 'name': 'postgres', 'ports': [{'containerPort': 5432, 'protocol': 'TCP'}], 'securityContext': {'capabilities': {}, 'privileged': False}, 'terminationMessagePath': '/dev/termination-log', 'volumeMounts': [{'mountPath': '/var/lib/postgresql/data', 'name': 'db-model-registry0-postgres-data'}]}], 'dnsPolicy': 'ClusterFirst', 'restartPolicy': 'Always', 'volumes': [{'name': 'db-model-registry0-postgres-data', 'persistentVolumeClaim': {'claimName': 'db-model-registry0'}}]}}, 'replicas': 1, 'revisionHistoryLimit': 0, 'strategy': {'type': 'Recreate'}}}[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:17:18.156718Z[0m [[32m[1minfo     [0m] [1mWait until Deployment db-model-registry0 is created[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:17:18.157116Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:18.187110Z[0m [[32m[1minfo     [0m] [1mElapsed time: 6.103515625e-05 [0:00:00.000061][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:18.187287Z[0m [[32m[1minfo     [0m] [1mWait for Deployment db-model-registry0 to be deployed: True[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:17:18.187423Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.deployment.wait_for_replicas.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:18.221499Z[0m [[32m[1minfo     [0m] [1mElapsed time: 3.218650817871094e-05 [0:00:00.000032][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:18.221755Z[0m [[32m[1minfo     [0m] [1mWaiting for 239.96565318107605 seconds [0:03:59.965653], retry every 1 seconds. (Function: ocp_resources.deployment.wait_for_replicas.lambda: self.instance)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:36.630381Z[0m [[32m[1minfo     [0m] [1mElapsed time: 18.388067722320557 [0:00:18.388068][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:36.630615Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: model_registry_instance[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:17:36.630762Z[0m [[32m[1minfo     [0m] [1mkind: ModelRegistry api version: modelregistry.opendatahub.io/v1beta1[0m [[0m[1m[34mocp_resources.resource[0m][0m
[2m2026-07-02T06:17:36.630935Z[0m [[32m[1minfo     [0m] [1mCreate ModelRegistry model-registry0[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:17:36.631084Z[0m [[32m[1minfo     [0m] [1mPosting {'apiVersion': 'modelregistry.opendatahub.io/v1beta1', 'kind': 'ModelRegistry', 'metadata': {'name': 'model-registry0', 'labels': {'app.kubernetes.io/name': 'model-registry0', 'app.kubernetes.io/instance': 'model-registry0', 'app.kubernetes.io/part-of': 'model-registry0', 'app.kubernetes.io/created-by': 'model-registry0'}, 'namespace': 'rhoai-model-registries'}, 'spec': {'grpc': None, 'rest': {}, 'kubeRBACProxy': {}, 'postgres': {'host': 'db-model-registry0.rhoai-model-registries.svc.cluster.local', 'database': 'model_registry', 'passwordSecret': {'key': 'database-password', 'name': 'db-model-registry0'}, 'port': 5432, 'skipDBCreation': False, 'username': 'mlmduser'}}}[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:17:36.676406Z[0m [[32m[1minfo     [0m] [1mWait until ModelRegistry model-registry0 is created[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:17:36.676707Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:36.694611Z[0m [[32m[1minfo     [0m] [1mElapsed time: 9.036064147949219e-05 [0:00:00.000090][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:36.694805Z[0m [[32m[1minfo     [0m] [1mWait for ModelRegistry/model-registry0's 'Available' condition to be 'True'[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:17:36.695115Z[0m [[32m[1minfo     [0m] [1mWait until ModelRegistry model-registry0 is created[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:17:36.695362Z[0m [[32m[1minfo     [0m] [1mWaiting for 300 seconds [0:05:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:36.713541Z[0m [[32m[1minfo     [0m] [1mElapsed time: 5.221366882324219e-05 [0:00:00.000052][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:36.713749Z[0m [[32m[1minfo     [0m] [1mWaiting for 299.98110723495483 seconds [0:04:59.981107], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:53.041588Z[0m [[32m[1minfo     [0m] [1mElapsed time: 16.308269023895264 [0:00:16.308269][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:53.042140Z[0m [[32m[1minfo     [0m] [1mWait for ModelRegistry/model-registry0's 'KubeRBACProxyAvailable' condition to be 'True'[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:17:53.042308Z[0m [[32m[1minfo     [0m] [1mWait until ModelRegistry model-registry0 is created[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:17:53.042435Z[0m [[32m[1minfo     [0m] [1mWaiting for 300 seconds [0:05:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:53.059243Z[0m [[32m[1minfo     [0m] [1mElapsed time: 3.170967102050781e-05 [0:00:00.000032][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:53.059376Z[0m [[32m[1minfo     [0m] [1mWaiting for 299.98198890686035 seconds [0:04:59.981989], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:53.077334Z[0m [[32m[1minfo     [0m] [1mElapsed time: 3.886222839355469e-05 [0:00:00.000039][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:17:53.126897Z[0m [[32m[1minfo     [0m] [1mWaiting for 180 seconds [0:03:00], retry every 5 seconds. (Function: utilities.general.get_not_running_pods  Kwargs: {'pods': [<ocp_resources.pod.Pod object at 0x7fbcda727e00>, <ocp_resources.pod.Pod object at 0x7fbcda725fd0>, <ocp_resources.pod.Pod object at 0x7fbcda7270e0>, <ocp_resources.pod.Pod object at 0x7fbcda726270>]})[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:18:19.248847Z[0m [[32m[1minfo     [0m] [1mElapsed time: 25.973147869110107 [0:00:25.973148][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:18:19.249112Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: model_registry_instance_rest_endpoint[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:18:19.286382Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: model_registry_rest_url[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:18:19.286552Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: model_registry_rest_headers[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:18:19.286692Z[0m [[32m[1minfo     [0m] [1mExecuting class fixture: registered_model_rest_api[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:18:19.388876Z[0m [[32m[1minfo     [0m] [1murl: https://model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_registry/v1alpha3/registered_models, status code: 201, rep: {"createTimeSinceEpoch":"1782973099373","customProperties":{"test_rm_bool_property":{"bool_value":false,"metadataType":"MetadataBoolValue"},"test_rm_str_property":{"metadataType":"MetadataStringValue","string_value":"my_value"}},"description":"Model created via rest call","id":"1","lastUpdateTimeSinceEpoch":"1782973099373","name":"model-rest-api","owner":"opendatahub-tests","state":"LIVE"}
[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[2m2026-07-02T06:18:19.460183Z[0m [[32m[1minfo     [0m] [1murl: https://model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_registry/v1alpha3/model_versions, status code: 201, rep: {"author":"opendatahub-tests","createTimeSinceEpoch":"1782973099446","customProperties":{"test_mv_bool_property":{"bool_value":true,"metadataType":"MetadataBoolValue"},"test_mv_str_property":{"metadataType":"MetadataStringValue","string_value":"my_value"}},"description":"Model version created via rest call","id":"2","lastUpdateTimeSinceEpoch":"1782973099446","name":"v0.0.1","registeredModelId":"1","state":"LIVE"}
[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
PASSED
_ 17 of 32 completed, 16 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_registry/rest_api/test_model_registry_rest_api.py::TestModelRegistryCreationRest::test_validate_model_registry_resource[test_validate_model_version-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] PASSED
_ 18 of 32 completed, 17 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_registry/rest_api/test_model_registry_rest_api.py::TestModelRegistryCreationRest::test_validate_model_registry_resource[test_validate_model_artifact-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] PASSED
_ 19 of 32 completed, 18 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_registry/rest_api/test_model_registry_rest_api.py::TestModelRegistryCreationRest::test_model_registry_validate_api_version[model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [2m2026-07-02T06:18:19.598525Z[0m [[32m[1minfo     [0m] [1murl: https://model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_registry/v1alpha3/model_versions/2/artifacts, status code: 201, rep: {"artifactType":"model-artifact","createTimeSinceEpoch":"1782973099583","customProperties":{"test_ma_bool_property":{"bool_value":true,"metadataType":"MetadataBoolValue"},"test_ma_str_property":{"metadataType":"MetadataStringValue","string_value":"my_value"}},"description":"Model artifact created via rest call","id":"1","lastUpdateTimeSinceEpoch":"1782973099583","modelFormatName":"onnx","modelFormatVersion":"v1","name":"model-artifact-rest-api","state":"UNKNOWN","uri":"hf://jonburdo/test2"}
[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[2m2026-07-02T06:18:19.599301Z[0m [[32m[1minfo     [0m] [1mSuccessfully registered model: {'createTimeSinceEpoch': '1782973099373', 'customProperties': {'test_rm_bool_property': {'bool_value': False, 'metadataType': 'MetadataBoolValue'}, 'test_rm_str_property': {'metadataType': 'MetadataStringValue', 'string_value': 'my_value'}}, 'description': 'Model created via rest call', 'id': '1', 'lastUpdateTimeSinceEpoch': '1782973099373', 'name': 'model-rest-api', 'owner': 'opendatahub-tests', 'state': 'LIVE'}, with version: {'author': 'opendatahub-tests', 'createTimeSinceEpoch': '1782973099446', 'customProperties': {'test_mv_bool_property': {'bool_value': True, 'metadataType': 'MetadataBoolValue'}, 'test_mv_str_property': {'metadataType': 'MetadataStringValue', 'string_value': 'my_value'}}, 'description': 'Model version created via rest call', 'id': '2', 'lastUpdateTimeSinceEpoch': '1782973099446', 'name': 'v0.0.1', 'registeredModelId': '1', 'state': 'LIVE'} and associated artifact: {'artifactType': 'model-artifact', 'createTimeSinceEpoch': '1782973099583', 'customProperties': {'test_ma_bool_property': {'bool_value': True, 'metadataType': 'MetadataBoolValue'}, 'test_ma_str_property': {'metadataType': 'MetadataStringValue', 'string_value': 'my_value'}}, 'description': 'Model artifact created via rest call', 'id': '1', 'lastUpdateTimeSinceEpoch': '1782973099583', 'modelFormatName': 'onnx', 'modelFormatVersion': 'v1', 'name': 'model-artifact-rest-api', 'state': 'UNKNOWN', 'uri': 'hf://jonburdo/test2'}[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[2m2026-07-02T06:18:19.605620Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_params[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:18:19.605763Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: data_key[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:18:19.600204Z[0m [[32m[1minfo     [0m] [1mSuccessfully validated resource: register_model: model-rest-api[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[1m
TEST: TestModelRegistryCreationRest.test_validate_model_registry_resource[test_validate_registered_model-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
 test_validate_model_registry_resource[test_validate_model_version-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:18:19.606611Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_params[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:18:19.606719Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: data_key[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:18:19.602101Z[0m [[32m[1minfo     [0m] [1mSuccessfully validated resource: model_version: v0.0.1[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[1m
TEST: TestModelRegistryCreationRest.test_validate_model_registry_resource[test_validate_model_version-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
 test_validate_model_registry_resource[test_validate_model_artifact-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:18:19.607470Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_params[0m [[0m[1m[34mconftest[0m][0m
[2m2026-07-02T06:18:19.607580Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: data_key[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:18:19.603501Z[0m [[32m[1minfo     [0m] [1mSuccessfully validated resource: model_artifact: model-artifact-rest-api[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[1m
TEST: TestModelRegistryCreationRest.test_validate_model_registry_resource[test_validate_model_artifact-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
 test_model_registry_validate_api_version[model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
PASSED[2m2026-07-02T06:18:19.641019Z[0m [[32m[1minfo     [0m] [1mValidating apiversion modelregistry.opendatahub.io/v1beta1 for model registry[0m [[0m[1m[34m_pytest.compat[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.test_model_registry_rest_api[0m

_ 20 of 32 completed, 19 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_registry/rest_api/test_model_registry_rest_api.py::TestModelRegistryCreationRest::test_model_registry_validate_kuberbacproxy_enabled[model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [1m
TEST: TestModelRegistryCreationRest.test_model_registry_validate_api_version[model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
 test_model_registry_validate_kuberbacproxy_enabled[model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
PASSED
_ 21 of 32 completed, 20 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_registry/rest_api/test_model_registry_rest_api.py::TestModelRegistryCreationRest::test_create_update_model_artifact[test_validate_updated_artifact_description-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [2m2026-07-02T06:18:19.661245Z[0m [[32m[1minfo     [0m] [1mValidating that MR is using kubeRBAC proxy {'grpc': {'port': 9090},
 'kubeRBACProxy': {'port': 8443, 'routePort': 443, 'serviceRoute': 'enabled'},
 'postgres': {'database': 'model_registry',
 'host': 'db-model-registry0.rhoai-model-registries.svc.cluster.local',
 'passwordSecret': {'key': 'database-password', 'name': 'db-model-registry0'},
 'port': 5432,
 'skipDBCreation': False,
 'sslMode': 'disable',
 'username': 'mlmduser'},
 'rest': {'port': 8080, 'serviceRoute': 'disabled'}}[0m [[0m[1m[34m_pytest.compat[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.test_model_registry_rest_api[0m
[1m
TEST: TestModelRegistryCreationRest.test_model_registry_validate_kuberbacproxy_enabled[model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
 test_create_update_model_artifact[test_validate_updated_artifact_description-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:18:19.663754Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: updated_model_registry_resource[0m [[0m[1m[34mconftest[0m][0m
PASSED
_ 22 of 32 completed, 21 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_registry/rest_api/test_model_registry_rest_api.py::TestModelRegistryCreationRest::test_create_update_model_artifact[test_validate_updated_artifact_model_format_name-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [2m2026-07-02T06:18:19.747802Z[0m [[32m[1minfo     [0m] [1murl: https://model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_registry/v1alpha3/model_artifacts/1, status code: 200, rep: {"artifactType":"model-artifact","createTimeSinceEpoch":"1782973099583","customProperties":{"test_ma_bool_property":{"bool_value":true,"metadataType":"MetadataBoolValue"},"test_ma_str_property":{"metadataType":"MetadataStringValue","string_value":"my_value"}},"description":"updated artifact description","id":"1","lastUpdateTimeSinceEpoch":"1782973099734","modelFormatName":"onnx","modelFormatVersion":"v1","name":"model-artifact-rest-api","state":"UNKNOWN","uri":"hf://jonburdo/test2"}
[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[2m2026-07-02T06:18:19.750966Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_param[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:18:19.748781Z[0m [[32m[1minfo     [0m] [1mSuccessfully validated resource: model artifact: model-artifact-rest-api[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[1m
TEST: TestModelRegistryCreationRest.test_create_update_model_artifact[test_validate_updated_artifact_description-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
 test_create_update_model_artifact[test_validate_updated_artifact_model_format_name-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:18:19.751883Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: updated_model_registry_resource[0m [[0m[1m[34mconftest[0m][0m
PASSED
_ 23 of 32 completed, 22 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_registry/rest_api/test_model_registry_rest_api.py::TestModelRegistryCreationRest::test_create_update_model_artifact[test_validate_updated_artifact_model_format_version-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [2m2026-07-02T06:18:19.846207Z[0m [[32m[1minfo     [0m] [1murl: https://model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_registry/v1alpha3/model_artifacts/1, status code: 200, rep: {"artifactType":"model-artifact","createTimeSinceEpoch":"1782973099583","customProperties":{"test_ma_bool_property":{"bool_value":true,"metadataType":"MetadataBoolValue"},"test_ma_str_property":{"metadataType":"MetadataStringValue","string_value":"my_value"}},"description":"updated artifact description","id":"1","lastUpdateTimeSinceEpoch":"1782973099834","modelFormatName":"tensorflow","modelFormatVersion":"v1","name":"model-artifact-rest-api","state":"UNKNOWN","uri":"hf://jonburdo/test2"}
[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[2m2026-07-02T06:18:19.849193Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_param[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:18:19.847055Z[0m [[32m[1minfo     [0m] [1mSuccessfully validated resource: model artifact: model-artifact-rest-api[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[1m
TEST: TestModelRegistryCreationRest.test_create_update_model_artifact[test_validate_updated_artifact_model_format_name-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
 test_create_update_model_artifact[test_validate_updated_artifact_model_format_version-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:18:19.850405Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: updated_model_registry_resource[0m [[0m[1m[34mconftest[0m][0m
PASSED[2m2026-07-02T06:18:19.949183Z[0m [[32m[1minfo     [0m] [1murl: https://model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_registry/v1alpha3/model_artifacts/1, status code: 200, rep: {"artifactType":"model-artifact","createTimeSinceEpoch":"1782973099583","customProperties":{"test_ma_bool_property":{"bool_value":true,"metadataType":"MetadataBoolValue"},"test_ma_str_property":{"metadataType":"MetadataStringValue","string_value":"my_value"}},"description":"updated artifact description","id":"1","lastUpdateTimeSinceEpoch":"1782973099937","modelFormatName":"tensorflow","modelFormatVersion":"v2","name":"model-artifact-rest-api","state":"UNKNOWN","uri":"hf://jonburdo/test2"}
[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m

_ 24 of 32 completed, 23 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_registry/rest_api/test_model_registry_rest_api.py::TestModelRegistryCreationRest::test_updated_model_version[test_validate_updated_version_description-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [2m2026-07-02T06:18:19.952249Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_param[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:18:19.950151Z[0m [[32m[1minfo     [0m] [1mSuccessfully validated resource: model artifact: model-artifact-rest-api[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[1m
TEST: TestModelRegistryCreationRest.test_create_update_model_artifact[test_validate_updated_artifact_model_format_version-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
 test_updated_model_version[test_validate_updated_version_description-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:18:19.953152Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: updated_model_registry_resource[0m [[0m[1m[34mconftest[0m][0m
PASSED[2m2026-07-02T06:18:20.050334Z[0m [[32m[1minfo     [0m] [1murl: https://model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_registry/v1alpha3/model_versions/2, status code: 200, rep: {"author":"opendatahub-tests","createTimeSinceEpoch":"1782973099446","customProperties":{"test_mv_bool_property":{"bool_value":true,"metadataType":"MetadataBoolValue"},"test_mv_str_property":{"metadataType":"MetadataStringValue","string_value":"my_value"}},"description":"updated model version description","id":"2","lastUpdateTimeSinceEpoch":"1782973100035","name":"v0.0.1","registeredModelId":"1","state":"LIVE"}
[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m

_ 25 of 32 completed, 24 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_registry/rest_api/test_model_registry_rest_api.py::TestModelRegistryCreationRest::test_updated_model_version[test_validate_updated_version_state_archived-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [2m2026-07-02T06:18:20.054608Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_param[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:18:20.052019Z[0m [[32m[1minfo     [0m] [1mSuccessfully validated resource: model version: v0.0.1[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[1m
TEST: TestModelRegistryCreationRest.test_updated_model_version[test_validate_updated_version_description-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
 test_updated_model_version[test_validate_updated_version_state_archived-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:18:20.055481Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: updated_model_registry_resource[0m [[0m[1m[34mconftest[0m][0m
PASSED[2m2026-07-02T06:18:20.122110Z[0m [[32m[1minfo     [0m] [1murl: https://model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_registry/v1alpha3/model_versions/2, status code: 200, rep: {"author":"opendatahub-tests","createTimeSinceEpoch":"1782973099446","customProperties":{"test_mv_bool_property":{"bool_value":true,"metadataType":"MetadataBoolValue"},"test_mv_str_property":{"metadataType":"MetadataStringValue","string_value":"my_value"}},"description":"updated model version description","id":"2","lastUpdateTimeSinceEpoch":"1782973100109","name":"v0.0.1","registeredModelId":"1","state":"ARCHIVED"}
[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m

_ 26 of 32 completed, 25 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_registry/rest_api/test_model_registry_rest_api.py::TestModelRegistryCreationRest::test_updated_model_version[test_validate_updated_version_state_unarchived-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [2m2026-07-02T06:18:20.125538Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_param[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:18:20.123329Z[0m [[32m[1minfo     [0m] [1mSuccessfully validated resource: model version: v0.0.1[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[1m
TEST: TestModelRegistryCreationRest.test_updated_model_version[test_validate_updated_version_state_archived-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
 test_updated_model_version[test_validate_updated_version_state_unarchived-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:18:20.126409Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: updated_model_registry_resource[0m [[0m[1m[34mconftest[0m][0m
PASSED[2m2026-07-02T06:18:20.200771Z[0m [[32m[1minfo     [0m] [1murl: https://model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_registry/v1alpha3/model_versions/2, status code: 200, rep: {"author":"opendatahub-tests","createTimeSinceEpoch":"1782973099446","customProperties":{"test_mv_bool_property":{"bool_value":true,"metadataType":"MetadataBoolValue"},"test_mv_str_property":{"metadataType":"MetadataStringValue","string_value":"my_value"}},"description":"updated model version description","id":"2","lastUpdateTimeSinceEpoch":"1782973100188","name":"v0.0.1","registeredModelId":"1","state":"LIVE"}
[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m

_ 27 of 32 completed, 26 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_registry/rest_api/test_model_registry_rest_api.py::TestModelRegistryCreationRest::test_updated_model_version[test_validate_updated_version_custom_properties-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [2m2026-07-02T06:18:20.205722Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_param[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:18:20.202857Z[0m [[32m[1minfo     [0m] [1mSuccessfully validated resource: model version: v0.0.1[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[1m
TEST: TestModelRegistryCreationRest.test_updated_model_version[test_validate_updated_version_state_unarchived-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
 test_updated_model_version[test_validate_updated_version_custom_properties-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:18:20.206663Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: updated_model_registry_resource[0m [[0m[1m[34mconftest[0m][0m
PASSED[2m2026-07-02T06:18:20.263973Z[0m [[32m[1minfo     [0m] [1murl: https://model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_registry/v1alpha3/model_versions/2, status code: 200, rep: {"author":"opendatahub-tests","createTimeSinceEpoch":"1782973099446","customProperties":{"my_bool_property":{"bool_value":true,"metadataType":"MetadataBoolValue"},"my_double_property":{"double_value":500.01,"metadataType":"MetadataDoubleValue"},"my_str_property":{"metadataType":"MetadataStringValue","string_value":"my_value"}},"description":"updated model version description","id":"2","lastUpdateTimeSinceEpoch":"1782973100250","name":"v0.0.1","registeredModelId":"1","state":"LIVE"}
[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m

_ 28 of 32 completed, 27 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_registry/rest_api/test_model_registry_rest_api.py::TestModelRegistryCreationRest::test_updated_registered_model[test_validate_updated_model_description-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [2m2026-07-02T06:18:20.267881Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_param[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:18:20.265389Z[0m [[32m[1minfo     [0m] [1mSuccessfully validated resource: model version: v0.0.1[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[1m
TEST: TestModelRegistryCreationRest.test_updated_model_version[test_validate_updated_version_custom_properties-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
 test_updated_registered_model[test_validate_updated_model_description-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:18:20.268979Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: updated_model_registry_resource[0m [[0m[1m[34mconftest[0m][0m
PASSED[2m2026-07-02T06:18:20.374336Z[0m [[32m[1minfo     [0m] [1murl: https://model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_registry/v1alpha3/registered_models/1, status code: 200, rep: {"createTimeSinceEpoch":"1782973099373","customProperties":{"test_rm_bool_property":{"bool_value":false,"metadataType":"MetadataBoolValue"},"test_rm_str_property":{"metadataType":"MetadataStringValue","string_value":"my_value"}},"description":"updated registered model description","id":"1","lastUpdateTimeSinceEpoch":"1782973100362","name":"model-rest-api","owner":"opendatahub-tests","state":"LIVE"}
[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m

_ 29 of 32 completed, 28 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_registry/rest_api/test_model_registry_rest_api.py::TestModelRegistryCreationRest::test_updated_registered_model[test_validate_updated_model_state_archived-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [2m2026-07-02T06:18:20.378175Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_param[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:18:20.375725Z[0m [[32m[1minfo     [0m] [1mSuccessfully validated resource: registered model: model-rest-api[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[1m
TEST: TestModelRegistryCreationRest.test_updated_registered_model[test_validate_updated_model_description-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
 test_updated_registered_model[test_validate_updated_model_state_archived-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:18:20.379228Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: updated_model_registry_resource[0m [[0m[1m[34mconftest[0m][0m
PASSED
_ 30 of 32 completed, 29 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_registry/rest_api/test_model_registry_rest_api.py::TestModelRegistryCreationRest::test_updated_registered_model[test_validate_updated_model_state_unarchived-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [2m2026-07-02T06:18:20.437456Z[0m [[32m[1minfo     [0m] [1murl: https://model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_registry/v1alpha3/registered_models/1, status code: 200, rep: {"createTimeSinceEpoch":"1782973099373","customProperties":{"test_rm_bool_property":{"bool_value":false,"metadataType":"MetadataBoolValue"},"test_rm_str_property":{"metadataType":"MetadataStringValue","string_value":"my_value"}},"description":"updated registered model description","id":"1","lastUpdateTimeSinceEpoch":"1782973100425","name":"model-rest-api","owner":"opendatahub-tests","state":"ARCHIVED"}
[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[2m2026-07-02T06:18:20.440935Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_param[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:18:20.438571Z[0m [[32m[1minfo     [0m] [1mSuccessfully validated resource: registered model: model-rest-api[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[1m
TEST: TestModelRegistryCreationRest.test_updated_registered_model[test_validate_updated_model_state_archived-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
 test_updated_registered_model[test_validate_updated_model_state_unarchived-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:18:20.442127Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: updated_model_registry_resource[0m [[0m[1m[34mconftest[0m][0m
PASSED[2m2026-07-02T06:18:20.523012Z[0m [[32m[1minfo     [0m] [1murl: https://model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_registry/v1alpha3/registered_models/1, status code: 200, rep: {"createTimeSinceEpoch":"1782973099373","customProperties":{"test_rm_bool_property":{"bool_value":false,"metadataType":"MetadataBoolValue"},"test_rm_str_property":{"metadataType":"MetadataStringValue","string_value":"my_value"}},"description":"updated registered model description","id":"1","lastUpdateTimeSinceEpoch":"1782973100511","name":"model-rest-api","owner":"opendatahub-tests","state":"LIVE"}
[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m

_ 31 of 32 completed, 30 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _

tests/ai_hub/model_registry/rest_api/test_model_registry_rest_api.py::TestModelRegistryCreationRest::test_updated_registered_model[test_validate_updated_registered_model_custom_properties-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [2m2026-07-02T06:18:20.526180Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_param[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:18:20.524020Z[0m [[32m[1minfo     [0m] [1mSuccessfully validated resource: registered model: model-rest-api[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[1m
TEST: TestModelRegistryCreationRest.test_updated_registered_model[test_validate_updated_model_state_unarchived-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[1m
 test_updated_registered_model[test_validate_updated_registered_model_custom_properties-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] [0m
[1m-------------------------------------------------------- SETUP --------------------------------------------------------[0m
[2m2026-07-02T06:18:20.527003Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: updated_model_registry_resource[0m [[0m[1m[34mconftest[0m][0m
PASSED[2m2026-07-02T06:18:20.586157Z[0m [[32m[1minfo     [0m] [1murl: https://model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com:443/api/model_registry/v1alpha3/registered_models/1, status code: 200, rep: {"createTimeSinceEpoch":"1782973099373","customProperties":{"my_bool_property":{"bool_value":true,"metadataType":"MetadataBoolValue"},"my_double_property":{"double_value":500.01,"metadataType":"MetadataDoubleValue"},"my_str_property":{"metadataType":"MetadataStringValue","string_value":"my_value"}},"description":"updated registered model description","id":"1","lastUpdateTimeSinceEpoch":"1782973100573","name":"model-rest-api","owner":"opendatahub-tests","state":"LIVE"}
[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[2m2026-07-02T06:18:20.588530Z[0m [[32m[1minfo     [0m] [1mExecuting function fixture: expected_param[0m [[0m[1m[34mconftest[0m][0m
[1m--------------------------------------------------------- CALL ---------------------------------------------------------[0m
[2m2026-07-02T06:18:20.587007Z[0m [[32m[1minfo     [0m] [1mSuccessfully validated resource: registered model: model-rest-api[0m [[0m[1m[34mtests.ai_hub.model_registry.rest_api.utils[0m][0m [36mname[0m=[35mtests.ai_hub.model_registry.rest_api.utils[0m
[1m
TEST: TestModelRegistryCreationRest.test_updated_registered_model[test_validate_updated_registered_model_custom_properties-model_registry_metadata_db_resources1-model_registry_instance1-registered_model_rest_api1] STATUS: [0;32mPASSED[0m[0m
[1m------------------------------------------------------- TEARDOWN -------------------------------------------------------[0m
[2m2026-07-02T06:18:20.589175Z[0m [[32m[1minfo     [0m] [1mDelete ModelRegistry model-registry0[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:18:20.628714Z[0m [[32m[1minfo     [0m] [1mDeleting {'apiVersion': 'modelregistry.opendatahub.io/v1beta1', 'kind': 'ModelRegistry', 'metadata': {'creationTimestamp': '2026-07-02T06:17:36Z', 'finalizers': ['modelregistry.opendatahub.io/finalizer'], 'generation': 1, 'labels': {'app.kubernetes.io/created-by': 'model-registry0', 'app.kubernetes.io/instance': 'model-registry0', 'app.kubernetes.io/name': 'model-registry0', 'app.kubernetes.io/part-of': 'model-registry0'}, 'managedFields': [{'apiVersion': 'modelregistry.opendatahub.io/v1beta1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:labels': {'.': {}, 'f:app.kubernetes.io/created-by': {}, 'f:app.kubernetes.io/instance': {}, 'f:app.kubernetes.io/name': {}, 'f:app.kubernetes.io/part-of': {}}}, 'f:spec': {'.': {}, 'f:kubeRBACProxy': {'.': {}, 'f:port': {}, 'f:routePort': {}, 'f:serviceRoute': {}}, 'f:postgres': {'.': {}, 'f:database': {}, 'f:host': {}, 'f:passwordSecret': {'.': {}, 'f:key': {}, 'f:name': {}}, 'f:port': {}, 'f:skipDBCreation': {}, 'f:sslMode': {}, 'f:username': {}}, 'f:rest': {'.': {}, 'f:port': {}, 'f:serviceRoute': {}}}}, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': '2026-07-02T06:17:36Z'}, {'apiVersion': 'modelregistry.opendatahub.io/v1beta1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:finalizers': {'.': {}, 'v:"modelregistry.opendatahub.io/finalizer"': {}}}}, 'manager': 'manager', 'operation': 'Update', 'time': '2026-07-02T06:17:36Z'}, {'apiVersion': 'modelregistry.opendatahub.io/v1beta1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'.': {}, 'f:conditions': {}, 'f:hosts': {}, 'f:hostsStr': {}, 'f:specDefaults': {}}}, 'manager': 'manager', 'operation': 'Update', 'subresource': 'status', 'time': '2026-07-02T06:17:52Z'}], 'name': 'model-registry0', 'namespace': 'rhoai-model-registries', 'resourceVersion': '11063237', 'uid': '40ea8372-74ce-45a0-837d-317810ff61d5'}, 'spec': {'grpc': {'port': 9090}, 'kubeRBACProxy': {'port': 8443, 'routePort': 443, 'serviceRoute': 'enabled'}, 'postgres': {'database': 'model_registry', 'host': 'db-model-registry0.rhoai-model-registries.svc.cluster.local', 'passwordSecret': {'key': 'database-password', 'name': 'db-model-registry0'}, 'port': 5432, 'skipDBCreation': False, 'sslMode': 'disable', 'username': 'mlmduser'}, 'rest': {'port': 8080, 'serviceRoute': 'disabled'}}, 'status': {'conditions': [{'lastTransitionTime': '2026-07-02T06:17:37Z', 'message': 'Deployment was successfully created', 'reason': 'CreatedDeployment', 'status': 'False', 'type': 'Progressing'}, {'lastTransitionTime': '2026-07-02T06:17:52Z', 'message': 'Deployment is available', 'reason': 'DeploymentAvailable', 'status': 'True', 'type': 'Available'}, {'lastTransitionTime': '2026-07-02T06:17:52Z', 'message': 'kube-rbac-proxy was successfully created', 'reason': 'ResourcesAvailable', 'status': 'True', 'type': 'KubeRBACProxyAvailable'}], 'hosts': ['model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com', 'model-registry0.rhoai-model-registries.svc.cluster.local', 'model-registry0.rhoai-model-registries', 'model-registry0'], 'hostsStr': 'model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com,model-registry0.rhoai-model-registries.svc.cluster.local,model-registry0.rhoai-model-registries,model-registry0', 'specDefaults': '{"kubeRBACProxy":{"domain":"apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com","image":"registry.redhat.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:b7cafb9561936ea45769e77f0da365043d16e2a0b3d2c74921d31dd20133e696","tlsCertificateSecret":{"key":"tls.crt","name":"model-registry0-kube-rbac-proxy"},"tlsKeySecret":{"key":"tls.key","name":"model-registry0-kube-rbac-proxy"}},"postgres":{"image":"registry.redhat.io/rhel9/postgresql-16@sha256:c2ac59c92d6629864210164d6899ddc021be8933d4a5ec262c659a38a20b670d"},"rest":{"image":"registry.redhat.io/rhoai/odh-model-registry-rhel9@sha256:20b320f3b9c07438fd5e62eca18e5ba85f1d73e7a58159db74426211004e71af","resources":{"limits":{"memory":"256Mi"},"requests":{"cpu":"100m","memory":"256Mi"}}}}'}}[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:18:20.653359Z[0m [[32m[1minfo     [0m] [1mWait until ModelRegistry model-registry0 is deleted[0m [[0m[1m[34mocp_resources ModelRegistry[0m][0m
[2m2026-07-02T06:18:20.653521Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:18:21.692399Z[0m [[32m[1minfo     [0m] [1mElapsed time: 1.0184931755065918 [0:00:01.018493][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:18:21.692578Z[0m [[32m[1minfo     [0m] [1mDelete Deployment db-model-registry0[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:18:21.736622Z[0m [[32m[1minfo     [0m] [1mDeleting {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'db-model-registry0', 'namespace': 'rhoai-model-registries', 'uid': '03b465fd-bb81-4e01-a8bf-4a1dc92c4f42', 'resourceVersion': '11062908', 'generation': 1, 'creationTimestamp': '2026-07-02T06:17:18Z', 'labels': {'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'deployment.kubernetes.io/revision': '1', 'template.alpha.openshift.io/wait-for-ready': 'true'}, 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'apps/v1', 'time': '2026-07-02T06:17:18Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:template.alpha.openshift.io/wait-for-ready': {}}, 'f:labels': {'.': {}, 'f:app.kubernetes.io/instance': {}, 'f:app.kubernetes.io/name': {}, 'f:app.kubernetes.io/part-of': {}}}, 'f:spec': {'f:progressDeadlineSeconds': {}, 'f:replicas': {}, 'f:revisionHistoryLimit': {}, 'f:selector': {}, 'f:strategy': {'f:type': {}}, 'f:template': {'f:metadata': {'f:labels': {'.': {}, 'f:name': {}, 'f:sidecar.istio.io/inject': {}}}, 'f:spec': {'f:containers': {'k:{"name":"postgres"}': {'.': {}, 'f:env': {'.': {}, 'k:{"name":"PGDATA"}': {'.': {}, 'f:name': {}, 'f:value': {}}, 'k:{"name":"POSTGRES_DB"}': {'.': {}, 'f:name': {}, 'f:valueFrom': {'.': {}, 'f:secretKeyRef': {}}}, 'k:{"name":"POSTGRES_PASSWORD"}': {'.': {}, 'f:name': {}, 'f:valueFrom': {'.': {}, 'f:secretKeyRef': {}}}, 'k:{"name":"POSTGRES_USER"}': {'.': {}, 'f:name': {}, 'f:valueFrom': {'.': {}, 'f:secretKeyRef': {}}}}, 'f:image': {}, 'f:imagePullPolicy': {}, 'f:livenessProbe': {'.': {}, 'f:exec': {'.': {}, 'f:command': {}}, 'f:failureThreshold': {}, 'f:initialDelaySeconds': {}, 'f:periodSeconds': {}, 'f:successThreshold': {}, 'f:timeoutSeconds': {}}, 'f:name': {}, 'f:ports': {'.': {}, 'k:{"containerPort":5432,"protocol":"TCP"}': {'.': {}, 'f:containerPort': {}, 'f:protocol': {}}}, 'f:readinessProbe': {'.': {}, 'f:exec': {'.': {}, 'f:command': {}}, 'f:failureThreshold': {}, 'f:initialDelaySeconds': {}, 'f:periodSeconds': {}, 'f:successThreshold': {}, 'f:timeoutSeconds': {}}, 'f:resources': {}, 'f:securityContext': {'.': {}, 'f:capabilities': {}, 'f:privileged': {}}, 'f:terminationMessagePath': {}, 'f:terminationMessagePolicy': {}, 'f:volumeMounts': {'.': {}, 'k:{"mountPath":"/var/lib/postgresql/data"}': {'.': {}, 'f:mountPath': {}, 'f:name': {}}}}}, 'f:dnsPolicy': {}, 'f:restartPolicy': {}, 'f:schedulerName': {}, 'f:securityContext': {}, 'f:terminationGracePeriodSeconds': {}, 'f:volumes': {'.': {}, 'k:{"name":"db-model-registry0-postgres-data"}': {'.': {}, 'f:name': {}, 'f:persistentVolumeClaim': {'.': {}, 'f:claimName': {}}}}}}}}}, {'manager': 'kube-controller-manager', 'operation': 'Update', 'apiVersion': 'apps/v1', 'time': '2026-07-02T06:17:36Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:deployment.kubernetes.io/revision': {}}}, 'f:status': {'f:availableReplicas': {}, 'f:conditions': {'.': {}, 'k:{"type":"Available"}': {'.': {}, 'f:lastTransitionTime': {}, 'f:lastUpdateTime': {}, 'f:message': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}, 'k:{"type":"Progressing"}': {'.': {}, 'f:lastTransitionTime': {}, 'f:lastUpdateTime': {}, 'f:message': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}}, 'f:observedGeneration': {}, 'f:readyReplicas': {}, 'f:replicas': {}, 'f:updatedReplicas': {}}}, 'subresource': 'status'}]}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'name': 'db-model-registry0'}}, 'template': {'metadata': {'labels': {'name': 'db-model-registry0', 'sidecar.istio.io/inject': 'false'}}, 'spec': {'volumes': [{'name': 'db-model-registry0-postgres-data', 'persistentVolumeClaim': {'claimName': 'db-model-registry0'}}], 'containers': [{'name': 'postgres', 'image': 'public.ecr.aws/docker/library/postgres@sha256:6e9bbed548cc1ca776dd4685cfea9efe60d58df91186ec6bad7328fd03b388a5', 'ports': [{'containerPort': 5432, 'protocol': 'TCP'}], 'env': [{'name': 'POSTGRES_USER', 'valueFrom': {'secretKeyRef': {'name': 'db-model-registry0', 'key': 'database-user'}}}, {'name': 'POSTGRES_PASSWORD', 'valueFrom': {'secretKeyRef': {'name': 'db-model-registry0', 'key': 'database-password'}}}, {'name': 'POSTGRES_DB', 'valueFrom': {'secretKeyRef': {'name': 'db-model-registry0', 'key': 'database-name'}}}, {'name': 'PGDATA', 'value': '/var/lib/postgresql/data/pgdata'}], 'resources': {}, 'volumeMounts': [{'name': 'db-model-registry0-postgres-data', 'mountPath': '/var/lib/postgresql/data'}], 'livenessProbe': {'exec': {'command': ['bash', '-c', '/usr/bin/pg_isready -U $POSTGRES_USER -d $POSTGRES_DB']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 2, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['bash', '-c', "psql -w -U $POSTGRES_USER -d $POSTGRES_DB -c 'SELECT 1'"]}, 'initialDelaySeconds': 10, 'timeoutSeconds': 5, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent', 'securityContext': {'capabilities': {}, 'privileged': False}}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'Recreate'}, 'revisionHistoryLimit': 0, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2026-07-02T06:17:36Z', 'lastTransitionTime': '2026-07-02T06:17:36Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2026-07-02T06:17:36Z', 'lastTransitionTime': '2026-07-02T06:17:18Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "db-model-registry0-6f7df78c54" has successfully progressed.'}]}}[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:18:21.762583Z[0m [[32m[1minfo     [0m] [1mWait until Deployment db-model-registry0 is deleted[0m [[0m[1m[34mocp_resources Deployment[0m][0m
[2m2026-07-02T06:18:21.762752Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:18:21.781720Z[0m [[32m[1minfo     [0m] [1mElapsed time: 4.982948303222656e-05 [0:00:00.000050][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:18:21.781960Z[0m [[32m[1minfo     [0m] [1mDelete Service db-model-registry0[0m [[0m[1m[34mocp_resources Service[0m][0m
[2m2026-07-02T06:18:21.824510Z[0m [[32m[1minfo     [0m] [1mDeleting {'kind': 'Service', 'apiVersion': 'v1', 'metadata': {'name': 'db-model-registry0', 'namespace': 'rhoai-model-registries', 'uid': '4c176376-39ad-4304-b357-cbcc3dd68941', 'resourceVersion': '11062563', 'creationTimestamp': '2026-07-02T06:17:18Z', 'labels': {'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'template.openshift.io/expose-uri': 'postgres://{.spec.clusterIP}:{.spec.ports[?(.name==\\postgres\\)].port}'}, 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-02T06:17:18Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:template.openshift.io/expose-uri': {}}, 'f:labels': {'.': {}, 'f:app.kubernetes.io/instance': {}, 'f:app.kubernetes.io/name': {}, 'f:app.kubernetes.io/part-of': {}}}, 'f:spec': {'f:internalTrafficPolicy': {}, 'f:ports': {'.': {}, 'k:{"port":5432,"protocol":"TCP"}': {'.': {}, 'f:appProtocol': {}, 'f:name': {}, 'f:port': {}, 'f:protocol': {}, 'f:targetPort': {}}}, 'f:selector': {}, 'f:sessionAffinity': {}, 'f:type': {}}}}]}, 'spec': {'ports': [{'name': 'postgres', 'protocol': 'TCP', 'appProtocol': 'tcp', 'port': 5432, 'targetPort': 5432}], 'selector': {'name': 'db-model-registry0'}, 'clusterIP': '172.30.126.11', 'clusterIPs': ['172.30.126.11'], 'type': 'ClusterIP', 'sessionAffinity': 'None', 'ipFamilies': ['IPv4'], 'ipFamilyPolicy': 'SingleStack', 'internalTrafficPolicy': 'Cluster'}, 'status': {'loadBalancer': {}}}[0m [[0m[1m[34mocp_resources Service[0m][0m
[2m2026-07-02T06:18:21.857515Z[0m [[32m[1minfo     [0m] [1mWait until Service db-model-registry0 is deleted[0m [[0m[1m[34mocp_resources Service[0m][0m
[2m2026-07-02T06:18:21.857676Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:18:21.876543Z[0m [[32m[1minfo     [0m] [1mElapsed time: 0.00012612342834472656 [0:00:00.000126][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:18:21.876753Z[0m [[32m[1minfo     [0m] [1mDelete PersistentVolumeClaim db-model-registry0[0m [[0m[1m[34mocp_resources PersistentVolumeClaim[0m][0m
[2m2026-07-02T06:18:21.915046Z[0m [[32m[1minfo     [0m] [1mDeleting {'kind': 'PersistentVolumeClaim', 'apiVersion': 'v1', 'metadata': {'name': 'db-model-registry0', 'namespace': 'rhoai-model-registries', 'uid': 'fede2f2e-8cd1-4934-9aee-00d3bcb2b9ca', 'resourceVersion': '11062621', 'creationTimestamp': '2026-07-02T06:17:17Z', 'labels': {'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'pv.kubernetes.io/bind-completed': 'yes', 'pv.kubernetes.io/bound-by-controller': 'yes', 'volume.beta.kubernetes.io/storage-provisioner': 'ebs.csi.aws.com', 'volume.kubernetes.io/selected-node': 'ip-10-0-1-105.us-east-2.compute.internal', 'volume.kubernetes.io/storage-provisioner': 'ebs.csi.aws.com'}, 'finalizers': ['kubernetes.io/pvc-protection'], 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-02T06:17:17Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:labels': {'.': {}, 'f:app.kubernetes.io/instance': {}, 'f:app.kubernetes.io/name': {}, 'f:app.kubernetes.io/part-of': {}}}, 'f:spec': {'f:accessModes': {}, 'f:resources': {'f:requests': {'.': {}, 'f:storage': {}}}, 'f:volumeMode': {}}}}, {'manager': 'kube-scheduler', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-02T06:17:18Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:volume.kubernetes.io/selected-node': {}}}}}, {'manager': 'kube-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-02T06:17:20Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:pv.kubernetes.io/bind-completed': {}, 'f:pv.kubernetes.io/bound-by-controller': {}, 'f:volume.beta.kubernetes.io/storage-provisioner': {}, 'f:volume.kubernetes.io/storage-provisioner': {}}}, 'f:spec': {'f:volumeName': {}}}}, {'manager': 'kube-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-02T06:17:20Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'f:accessModes': {}, 'f:capacity': {'.': {}, 'f:storage': {}}, 'f:phase': {}}}, 'subresource': 'status'}]}, 'spec': {'accessModes': ['ReadWriteOnce'], 'resources': {'requests': {'storage': '3Gi'}}, 'volumeName': 'pvc-fede2f2e-8cd1-4934-9aee-00d3bcb2b9ca', 'storageClassName': 'gp3-csi', 'volumeMode': 'Filesystem'}, 'status': {'phase': 'Bound', 'accessModes': ['ReadWriteOnce'], 'capacity': {'storage': '3Gi'}}}[0m [[0m[1m[34mocp_resources PersistentVolumeClaim[0m][0m
[2m2026-07-02T06:18:21.937703Z[0m [[32m[1minfo     [0m] [1mWait until PersistentVolumeClaim db-model-registry0 is deleted[0m [[0m[1m[34mocp_resources PersistentVolumeClaim[0m][0m
[2m2026-07-02T06:18:21.937951Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:18:22.975624Z[0m [[32m[1minfo     [0m] [1mElapsed time: 1.017972707748413 [0:00:01.017973][0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:18:22.975895Z[0m [[32m[1minfo     [0m] [1mDelete Secret db-model-registry0[0m [[0m[1m[34mocp_resources Secret[0m][0m
[2m2026-07-02T06:18:23.021357Z[0m [[32m[1minfo     [0m] [1mDeleting {'kind': 'Secret', 'apiVersion': 'v1', 'metadata': {'name': 'db-model-registry0', 'namespace': 'rhoai-model-registries', 'uid': '9c725782-52cf-4c38-bc3a-bf6cb48ca46f', 'resourceVersion': '11062554', 'creationTimestamp': '2026-07-02T06:17:17Z', 'labels': {'app.kubernetes.io/instance': 'db-model-registry0', 'app.kubernetes.io/name': 'db-model-registry0', 'app.kubernetes.io/part-of': 'db-model-registry0'}, 'annotations': {'template.openshift.io/expose-database_name': "'{.data[''database-name'']}'", 'template.openshift.io/expose-password': "'{.data[''database-password'']}'", 'template.openshift.io/expose-username': "'{.data[''database-user'']}'"}, 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-02T06:17:17Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:data': {'.': {}, 'f:database-name': {}, 'f:database-password': {}, 'f:database-user': {}}, 'f:metadata': {'f:annotations': {'.': {}, 'f:template.openshift.io/expose-database_name': {}, 'f:template.openshift.io/expose-password': {}, 'f:template.openshift.io/expose-username': {}}, 'f:labels': {'.': {}, 'f:app.kubernetes.io/instance': {}, 'f:app.kubernetes.io/name': {}, 'f:app.kubernetes.io/part-of': {}}}, 'f:type': {}}}]}, 'data': '*******', 'type': 'Opaque'}[0m [[0m[1m[34mocp_resources Secret[0m][0m
[2m2026-07-02T06:18:26.548253Z[0m [[32m[1minfo     [0m] [1mWait until Secret db-model-registry0 is deleted[0m [[0m[1m[34mocp_resources Secret[0m][0m
[2m2026-07-02T06:18:26.548408Z[0m [[32m[1minfo     [0m] [1mWaiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists)[0m [[0m[1m[34mtimeout_sampler[0m][0m
[2m2026-07-02T06:18:26.568515Z[0m [[32m[1minfo     [0m] [1mElapsed time: 5.364418029785156e-05 [0:00:00.000054][0m [[0m[1m[34mtimeout_sampler[0m][0m

_ 32 of 32 completed, 31 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _
==== 1 failed, 31 passed, 441 deselected, 39 warnings in 315.00s (0:05:14) =====

=================================== FAILURES ===================================
_ TestModelRegistryImages.test_verify_model_registry_pod_images[model_registry_metadata_db_resources0-model_registry_instance0-model_registry_instance_pods_by_label0] _
Traceback (most recent call last):
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call
    result: TResult | None = func()
                             ~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in <lambda>
    lambda: runtest_hook(item=item, **kwds),
            ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper
    return result.get_result()
           ~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result
    raise exc.with_traceback(tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper
    res = yield
          ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call
    return (yield)
            ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 179, in pytest_runtest_call
    item.runtest()
    ~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1720, in runtest
    self.ihook.pytest_pyfunc_call(pyfuncitem=self)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall
    raise exception
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall
    teardown.throw(exception)
    ~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper
    return result.get_result()
           ~~~~~~~~~~~~~~~~~^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result
    raise exc.with_traceback(tb)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper
    res = yield
          ^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall
    res = hook_impl.function(*args)
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 166, in pytest_pyfunc_call
    result = testfunction(**testargs)
  File "/home/odh/opendatahub-tests/tests/ai_hub/image_validation/test_verify_rhoai_images.py", line 102, in test_verify_model_registry_pod_images
    validate_images(pods_to_validate=model_registry_instance_pods_by_label, related_images_refs=related_images_refs)
    ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/tests/ai_hub/image_validation/utils.py", line 22, in validate_images
    pytest.fail("\n".join(validation_errors))
    ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/outcomes.py", line 163, in __call__
    raise Failed(msg=reason, pytrace=pytrace)
Failed: Pod model-registry0-57764fb5cf-bpvrw in namespace: rhoai-model-registries image validation failed: Image quay.io/rhoai/odh-model-registry-rhel9@sha256:20b320f3b9c07438fd5e62eca18e5ba85f1d73e7a58159db74426211004e71af is not from registry.redhat.io
Pod model-registry0-57764fb5cf-bpvrw, namespace: rhoai-model-registries image quay.io/rhoai/odh-model-registry-rhel9@sha256:20b320f3b9c07438fd5e62eca18e5ba85f1d73e7a58159db74426211004e71af is not in valid image references
Pod model-registry0-57764fb5cf-bpvrw in namespace: rhoai-model-registries image validation failed: Image quay.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:b7cafb9561936ea45769e77f0da365043d16e2a0b3d2c74921d31dd20133e696 is not from registry.redhat.io
Pod model-registry0-57764fb5cf-bpvrw, namespace: rhoai-model-registries image quay.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:b7cafb9561936ea45769e77f0da365043d16e2a0b3d2c74921d31dd20133e696 is not in valid image references
=============================== warnings summary ===============================
tests/ai_hub/model_catalog/catalog_config/test_serving_config_validated_tasks.py:89
  /home/odh/opendatahub-tests/tests/ai_hub/model_catalog/catalog_config/test_serving_config_validated_tasks.py:89: PytestUnknownMarkWarning: Unknown pytest.mark.jira - is this a typo?  You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
    @pytest.mark.jira("RHOAIENG-60668")

tests/ai_hub/model_catalog/db_check/test_model_catalog_db_validation.py:100
  /home/odh/opendatahub-tests/tests/ai_hub/model_catalog/db_check/test_model_catalog_db_validation.py:100: PytestUnknownMarkWarning: Unknown pytest.mark.test_postgres_network_policy_only - is this a typo?  You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
    @pytest.mark.test_postgres_network_policy_only

tests/ai_hub/model_catalog/db_check/test_model_catalog_db_validation.py:111
  /home/odh/opendatahub-tests/tests/ai_hub/model_catalog/db_check/test_model_catalog_db_validation.py:111: PytestUnknownMarkWarning: Unknown pytest.mark.test_postgres_network_policy_only - is this a typo?  You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
    @pytest.mark.test_postgres_network_policy_only

tests/ai_hub/model_catalog/db_check/test_model_catalog_db_validation.py:119
  /home/odh/opendatahub-tests/tests/ai_hub/model_catalog/db_check/test_model_catalog_db_validation.py:119: PytestUnknownMarkWarning: Unknown pytest.mark.test_https_route_network_policy_only - is this a typo?  You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
    @pytest.mark.test_https_route_network_policy_only

.venv/lib64/python3.14/site-packages/requests/auth.py:45
.venv/lib64/python3.14/site-packages/requests/auth.py:45
.venv/lib64/python3.14/site-packages/requests/auth.py:45
.venv/lib64/python3.14/site-packages/requests/auth.py:45
  /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/requests/auth.py:45: DeprecationWarning: Non-string usernames will no longer be supported in Requests 3.0.0. Please convert the object you've passed in (None) to a string or bytes object in the near future to avoid problems.
    warnings.warn(

.venv/lib64/python3.14/site-packages/requests/auth.py:55
.venv/lib64/python3.14/site-packages/requests/auth.py:55
.venv/lib64/python3.14/site-packages/requests/auth.py:55
.venv/lib64/python3.14/site-packages/requests/auth.py:55
  /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/requests/auth.py:55: DeprecationWarning: Non-string passwords will no longer be supported in Requests 3.0.0. Please convert the object you've passed in (<class 'NoneType'>) to a string or bytes object in the near future to avoid problems.
    warnings.warn(

tests/ai_hub/mcp_servers/config/test_default_mcp.py: 1 warning
tests/ai_hub/mcp_servers/config/test_source_label.py: 4 warnings
tests/ai_hub/model_catalog/metadata/test_labels_endpoint.py: 3 warnings
tests/ai_hub/model_catalog/search/test_model_search.py: 5 warnings
  /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'model-catalog.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings
    warnings.warn(

tests/ai_hub/model_registry/rest_api/test_model_registry_rest_api.py: 14 warnings
  /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'model-registry0-rest.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings
    warnings.warn(

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: /workspace/tests-shared/tests-payload/results/ai-hub-smoke.xml -
=========================== short test summary info ============================
FAILED tests/ai_hub/image_validation/test_verify_rhoai_images.py::TestModelRegistryImages::test_verify_model_registry_pod_images[model_registry_metadata_db_resources0-model_registry_instance0-model_registry_instance_pods_by_label0] - Failed: Pod model-registry0-57764fb5cf-bpvrw in namespace: rhoai-model-registries image validation failed: Image quay.io/rhoai/odh-model-registry-rhel9@sha256:20b320f3b9c07438fd5e62eca18e5ba85f1d73e7a58159db74426211004e71af is not from registry.redhat.io
Pod model-registry0-57764fb5cf-bpvrw, namespace: rhoai-model-registries image quay.io/rhoai/odh-model-registry-rhel9@sha256:20b320f3b9c07438fd5e62eca18e5ba85f1d73e7a58159db74426211004e71af is not in valid image references
Pod model-registry0-57764fb5cf-bpvrw in namespace: rhoai-model-registries image validation failed: Image quay.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:b7cafb9561936ea45769e77f0da365043d16e2a0b3d2c74921d31dd20133e696 is not from registry.redhat.io
Pod model-registry0-57764fb5cf-bpvrw, namespace: rhoai-model-registries image quay.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:b7cafb9561936ea45769e77f0da365043d16e2a0b3d2c74921d31dd20133e696 is not in valid image references
==== 1 failed, 31 passed, 441 deselected, 39 warnings in 315.00s (0:05:14) =====