--- BVT pytest attempt 2026-06-02T05:20:54.796016+00:00 (/.local/bin/uv run pytest...) --- 2026-06-02T05:20:56.946722Z [info ] Writing tests log to /home/odh/opendatahub-tests/results/pytest-tests.log [conftest] 2026-06-02T05:20:56.957249Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-02T05:20:56.958290Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-02T05:20:56.958719Z [info ] PRAGMA main.table_info("OpenDataHubTestTable") [sqlalchemy.engine.Engine] 2026-06-02T05:20:56.958881Z [info ] PRAGMA main.table_info("OpenDataHubTestTable") [sqlalchemy.engine.Engine] 2026-06-02T05:20:56.959652Z [info ] [raw sql] ()  [sqlalchemy.engine.Engine] 2026-06-02T05:20:56.959845Z [info ] [raw sql] ()  [sqlalchemy.engine.Engine] 2026-06-02T05:20:56.960003Z [info ] PRAGMA temp.table_info("OpenDataHubTestTable") [sqlalchemy.engine.Engine] 2026-06-02T05:20:56.960251Z [info ] PRAGMA temp.table_info("OpenDataHubTestTable") [sqlalchemy.engine.Engine] 2026-06-02T05:20:56.960459Z [info ] [raw sql] ()  [sqlalchemy.engine.Engine] 2026-06-02T05:20:56.960625Z [info ] [raw sql] ()  [sqlalchemy.engine.Engine] 2026-06-02T05:20:56.962856Z [info ]  CREATE TABLE "OpenDataHubTestTable" ( id INTEGER NOT NULL, test_name VARCHAR(500) NOT NULL, start_time INTEGER NOT NULL, PRIMARY KEY (id) )  [sqlalchemy.engine.Engine] 2026-06-02T05:20:56.963138Z [info ]  CREATE TABLE "OpenDataHubTestTable" ( id INTEGER NOT NULL, test_name VARCHAR(500) NOT NULL, start_time INTEGER NOT NULL, PRIMARY KEY (id) )  [sqlalchemy.engine.Engine] 2026-06-02T05:20:56.963359Z [info ] [no key 0.00005s] ()  [sqlalchemy.engine.Engine] 2026-06-02T05:20:56.963544Z [info ] [no key 0.00005s] ()  [sqlalchemy.engine.Engine] 2026-06-02T05:20:56.964399Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-02T05:20:56.964552Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-02T05:20:56.964731Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-09.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-09.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-09.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-09.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-09.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( 2026-06-02T05:20:57.106174Z [info ] kind: DataScienceCluster api version: datasciencecluster.opendatahub.io/v2 [ocp_resources.resource] /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-09.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-09.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-09.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-09.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( 2026-06-02T05:20:57.174279Z [info ] kind: DSCInitialization api version: dscinitialization.opendatahub.io/v2 [ocp_resources.resource] /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-09.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( ============================= test session starts ============================== platform linux -- Python 3.14.5, pytest-9.0.3, pluggy-1.6.0 -- /home/odh/opendatahub-tests/.venv/bin/python cachedir: .pytest_cache metadata: {'Python': '3.14.5', 'Platform': 'Linux-5.14.0-427.115.1.el9_4.x86_64-x86_64-with-glibc2.42', 'Packages': {'pytest': '9.0.3', 'pluggy': '1.6.0'}, 'Plugins': {'anyio': '4.13.0', 'langsmith': '0.8.7', 'asyncio': '1.4.0', 'dependency': '0.6.1', 'html': '4.2.0', 'metadata': '3.1.1', 'order': '1.4.0', 'progress': '1.4.0', 'testconfig': '0.2.0', 'xdist': '3.8.0', 'syrupy': '5.2.0'}} rootdir: /home/odh/opendatahub-tests configfile: pytest.ini plugins: anyio-4.13.0, langsmith-0.8.7, asyncio-1.4.0, dependency-0.6.1, html-4.2.0, metadata-3.1.1, order-1.4.0, progress-1.4.0, testconfig-0.2.0, xdist-3.8.0, syrupy-5.2.0 asyncio: mode=Mode.STRICT, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function collecting ... collected 13 items / 8 deselected / 5 selected tests/workbenches/notebooks_server/controller/test_spawning.py::TestNotebook::test_create_simple_notebook[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0]  test_create_simple_notebook[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0]  -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-06-02T05:20:57.290435Z [info ] (OpenDataHubTestTable|OpenDataHubTestTable) _post_configure_properties() started [sqlalchemy.orm.mapper.Mapper] 2026-06-02T05:20:57.290600Z [info ] (OpenDataHubTestTable|OpenDataHubTestTable) initialize prop id [sqlalchemy.orm.mapper.Mapper] 2026-06-02T05:20:57.291251Z [info ] (OpenDataHubTestTable|OpenDataHubTestTable) initialize prop test_name [sqlalchemy.orm.mapper.Mapper] 2026-06-02T05:20:57.291711Z [info ] (OpenDataHubTestTable|OpenDataHubTestTable) initialize prop start_time [sqlalchemy.orm.mapper.Mapper] 2026-06-02T05:20:57.291877Z [info ] (OpenDataHubTestTable|OpenDataHubTestTable) _post_configure_properties() complete [sqlalchemy.orm.mapper.Mapper] 2026-06-02T05:20:57.293197Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-02T05:20:57.295225Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-02T05:20:57.295480Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-02T05:20:57.296802Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-02T05:20:57.297184Z [info ] [generated in 0.00014s] ('/home/odh/opendatahub-tests/tests/workbenches/notebooks_server/controller/test_spawning.py::test_create_simple_notebook[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0]', 1780377657) [sqlalchemy.engine.Engine] 2026-06-02T05:20:57.297451Z [info ] [generated in 0.00014s] ('/home/odh/opendatahub-tests/tests/workbenches/notebooks_server/controller/test_spawning.py::test_create_simple_notebook[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0]', 1780377657) [sqlalchemy.engine.Engine] 2026-06-02T05:20:57.297640Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-02T05:20:57.297818Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-02T05:20:57.298472Z [info ] Executing session fixture: event_loop_policy [conftest] 2026-06-02T05:20:57.298649Z [info ] Executing session fixture: _syrupy_apply_ide_patches [conftest] 2026-06-02T05:20:57.298811Z [info ] Executing session fixture: admin_client [conftest] 2026-06-02T05:20:57.298981Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] 2026-06-02T05:20:57.299135Z [info ] Executing session fixture: dsc_resource [conftest] 2026-06-02T05:20:57.299271Z [info ] kind: DataScienceCluster api version: datasciencecluster.opendatahub.io/v2 [ocp_resources.resource] 2026-06-02T05:20:57.420195Z [info ] Executing session fixture: tmp_path_factory [conftest] 2026-06-02T05:20:57.420549Z [info ] Executing session fixture: tests_tmp_dir [conftest] 2026-06-02T05:20:57.421698Z [info ] Executing session fixture: os_path_environment [conftest] 2026-06-02T05:20:57.421918Z [info ] Executing session fixture: tmpdir_factory [conftest] 2026-06-02T05:20:57.422069Z [info ] Executing session fixture: bin_directory [conftest] 2026-06-02T05:20:57.423484Z [info ] Executing session fixture: oc_binary_path [conftest] 2026-06-02T05:20:57.468879Z [info ] kind: ConsoleCLIDownload api version: console.openshift.io/v1 [ocp_resources.resource] 2026-06-02T05:20:57.508496Z [info ] All oc console cli download links: ['https://downloads-openshift-console.apps.ods-qe-psi-09.osp.rh-ods.com/amd64/linux/oc.tar'] [utilities.infra] name=utilities.infra 2026-06-02T05:20:57.508620Z [info ] Downloading archive using: url=https://downloads-openshift-console.apps.ods-qe-psi-09.osp.rh-ods.com/amd64/linux/oc.tar [utilities.infra] name=utilities.infra 2026-06-02T05:23:07.459425Z [info ] Extract the downloaded archive. [utilities.infra] name=utilities.infra 2026-06-02T05:23:07.583843Z [info ] Downloaded file: ['oc']  [utilities.infra] name=utilities.infra 2026-06-02T05:23:07.607617Z [info ] Executing session fixture: bin_directory_to_os_path [conftest] 2026-06-02T05:23:07.605610Z [info ] OC binary path: /tmp/pytest-HDKqtwJzupbds4RLi4pvrr/bin0/oc [tests.conftest] name=tests.conftest 2026-06-02T05:23:07.605676Z [info ] Adding /tmp/pytest-HDKqtwJzupbds4RLi4pvrr/bin0 to $PATH [tests.conftest] name=tests.conftest 2026-06-02T05:23:07.608137Z [info ] Executing session fixture: nodes [conftest] 2026-06-02T05:23:09.884873Z [info ] Executing session fixture: dsci_resource [conftest] 2026-06-02T05:23:09.885075Z [info ] kind: DSCInitialization api version: dscinitialization.opendatahub.io/v2 [ocp_resources.resource] 2026-06-02T05:23:09.912502Z [info ] Executing session fixture: record_testsuite_property [conftest] 2026-06-02T05:23:09.912710Z [info ] Executing session fixture: junitxml_plugin [conftest] 2026-06-02T05:23:09.912876Z [info ] Executing session fixture: cluster_sanity_scope_session [conftest] 2026-06-02T05:23:09.911430Z [info ] Check cluster sanity.  [utilities.infra] name=utilities.infra 2026-06-02T05:23:09.913177Z [info ] Verify all nodes are in a healthy condition. [ocp_utilities.infra] 2026-06-02T05:23:10.251464Z [info ] Verify all nodes are schedulable. [ocp_utilities.infra] 2026-06-02T05:23:10.445242Z [info ] Waiting for 120 seconds [0:02:00], retry every 5 seconds. (Function: utilities.infra.wait_for_dsci_status_ready Kwargs: {'dsci_resource': }) [timeout_sampler] 2026-06-02T05:23:10.444273Z [info ] Wait for DSCI default-dsci to be in Ready status. [utilities.infra] name=utilities.infra 2026-06-02T05:23:10.445655Z [info ] Get DSCInitialization default-dsci status [ocp_resources DSCInitialization] 2026-06-02T05:23:10.468939Z [info ] Elapsed time: 0.0001552104949951172 [0:00:00.000155] [timeout_sampler] 2026-06-02T05:23:10.469101Z [info ] Waiting for 120 seconds [0:02:00], retry every 5 seconds. (Function: utilities.infra.wait_for_dsc_status_ready Kwargs: {'dsc_resource': }) [timeout_sampler] 2026-06-02T05:23:10.468131Z [info ] Wait for DSC default-dsc are Ready. [utilities.infra] name=utilities.infra 2026-06-02T05:23:10.469404Z [info ] Get DataScienceCluster default-dsc status [ocp_resources DataScienceCluster] 2026-06-02T05:23:10.498464Z [info ] Elapsed time: 4.5299530029296875e-05 [0:00:00.000045] [timeout_sampler] 2026-06-02T05:23:10.498751Z [info ] Executing session fixture: autouse_fixtures [conftest] 2026-06-02T05:23:10.498927Z [info ] Executing session fixture: pytestconfig [conftest] 2026-06-02T05:23:10.499089Z [info ] Executing session fixture: use_unprivileged_client [conftest] 2026-06-02T05:23:10.499218Z [info ] Executing session fixture: kubconfig_filepath [conftest] 2026-06-02T05:23:10.499383Z [info ] Executing session fixture: cluster_authentication [conftest] 2026-06-02T05:23:10.499512Z [info ] kind: Authentication api version: config.openshift.io/v1 [ocp_resources.resource] 2026-06-02T05:23:10.525956Z [info ] Executing session fixture: is_byoidc [conftest] 2026-06-02T05:23:10.550897Z [info ] Executing session fixture: non_admin_user_password [conftest] 2026-06-02T05:23:10.551105Z [info ] Executing session fixture: unprivileged_client [conftest] 2026-06-02T05:23:10.548453Z [warning ] Unprivileged client is not enabled, using admin client [tests.conftest] name=tests.conftest 2026-06-02T05:23:10.551506Z [info ] Executing session fixture: teardown_resources [conftest] 2026-06-02T05:23:10.551654Z [info ] Executing class fixture: unprivileged_model_namespace [conftest] 2026-06-02T05:23:10.551783Z [info ] kind: ProjectRequest api version: project.openshift.io/v1 [ocp_resources.resource] 2026-06-02T05:23:10.551907Z [info ] Create ProjectRequest test-odh-notebook [ocp_resources ProjectRequest] 2026-06-02T05:23:10.552036Z [info ] Posting {'apiVersion': 'project.openshift.io/v1', 'kind': 'ProjectRequest', 'metadata': {'name': 'test-odh-notebook', 'labels': {'opendatahub.io/dashboard': 'true'}}} [ocp_resources ProjectRequest] 2026-06-02T05:23:10.775780Z [info ] kind: Project api version: project.openshift.io/v1 [ocp_resources.resource] 2026-06-02T05:23:10.775987Z [info ] Wait for Project test-odh-notebook status to be Active [ocp_resources Project] 2026-06-02T05:23:10.776143Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_status.lambda: self.exists) [timeout_sampler] 2026-06-02T05:23:10.814898Z [info ] Status of Project test-odh-notebook is Active [ocp_resources Project] 2026-06-02T05:23:10.815068Z [info ] Elapsed time: 4.124641418457031e-05 [0:00:00.000041] [timeout_sampler] 2026-06-02T05:23:10.815281Z [info ] ResourceEdits: Updating data for resource Namespace test-odh-notebook [ocp_resources.resource] 2026-06-02T05:23:10.815448Z [info ] Update Namespace test-odh-notebook: {'metadata': {'labels': {'opendatahub.io/dashboard': 'true'}, 'name': 'test-odh-notebook'}} [ocp_resources Namespace] 2026-06-02T05:23:10.850504Z [info ] Executing function fixture: minimal_image [conftest] 2026-06-02T05:23:10.932277Z [info ] kind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1 [ocp_resources.resource] 2026-06-02T05:23:11.664542Z [info ] Executing function fixture: notebook_image [conftest] 2026-06-02T05:23:12.125873Z [info ] kind: Config api version: imageregistry.operator.openshift.io/v1 [ocp_resources.resource] 2026-06-02T05:23:12.147831Z [info ] Image registry management state: managed, available: True [utilities.infra] name=utilities.infra 2026-06-02T05:23:12.152091Z [info ] Executing function fixture: users_persistent_volume_claim [conftest] 2026-06-02T05:23:12.152269Z [info ] Create PersistentVolumeClaim test-odh-notebook [ocp_resources PersistentVolumeClaim] 2026-06-02T05:23:12.152579Z [info ] Posting {'apiVersion': 'v1', 'kind': 'PersistentVolumeClaim', 'metadata': {'name': 'test-odh-notebook', 'labels': {'opendatahub.io/dashboard': 'true'}, 'namespace': 'test-odh-notebook'}, 'spec': {'volumeMode': 'Filesystem', 'accessModes': ['ReadWriteOnce'], 'resources': {'requests': {'storage': '10Gi'}}}} [ocp_resources PersistentVolumeClaim] 2026-06-02T05:23:12.198279Z [info ] Executing function fixture: default_notebook [conftest] 2026-06-02T05:23:12.198558Z [info ] kind: SelfSubjectReview api version: authentication.k8s.io/v1 [ocp_resources.resource] 2026-06-02T05:23:12.198705Z [info ] Create SelfSubjectReview selfSubjectReview [ocp_resources SelfSubjectReview] 2026-06-02T05:23:12.198847Z [info ] Posting {'apiVersion': 'authentication.k8s.io/v1', 'kind': 'SelfSubjectReview', 'metadata': {'name': 'selfSubjectReview'}} [ocp_resources SelfSubjectReview] 2026-06-02T05:23:12.298055Z [info ] kind: Notebook api version: kubeflow.org/v1 [ocp_resources.resource] 2026-06-02T05:23:12.298261Z [info ] Create Notebook test-odh-notebook [ocp_resources Notebook] 2026-06-02T05:23:12.298510Z [info ] Posting {'apiVersion': 'kubeflow.org/v1', 'kind': 'Notebook', 'metadata': {'annotations': {'notebooks.opendatahub.io/inject-auth': 'true', 'opendatahub.io/accelerator-name': '', 'notebooks.opendatahub.io/last-image-selection': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.4'}, 'finalizers': ['notebook.opendatahub.io/kube-rbac-proxy-cleanup'], 'labels': {'app': 'test-odh-notebook', 'opendatahub.io/dashboard': 'true', 'opendatahub.io/odh-managed': 'true'}, 'name': 'test-odh-notebook', 'namespace': 'test-odh-notebook'}, 'spec': {'template': {'spec': {'affinity': {}, 'containers': [{'env': [{'name': 'NOTEBOOK_ARGS', 'value': "--ServerApp.port=8888\n --ServerApp.token=''\n --ServerApp.password=''\n --ServerApp.base_url=/notebook/test-odh-notebook/test-odh-notebook\n --ServerApp.quit_button=False\n"}, {'name': 'JUPYTER_IMAGE', 'value': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.4'}], 'image': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.4', 'imagePullPolicy': 'Always', 'livenessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/notebook/test-odh-notebook/test-odh-notebook/api', 'port': 'notebook-port', 'scheme': 'HTTP'}, 'initialDelaySeconds': 10, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'name': 'test-odh-notebook', 'ports': [{'containerPort': 8888, 'name': 'notebook-port', 'protocol': 'TCP'}], 'readinessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/notebook/test-odh-notebook/test-odh-notebook/api', 'port': 'notebook-port', 'scheme': 'HTTP'}, 'initialDelaySeconds': 10, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'resources': {'limits': {'cpu': '2', 'memory': '4Gi'}, 'requests': {'cpu': '1', 'memory': '1Gi'}}, 'volumeMounts': [{'mountPath': '/opt/app-root/src', 'name': 'test-odh-notebook'}, {'mountPath': '/dev/shm', 'name': 'shm'}], 'workingDir': '/opt/app-root/src'}], 'enableServiceLinks': False, 'serviceAccountName': 'test-odh-notebook', 'volumes': [{'name': 'test-odh-notebook', 'persistentVolumeClaim': {'claimName': 'test-odh-notebook'}}, {'emptyDir': {'medium': 'Memory'}, 'name': 'shm'}, {'name': 'kube-rbac-proxy-config', 'configMap': {'defaultMode': 420, 'name': 'test-kube-rbac-proxy-config'}}, {'name': 'kube-rbac-proxy-tls-certificates', 'secret': {'defaultMode': 420, 'secretName': 'test-kube-rbac-proxy-tls'}}]}}}} [ocp_resources Notebook] 2026-06-02T05:23:12.430534Z [info ] Executing function fixture: notebook_pod [conftest] 2026-06-02T05:23:12.430800Z [info ] Wait until Pod test-odh-notebook-0 is created [ocp_resources Pod] 2026-06-02T05:23:12.430964Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-06-02T05:23:13.493351Z [info ] Elapsed time: 1.024148941040039 [0:00:01.024149] [timeout_sampler] 2026-06-02T05:23:13.493520Z [info ] Wait for Pod/test-odh-notebook-0's 'Ready' condition to be 'True' [ocp_resources Pod] 2026-06-02T05:23:13.493653Z [info ] Wait until Pod test-odh-notebook-0 is created [ocp_resources Pod] 2026-06-02T05:23:13.493791Z [info ] Waiting for 120 seconds [0:02:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-06-02T05:23:13.515978Z [info ] Elapsed time: 3.123283386230469e-05 [0:00:00.000031] [timeout_sampler] 2026-06-02T05:23:13.516210Z [info ] Waiting for 119.97703790664673 seconds [0:01:59.977038], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-06-02T05:23:37.641479Z [info ] Elapsed time: 24.08175277709961 [0:00:24.081753] [timeout_sampler] --------------------------------------------------------- CALL --------------------------------------------------------- PASSED TEST: TestNotebook.test_create_simple_notebook[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0] STATUS: PASSED ------------------------------------------------------- TEARDOWN ------------------------------------------------------- 2026-06-02T05:23:37.671503Z [info ] Delete Notebook test-odh-notebook [ocp_resources Notebook] 2026-06-02T05:23:37.815483Z [info ] Deleting {'apiVersion': 'kubeflow.org/v1', 'kind': 'Notebook', 'metadata': {'annotations': {'notebooks.opendatahub.io/inject-auth': 'true', 'notebooks.opendatahub.io/last-image-selection': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.4', 'opendatahub.io/accelerator-name': ''}, 'creationTimestamp': '2026-06-02T05:23:12Z', 'finalizers': ['notebook.opendatahub.io/kube-rbac-proxy-cleanup', 'notebook.opendatahub.io/httproute-cleanup', 'notebook.opendatahub.io/referencegrant-cleanup'], 'generation': 1, 'labels': {'app': 'test-odh-notebook', 'opendatahub.io/dashboard': 'true', 'opendatahub.io/odh-managed': 'true'}, 'managedFields': [{'apiVersion': 'kubeflow.org/v1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:notebooks.opendatahub.io/inject-auth': {}, 'f:notebooks.opendatahub.io/last-image-selection': {}, 'f:opendatahub.io/accelerator-name': {}}, 'f:finalizers': {'.': {}, 'v:"notebook.opendatahub.io/kube-rbac-proxy-cleanup"': {}}, 'f:labels': {'.': {}, 'f:app': {}, 'f:opendatahub.io/dashboard': {}, 'f:opendatahub.io/odh-managed': {}}}, 'f:spec': {'.': {}, 'f:template': {'.': {}, 'f:spec': {'.': {}, 'f:affinity': {}, 'f:containers': {'.': {}, 'k:{"name":"test-odh-notebook"}': {'.': {}, 'f:env': {'.': {}, 'k:{"name":"JUPYTER_IMAGE"}': {'.': {}, 'f:name': {}, 'f:value': {}}, 'k:{"name":"NOTEBOOK_ARGS"}': {'.': {}, 'f:name': {}, 'f:value': {}}}, 'f:image': {}, 'f:imagePullPolicy': {}, 'f:livenessProbe': {'.': {}, 'f:failureThreshold': {}, 'f:httpGet': {'.': {}, 'f:path': {}, 'f:port': {}, 'f:scheme': {}}, 'f:initialDelaySeconds': {}, 'f:periodSeconds': {}, 'f:successThreshold': {}, 'f:timeoutSeconds': {}}, 'f:name': {}, 'f:ports': {'.': {}, 'k:{"containerPort":8888,"protocol":"TCP"}': {'.': {}, 'f:containerPort': {}, 'f:name': {}, 'f:protocol': {}}}, 'f:readinessProbe': {'.': {}, 'f:failureThreshold': {}, 'f:httpGet': {'.': {}, 'f:path': {}, 'f:port': {}, 'f:scheme': {}}, 'f:initialDelaySeconds': {}, 'f:periodSeconds': {}, 'f:successThreshold': {}, 'f:timeoutSeconds': {}}, 'f:resources': {'.': {}, 'f:limits': {'.': {}, 'f:cpu': {}, 'f:memory': {}}, 'f:requests': {'.': {}, 'f:cpu': {}, 'f:memory': {}}}, 'f:volumeMounts': {'.': {}, 'k:{"mountPath":"/dev/shm"}': {'.': {}, 'f:mountPath': {}, 'f:name': {}}, 'k:{"mountPath":"/opt/app-root/src"}': {'.': {}, 'f:mountPath': {}, 'f:name': {}}}, 'f:workingDir': {}}}, 'f:enableServiceLinks': {}, 'f:serviceAccountName': {}, 'f:volumes': {'.': {}, 'k:{"name":"kube-rbac-proxy-config"}': {'.': {}, 'f:configMap': {}, 'f:name': {}}, 'k:{"name":"kube-rbac-proxy-tls-certificates"}': {'.': {}, 'f:name': {}, 'f:secret': {'.': {}, 'f:defaultMode': {}, 'f:secretName': {}}}, 'k:{"name":"shm"}': {'.': {}, 'f:emptyDir': {'.': {}, 'f:medium': {}}, 'f:name': {}}, 'k:{"name":"test-odh-notebook"}': {'.': {}, 'f:name': {}, 'f:persistentVolumeClaim': {'.': {}, 'f:claimName': {}}}}}}}}, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': '2026-06-02T05:23:12Z'}, {'apiVersion': 'kubeflow.org/v1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:finalizers': {'v:"notebook.opendatahub.io/httproute-cleanup"': {}, 'v:"notebook.opendatahub.io/referencegrant-cleanup"': {}}}}, 'manager': 'manager', 'operation': 'Update', 'time': '2026-06-02T05:23:12Z'}, {'apiVersion': 'kubeflow.org/v1beta1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'.': {}, 'f:conditions': {}, 'f:containerState': {'.': {}, 'f:running': {'.': {}, 'f:startedAt': {}}}, 'f:readyReplicas': {}}}, 'manager': 'manager', 'operation': 'Update', 'subresource': 'status', 'time': '2026-06-02T05:23:37Z'}], 'name': 'test-odh-notebook', 'namespace': 'test-odh-notebook', 'resourceVersion': '243923341', 'uid': '6c5b5ae9-1422-4ecd-ac8d-302011fcb213'}, 'spec': {'template': {'spec': {'affinity': {}, 'containers': [{'env': [{'name': 'NOTEBOOK_ARGS', 'value': "--ServerApp.port=8888\n --ServerApp.token=''\n --ServerApp.password=''\n --ServerApp.base_url=/notebook/test-odh-notebook/test-odh-notebook\n --ServerApp.quit_button=False\n"}, {'name': 'JUPYTER_IMAGE', 'value': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.4'}, {'name': 'SSL_CERT_FILE', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}, {'name': 'PIPELINES_SSL_SA_CERTS', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}, {'name': 'KF_PIPELINES_SSL_SA_CERTS', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}, {'name': 'GIT_SSL_CAINFO', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}, {'name': 'PIP_CERT', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}, {'name': 'REQUESTS_CA_BUNDLE', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}], 'image': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.4', 'imagePullPolicy': 'Always', 'livenessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/notebook/test-odh-notebook/test-odh-notebook/api', 'port': 'notebook-port', 'scheme': 'HTTP'}, 'initialDelaySeconds': 10, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'name': 'test-odh-notebook', 'ports': [{'containerPort': 8888, 'name': 'notebook-port', 'protocol': 'TCP'}], 'readinessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/notebook/test-odh-notebook/test-odh-notebook/api', 'port': 'notebook-port', 'scheme': 'HTTP'}, 'initialDelaySeconds': 10, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'resources': {'limits': {'cpu': '2', 'memory': '4Gi'}, 'requests': {'cpu': '1', 'memory': '1Gi'}}, 'volumeMounts': [{'mountPath': '/opt/app-root/src', 'name': 'test-odh-notebook'}, {'mountPath': '/dev/shm', 'name': 'shm'}, {'mountPath': '/etc/pki/tls/custom-certs/ca-bundle.crt', 'name': 'trusted-ca', 'readOnly': True, 'subPath': 'ca-bundle.crt'}, {'mountPath': '/opt/app-root/pipeline-runtimes/', 'name': 'runtime-images'}], 'workingDir': '/opt/app-root/src'}, {'args': ['--secure-listen-address=0.0.0.0:8443', '--upstream=http://127.0.0.1:8888/', '--logtostderr=true', '--v=10', '--proxy-endpoints-port=8444', '--config-file=/etc/kube-rbac-proxy/config-file.yaml', '--tls-cert-file=/etc/tls/private/tls.crt', '--tls-private-key-file=/etc/tls/private/tls.key', '--auth-header-fields-enabled=true', '--auth-header-user-field-name=X-Auth-Request-User', '--auth-header-groups-field-name=X-Auth-Request-Groups'], 'image': 'registry.redhat.io/rhoai/odh-kube-auth-proxy-rhel9@sha256:b113d3c4adc2e5456a99c12384d0827cc82e0e3acb2a42adeb75f80f1654f936', 'imagePullPolicy': 'Always', 'livenessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/healthz', 'port': 8444, 'scheme': 'HTTPS'}, 'initialDelaySeconds': 30, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'name': 'kube-rbac-proxy', 'ports': [{'containerPort': 8443, 'name': 'kube-rbac-proxy', 'protocol': 'TCP'}], 'readinessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/healthz', 'port': 8444, 'scheme': 'HTTPS'}, 'initialDelaySeconds': 5, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'resources': {'limits': {'cpu': '100m', 'memory': '64Mi'}, 'requests': {'cpu': '100m', 'memory': '64Mi'}}, 'volumeMounts': [{'mountPath': '/etc/kube-rbac-proxy', 'name': 'kube-rbac-proxy-config'}, {'mountPath': '/etc/tls/private', 'name': 'kube-rbac-proxy-tls-certificates'}]}], 'enableServiceLinks': False, 'serviceAccountName': 'test-odh-notebook', 'volumes': [{'name': 'test-odh-notebook', 'persistentVolumeClaim': {'claimName': 'test-odh-notebook'}}, {'emptyDir': {'medium': 'Memory'}, 'name': 'shm'}, {'configMap': {'defaultMode': 420, 'name': 'test-odh-notebook-kube-rbac-proxy-config'}, 'name': 'kube-rbac-proxy-config'}, {'name': 'kube-rbac-proxy-tls-certificates', 'secret': {'defaultMode': 420, 'secretName': 'test-odh-notebook-kube-rbac-proxy-tls'}}, {'configMap': {'items': [{'key': 'ca-bundle.crt', 'path': 'ca-bundle.crt'}], 'name': 'workbench-trusted-ca-bundle', 'optional': True}, 'name': 'trusted-ca'}, {'configMap': {'name': 'pipeline-runtime-images', 'optional': True}, 'name': 'runtime-images'}]}}}, 'status': {'conditions': [{'lastProbeTime': '2026-06-02T05:23:37Z', 'lastTransitionTime': '2026-06-02T05:23:24Z', 'status': 'True', 'type': 'PodReadyToStartContainers'}, {'lastProbeTime': '2026-06-02T05:23:37Z', 'lastTransitionTime': '2026-06-02T05:23:13Z', 'status': 'True', 'type': 'Initialized'}, {'lastProbeTime': '2026-06-02T05:23:37Z', 'lastTransitionTime': '2026-06-02T05:23:36Z', 'status': 'True', 'type': 'Ready'}, {'lastProbeTime': '2026-06-02T05:23:37Z', 'lastTransitionTime': '2026-06-02T05:23:36Z', 'status': 'True', 'type': 'ContainersReady'}, {'lastProbeTime': '2026-06-02T05:23:37Z', 'lastTransitionTime': '2026-06-02T05:23:13Z', 'status': 'True', 'type': 'PodScheduled'}], 'containerState': {'running': {'startedAt': '2026-06-02T05:23:23Z'}}, 'readyReplicas': 1}} [ocp_resources Notebook] 2026-06-02T05:23:37.843664Z [info ] Wait until Notebook test-odh-notebook is deleted [ocp_resources Notebook] 2026-06-02T05:23:37.843863Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-06-02T05:23:38.885594Z [info ] Elapsed time: 1.0223844051361084 [0:00:01.022384] [timeout_sampler] 2026-06-02T05:23:38.885823Z [info ] Delete PersistentVolumeClaim test-odh-notebook [ocp_resources PersistentVolumeClaim] 2026-06-02T05:23:38.922877Z [info ] Deleting {'kind': 'PersistentVolumeClaim', 'apiVersion': 'v1', 'metadata': {'name': 'test-odh-notebook', 'namespace': 'test-odh-notebook', 'uid': 'a4988a62-0e4d-42d3-bcd0-7f0370eb7828', 'resourceVersion': '243922958', 'creationTimestamp': '2026-06-02T05:23:12Z', 'labels': {'opendatahub.io/dashboard': 'true'}, 'annotations': {'pv.kubernetes.io/bind-completed': 'yes', 'pv.kubernetes.io/bound-by-controller': 'yes', 'volume.beta.kubernetes.io/storage-provisioner': 'cinder.csi.openstack.org', 'volume.kubernetes.io/selected-node': 'ods-qe-psi-09-p2fn8-worker-0-425l6', 'volume.kubernetes.io/storage-provisioner': 'cinder.csi.openstack.org'}, 'finalizers': ['kubernetes.io/pvc-protection'], 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-02T05:23:12Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:labels': {'.': {}, 'f:opendatahub.io/dashboard': {}}}, 'f:spec': {'f:accessModes': {}, 'f:resources': {'f:requests': {'.': {}, 'f:storage': {}}}, 'f:volumeMode': {}}}}, {'manager': 'kube-scheduler', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-02T05:23:12Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:volume.kubernetes.io/selected-node': {}}}}}, {'manager': 'kube-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-02T05:23:13Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:pv.kubernetes.io/bind-completed': {}, 'f:pv.kubernetes.io/bound-by-controller': {}, 'f:volume.beta.kubernetes.io/storage-provisioner': {}, 'f:volume.kubernetes.io/storage-provisioner': {}}}, 'f:spec': {'f:volumeName': {}}}}, {'manager': 'kube-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-02T05:23:13Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'f:accessModes': {}, 'f:capacity': {'.': {}, 'f:storage': {}}, 'f:phase': {}}}, 'subresource': 'status'}]}, 'spec': {'accessModes': ['ReadWriteOnce'], 'resources': {'requests': {'storage': '10Gi'}}, 'volumeName': 'pvc-a4988a62-0e4d-42d3-bcd0-7f0370eb7828', 'storageClassName': 'standard-csi', 'volumeMode': 'Filesystem'}, 'status': {'phase': 'Bound', 'accessModes': ['ReadWriteOnce'], 'capacity': {'storage': '10Gi'}}} [ocp_resources PersistentVolumeClaim] 2026-06-02T05:23:38.943797Z [info ] Wait until PersistentVolumeClaim test-odh-notebook is deleted [ocp_resources PersistentVolumeClaim] 2026-06-02T05:23:38.943978Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-06-02T05:23:39.987286Z [info ] Elapsed time: 1.0207228660583496 [0:00:01.020723] [timeout_sampler] 2026-06-02T05:23:40.005744Z [info ] Delete Project test-odh-notebook [ocp_resources Project] 2026-06-02T05:23:40.059856Z [info ] Deleting {'kind': 'Project', 'apiVersion': 'project.openshift.io/v1', 'metadata': {'name': 'test-odh-notebook', 'uid': '45434768-ec2b-4f9a-966f-5fdc319e482c', 'resourceVersion': '243922864', 'creationTimestamp': '2026-06-02T05:23:10Z', 'labels': {'kubernetes.io/metadata.name': 'test-odh-notebook', 'opendatahub.io/dashboard': 'true', 'pod-security.kubernetes.io/audit': 'restricted', 'pod-security.kubernetes.io/audit-version': 'latest', 'pod-security.kubernetes.io/warn': 'restricted', 'pod-security.kubernetes.io/warn-version': 'latest'}, 'annotations': {'openshift.io/description': '', 'openshift.io/display-name': '', 'openshift.io/requester': 'htpasswd-cluster-admin-user', 'openshift.io/sa.scc.mcs': 's0:c31,c30', 'openshift.io/sa.scc.supplemental-groups': '1000990000/10000', 'openshift.io/sa.scc.uid-range': '1000990000/10000', 'security.openshift.io/MinimallySufficientPodSecurityStandard': 'restricted'}, 'managedFields': [{'manager': 'pod-security-admission-label-synchronization-controller', 'operation': 'Apply', 'apiVersion': 'v1', 'time': '2026-06-02T05:23:10Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:security.openshift.io/MinimallySufficientPodSecurityStandard': {}}, 'f:labels': {'f:pod-security.kubernetes.io/audit': {}, 'f:pod-security.kubernetes.io/audit-version': {}, 'f:pod-security.kubernetes.io/warn': {}, 'f:pod-security.kubernetes.io/warn-version': {}}}}}, {'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-02T05:23:10Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:labels': {'f:opendatahub.io/dashboard': {}}}}}, {'manager': 'cluster-policy-controller', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-02T05:23:10Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:openshift.io/sa.scc.mcs': {}, 'f:openshift.io/sa.scc.supplemental-groups': {}, 'f:openshift.io/sa.scc.uid-range': {}}}}}, {'manager': 'openshift-apiserver', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-02T05:23:10Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:openshift.io/description': {}, 'f:openshift.io/display-name': {}, 'f:openshift.io/requester': {}}, 'f:labels': {'.': {}, 'f:kubernetes.io/metadata.name': {}}}}}, {'manager': 'openshift-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-02T05:23:10Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'f:finalizers': {}}}, 'subresource': 'finalize'}]}, 'spec': {'finalizers': ['kubernetes']}, 'status': {'phase': 'Active'}} [ocp_resources Project] 2026-06-02T05:23:40.090210Z [info ] Wait until Project test-odh-notebook is deleted [ocp_resources Project] 2026-06-02T05:23:40.090479Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] _ 1 of 5 completed, 1 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _ tests/workbenches/notebooks_server/controller/test_spawning.py::TestNotebook::test_auth_container_resource_customization[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0] 2026-06-02T05:23:48.371749Z [info ] Elapsed time: 8.23269248008728 [0:00:08.232692] [timeout_sampler]  test_auth_container_resource_customization[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0]  -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-06-02T05:23:48.374177Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-02T05:23:48.374719Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-02T05:23:48.376466Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-02T05:23:48.376638Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-02T05:23:48.377400Z [info ] [cached since 171.1s ago] ('/home/odh/opendatahub-tests/tests/workbenches/notebooks_server/controller/test_spawning.py::test_auth_container_resource_customization[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0]', 1780377828) [sqlalchemy.engine.Engine] 2026-06-02T05:23:48.377723Z [info ] [cached since 171.1s ago] ('/home/odh/opendatahub-tests/tests/workbenches/notebooks_server/controller/test_spawning.py::test_auth_container_resource_customization[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0]', 1780377828) [sqlalchemy.engine.Engine] 2026-06-02T05:23:48.377899Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-02T05:23:48.378053Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-02T05:23:48.378204Z [info ] Executing class fixture: unprivileged_model_namespace [conftest] 2026-06-02T05:23:48.378388Z [info ] kind: ProjectRequest api version: project.openshift.io/v1 [ocp_resources.resource] 2026-06-02T05:23:48.378540Z [info ] Create ProjectRequest test-auth-notebook [ocp_resources ProjectRequest] 2026-06-02T05:23:48.378666Z [info ] Posting {'apiVersion': 'project.openshift.io/v1', 'kind': 'ProjectRequest', 'metadata': {'name': 'test-auth-notebook', 'labels': {'opendatahub.io/dashboard': 'true'}}} [ocp_resources ProjectRequest] 2026-06-02T05:23:48.488761Z [info ] kind: Project api version: project.openshift.io/v1 [ocp_resources.resource] 2026-06-02T05:23:48.488941Z [info ] Wait for Project test-auth-notebook status to be Active [ocp_resources Project] 2026-06-02T05:23:48.489103Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_status.lambda: self.exists) [timeout_sampler] 2026-06-02T05:23:48.510901Z [info ] Status of Project test-auth-notebook is Active [ocp_resources Project] 2026-06-02T05:23:48.511132Z [info ] Elapsed time: 3.457069396972656e-05 [0:00:00.000035] [timeout_sampler] 2026-06-02T05:23:48.511308Z [info ] ResourceEdits: Updating data for resource Namespace test-auth-notebook [ocp_resources.resource] 2026-06-02T05:23:48.511503Z [info ] Update Namespace test-auth-notebook: {'metadata': {'labels': {'opendatahub.io/dashboard': 'true'}, 'name': 'test-auth-notebook'}} [ocp_resources Namespace] 2026-06-02T05:23:48.535022Z [info ] Executing function fixture: minimal_image [conftest] 2026-06-02T05:23:49.050106Z [info ] Executing function fixture: notebook_image [conftest] 2026-06-02T05:23:49.456472Z [info ] kind: Config api version: imageregistry.operator.openshift.io/v1 [ocp_resources.resource] 2026-06-02T05:23:49.655829Z [info ] Image registry management state: managed, available: True [utilities.infra] name=utilities.infra 2026-06-02T05:23:49.658153Z [info ] Executing function fixture: users_persistent_volume_claim [conftest] 2026-06-02T05:23:49.658345Z [info ] Create PersistentVolumeClaim test-auth-notebook [ocp_resources PersistentVolumeClaim] 2026-06-02T05:23:49.658521Z [info ] Posting {'apiVersion': 'v1', 'kind': 'PersistentVolumeClaim', 'metadata': {'name': 'test-auth-notebook', 'labels': {'opendatahub.io/dashboard': 'true'}, 'namespace': 'test-auth-notebook'}, 'spec': {'volumeMode': 'Filesystem', 'accessModes': ['ReadWriteOnce'], 'resources': {'requests': {'storage': '10Gi'}}}} [ocp_resources PersistentVolumeClaim] 2026-06-02T05:23:49.723014Z [info ] Executing function fixture: default_notebook [conftest] 2026-06-02T05:23:49.723259Z [info ] kind: SelfSubjectReview api version: authentication.k8s.io/v1 [ocp_resources.resource] 2026-06-02T05:23:49.723452Z [info ] Create SelfSubjectReview selfSubjectReview [ocp_resources SelfSubjectReview] 2026-06-02T05:23:49.723612Z [info ] Posting {'apiVersion': 'authentication.k8s.io/v1', 'kind': 'SelfSubjectReview', 'metadata': {'name': 'selfSubjectReview'}} [ocp_resources SelfSubjectReview] 2026-06-02T05:23:49.771534Z [info ] kind: Notebook api version: kubeflow.org/v1 [ocp_resources.resource] 2026-06-02T05:23:49.771746Z [info ] Create Notebook test-auth-notebook [ocp_resources Notebook] 2026-06-02T05:23:49.771895Z [info ] Posting {'apiVersion': 'kubeflow.org/v1', 'kind': 'Notebook', 'metadata': {'annotations': {'notebooks.opendatahub.io/inject-auth': 'true', 'opendatahub.io/accelerator-name': '', 'notebooks.opendatahub.io/last-image-selection': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.4', 'notebooks.opendatahub.io/auth-sidecar-cpu-request': '200m', 'notebooks.opendatahub.io/auth-sidecar-memory-request': '128Mi', 'notebooks.opendatahub.io/auth-sidecar-cpu-limit': '500m', 'notebooks.opendatahub.io/auth-sidecar-memory-limit': '256Mi'}, 'finalizers': ['notebook.opendatahub.io/kube-rbac-proxy-cleanup'], 'labels': {'app': 'test-auth-notebook', 'opendatahub.io/dashboard': 'true', 'opendatahub.io/odh-managed': 'true'}, 'name': 'test-auth-notebook', 'namespace': 'test-auth-notebook'}, 'spec': {'template': {'spec': {'affinity': {}, 'containers': [{'env': [{'name': 'NOTEBOOK_ARGS', 'value': "--ServerApp.port=8888\n --ServerApp.token=''\n --ServerApp.password=''\n --ServerApp.base_url=/notebook/test-auth-notebook/test-auth-notebook\n --ServerApp.quit_button=False\n"}, {'name': 'JUPYTER_IMAGE', 'value': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.4'}], 'image': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.4', 'imagePullPolicy': 'Always', 'livenessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/notebook/test-auth-notebook/test-auth-notebook/api', 'port': 'notebook-port', 'scheme': 'HTTP'}, 'initialDelaySeconds': 10, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'name': 'test-auth-notebook', 'ports': [{'containerPort': 8888, 'name': 'notebook-port', 'protocol': 'TCP'}], 'readinessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/notebook/test-auth-notebook/test-auth-notebook/api', 'port': 'notebook-port', 'scheme': 'HTTP'}, 'initialDelaySeconds': 10, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'resources': {'limits': {'cpu': '2', 'memory': '4Gi'}, 'requests': {'cpu': '1', 'memory': '1Gi'}}, 'volumeMounts': [{'mountPath': '/opt/app-root/src', 'name': 'test-auth-notebook'}, {'mountPath': '/dev/shm', 'name': 'shm'}], 'workingDir': '/opt/app-root/src'}], 'enableServiceLinks': False, 'serviceAccountName': 'test-auth-notebook', 'volumes': [{'name': 'test-auth-notebook', 'persistentVolumeClaim': {'claimName': 'test-auth-notebook'}}, {'emptyDir': {'medium': 'Memory'}, 'name': 'shm'}, {'name': 'kube-rbac-proxy-config', 'configMap': {'defaultMode': 420, 'name': 'test-kube-rbac-proxy-config'}}, {'name': 'kube-rbac-proxy-tls-certificates', 'secret': {'defaultMode': 420, 'secretName': 'test-kube-rbac-proxy-tls'}}]}}}} [ocp_resources Notebook] 2026-06-02T05:23:49.895983Z [info ] Executing function fixture: notebook_pod [conftest] 2026-06-02T05:23:49.896215Z [info ] Wait until Pod test-auth-notebook-0 is created [ocp_resources Pod] 2026-06-02T05:23:49.896414Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-06-02T05:23:50.951469Z [info ] Elapsed time: 1.0288410186767578 [0:00:01.028841] [timeout_sampler] 2026-06-02T05:23:50.951675Z [info ] Wait for Pod/test-auth-notebook-0's 'Ready' condition to be 'True' [ocp_resources Pod] 2026-06-02T05:23:50.951812Z [info ] Wait until Pod test-auth-notebook-0 is created [ocp_resources Pod] 2026-06-02T05:23:50.951940Z [info ] Waiting for 120 seconds [0:02:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-06-02T05:23:50.970638Z [info ] Elapsed time: 3.075599670410156e-05 [0:00:00.000031] [timeout_sampler] 2026-06-02T05:23:50.970792Z [info ] Waiting for 119.98064875602722 seconds [0:01:59.980649], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-06-02T05:24:08.533051Z [info ] Elapsed time: 17.535041570663452 [0:00:17.535042] [timeout_sampler] --------------------------------------------------------- CALL --------------------------------------------------------- PASSED TEST: TestNotebook.test_auth_container_resource_customization[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0] STATUS: PASSED ------------------------------------------------------- TEARDOWN ------------------------------------------------------- 2026-06-02T05:24:08.548864Z [info ] Delete Notebook test-auth-notebook [ocp_resources Notebook] 2026-06-02T05:24:08.591076Z [info ] Deleting {'apiVersion': 'kubeflow.org/v1', 'kind': 'Notebook', 'metadata': {'annotations': {'notebooks.opendatahub.io/auth-sidecar-cpu-limit': '500m', 'notebooks.opendatahub.io/auth-sidecar-cpu-request': '200m', 'notebooks.opendatahub.io/auth-sidecar-memory-limit': '256Mi', 'notebooks.opendatahub.io/auth-sidecar-memory-request': '128Mi', 'notebooks.opendatahub.io/inject-auth': 'true', 'notebooks.opendatahub.io/last-image-selection': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.4', 'opendatahub.io/accelerator-name': ''}, 'creationTimestamp': '2026-06-02T05:23:49Z', 'finalizers': ['notebook.opendatahub.io/kube-rbac-proxy-cleanup', 'notebook.opendatahub.io/httproute-cleanup', 'notebook.opendatahub.io/referencegrant-cleanup'], 'generation': 1, 'labels': {'app': 'test-auth-notebook', 'opendatahub.io/dashboard': 'true', 'opendatahub.io/odh-managed': 'true'}, 'managedFields': [{'apiVersion': 'kubeflow.org/v1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:notebooks.opendatahub.io/auth-sidecar-cpu-limit': {}, 'f:notebooks.opendatahub.io/auth-sidecar-cpu-request': {}, 'f:notebooks.opendatahub.io/auth-sidecar-memory-limit': {}, 'f:notebooks.opendatahub.io/auth-sidecar-memory-request': {}, 'f:notebooks.opendatahub.io/inject-auth': {}, 'f:notebooks.opendatahub.io/last-image-selection': {}, 'f:opendatahub.io/accelerator-name': {}}, 'f:finalizers': {'.': {}, 'v:"notebook.opendatahub.io/kube-rbac-proxy-cleanup"': {}}, 'f:labels': {'.': {}, 'f:app': {}, 'f:opendatahub.io/dashboard': {}, 'f:opendatahub.io/odh-managed': {}}}, 'f:spec': {'.': {}, 'f:template': {'.': {}, 'f:spec': {'.': {}, 'f:affinity': {}, 'f:containers': {'.': {}, 'k:{"name":"test-auth-notebook"}': {'.': {}, 'f:env': {'.': {}, 'k:{"name":"JUPYTER_IMAGE"}': {'.': {}, 'f:name': {}, 'f:value': {}}, 'k:{"name":"NOTEBOOK_ARGS"}': {'.': {}, 'f:name': {}, 'f:value': {}}}, 'f:image': {}, 'f:imagePullPolicy': {}, 'f:livenessProbe': {'.': {}, 'f:failureThreshold': {}, 'f:httpGet': {'.': {}, 'f:path': {}, 'f:port': {}, 'f:scheme': {}}, 'f:initialDelaySeconds': {}, 'f:periodSeconds': {}, 'f:successThreshold': {}, 'f:timeoutSeconds': {}}, 'f:name': {}, 'f:ports': {'.': {}, 'k:{"containerPort":8888,"protocol":"TCP"}': {'.': {}, 'f:containerPort': {}, 'f:name': {}, 'f:protocol': {}}}, 'f:readinessProbe': {'.': {}, 'f:failureThreshold': {}, 'f:httpGet': {'.': {}, 'f:path': {}, 'f:port': {}, 'f:scheme': {}}, 'f:initialDelaySeconds': {}, 'f:periodSeconds': {}, 'f:successThreshold': {}, 'f:timeoutSeconds': {}}, 'f:resources': {'.': {}, 'f:limits': {'.': {}, 'f:cpu': {}, 'f:memory': {}}, 'f:requests': {'.': {}, 'f:cpu': {}, 'f:memory': {}}}, 'f:volumeMounts': {'.': {}, 'k:{"mountPath":"/dev/shm"}': {'.': {}, 'f:mountPath': {}, 'f:name': {}}, 'k:{"mountPath":"/opt/app-root/src"}': {'.': {}, 'f:mountPath': {}, 'f:name': {}}}, 'f:workingDir': {}}}, 'f:enableServiceLinks': {}, 'f:serviceAccountName': {}, 'f:volumes': {'.': {}, 'k:{"name":"kube-rbac-proxy-config"}': {'.': {}, 'f:configMap': {}, 'f:name': {}}, 'k:{"name":"kube-rbac-proxy-tls-certificates"}': {'.': {}, 'f:name': {}, 'f:secret': {'.': {}, 'f:defaultMode': {}, 'f:secretName': {}}}, 'k:{"name":"shm"}': {'.': {}, 'f:emptyDir': {'.': {}, 'f:medium': {}}, 'f:name': {}}, 'k:{"name":"test-auth-notebook"}': {'.': {}, 'f:name': {}, 'f:persistentVolumeClaim': {'.': {}, 'f:claimName': {}}}}}}}}, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': '2026-06-02T05:23:49Z'}, {'apiVersion': 'kubeflow.org/v1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:finalizers': {'v:"notebook.opendatahub.io/httproute-cleanup"': {}, 'v:"notebook.opendatahub.io/referencegrant-cleanup"': {}}}}, 'manager': 'manager', 'operation': 'Update', 'time': '2026-06-02T05:23:50Z'}, {'apiVersion': 'kubeflow.org/v1beta1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'.': {}, 'f:conditions': {}, 'f:containerState': {'.': {}, 'f:running': {'.': {}, 'f:startedAt': {}}}, 'f:readyReplicas': {}}}, 'manager': 'manager', 'operation': 'Update', 'subresource': 'status', 'time': '2026-06-02T05:24:08Z'}], 'name': 'test-auth-notebook', 'namespace': 'test-auth-notebook', 'resourceVersion': '243924009', 'uid': '96cc63f3-06ab-49ad-8c7f-680381e00478'}, 'spec': {'template': {'spec': {'affinity': {}, 'containers': [{'env': [{'name': 'NOTEBOOK_ARGS', 'value': "--ServerApp.port=8888\n --ServerApp.token=''\n --ServerApp.password=''\n --ServerApp.base_url=/notebook/test-auth-notebook/test-auth-notebook\n --ServerApp.quit_button=False\n"}, {'name': 'JUPYTER_IMAGE', 'value': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.4'}, {'name': 'PIP_CERT', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}, {'name': 'REQUESTS_CA_BUNDLE', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}, {'name': 'SSL_CERT_FILE', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}, {'name': 'PIPELINES_SSL_SA_CERTS', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}, {'name': 'KF_PIPELINES_SSL_SA_CERTS', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}, {'name': 'GIT_SSL_CAINFO', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}], 'image': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.4', 'imagePullPolicy': 'Always', 'livenessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/notebook/test-auth-notebook/test-auth-notebook/api', 'port': 'notebook-port', 'scheme': 'HTTP'}, 'initialDelaySeconds': 10, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'name': 'test-auth-notebook', 'ports': [{'containerPort': 8888, 'name': 'notebook-port', 'protocol': 'TCP'}], 'readinessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/notebook/test-auth-notebook/test-auth-notebook/api', 'port': 'notebook-port', 'scheme': 'HTTP'}, 'initialDelaySeconds': 10, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'resources': {'limits': {'cpu': '2', 'memory': '4Gi'}, 'requests': {'cpu': '1', 'memory': '1Gi'}}, 'volumeMounts': [{'mountPath': '/opt/app-root/src', 'name': 'test-auth-notebook'}, {'mountPath': '/dev/shm', 'name': 'shm'}, {'mountPath': '/etc/pki/tls/custom-certs/ca-bundle.crt', 'name': 'trusted-ca', 'readOnly': True, 'subPath': 'ca-bundle.crt'}, {'mountPath': '/opt/app-root/pipeline-runtimes/', 'name': 'runtime-images'}], 'workingDir': '/opt/app-root/src'}, {'args': ['--secure-listen-address=0.0.0.0:8443', '--upstream=http://127.0.0.1:8888/', '--logtostderr=true', '--v=10', '--proxy-endpoints-port=8444', '--config-file=/etc/kube-rbac-proxy/config-file.yaml', '--tls-cert-file=/etc/tls/private/tls.crt', '--tls-private-key-file=/etc/tls/private/tls.key', '--auth-header-fields-enabled=true', '--auth-header-user-field-name=X-Auth-Request-User', '--auth-header-groups-field-name=X-Auth-Request-Groups'], 'image': 'registry.redhat.io/rhoai/odh-kube-auth-proxy-rhel9@sha256:b113d3c4adc2e5456a99c12384d0827cc82e0e3acb2a42adeb75f80f1654f936', 'imagePullPolicy': 'Always', 'livenessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/healthz', 'port': 8444, 'scheme': 'HTTPS'}, 'initialDelaySeconds': 30, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'name': 'kube-rbac-proxy', 'ports': [{'containerPort': 8443, 'name': 'kube-rbac-proxy', 'protocol': 'TCP'}], 'readinessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/healthz', 'port': 8444, 'scheme': 'HTTPS'}, 'initialDelaySeconds': 5, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'resources': {'limits': {'cpu': '500m', 'memory': '256Mi'}, 'requests': {'cpu': '200m', 'memory': '128Mi'}}, 'volumeMounts': [{'mountPath': '/etc/kube-rbac-proxy', 'name': 'kube-rbac-proxy-config'}, {'mountPath': '/etc/tls/private', 'name': 'kube-rbac-proxy-tls-certificates'}]}], 'enableServiceLinks': False, 'serviceAccountName': 'test-auth-notebook', 'volumes': [{'name': 'test-auth-notebook', 'persistentVolumeClaim': {'claimName': 'test-auth-notebook'}}, {'emptyDir': {'medium': 'Memory'}, 'name': 'shm'}, {'configMap': {'defaultMode': 420, 'name': 'test-auth-notebook-kube-rbac-proxy-config'}, 'name': 'kube-rbac-proxy-config'}, {'name': 'kube-rbac-proxy-tls-certificates', 'secret': {'defaultMode': 420, 'secretName': 'test-auth-notebook-kube-rbac-proxy-tls'}}, {'configMap': {'items': [{'key': 'ca-bundle.crt', 'path': 'ca-bundle.crt'}], 'name': 'workbench-trusted-ca-bundle', 'optional': True}, 'name': 'trusted-ca'}, {'configMap': {'name': 'pipeline-runtime-images', 'optional': True}, 'name': 'runtime-images'}]}}}, 'status': {'conditions': [{'lastProbeTime': '2026-06-02T05:24:08Z', 'lastTransitionTime': '2026-06-02T05:23:55Z', 'status': 'True', 'type': 'PodReadyToStartContainers'}, {'lastProbeTime': '2026-06-02T05:24:08Z', 'lastTransitionTime': '2026-06-02T05:23:51Z', 'status': 'True', 'type': 'Initialized'}, {'lastProbeTime': '2026-06-02T05:24:08Z', 'lastTransitionTime': '2026-06-02T05:24:07Z', 'status': 'True', 'type': 'Ready'}, {'lastProbeTime': '2026-06-02T05:24:08Z', 'lastTransitionTime': '2026-06-02T05:24:07Z', 'status': 'True', 'type': 'ContainersReady'}, {'lastProbeTime': '2026-06-02T05:24:08Z', 'lastTransitionTime': '2026-06-02T05:23:51Z', 'status': 'True', 'type': 'PodScheduled'}], 'containerState': {'running': {'startedAt': '2026-06-02T05:23:54Z'}}, 'readyReplicas': 1}} [ocp_resources Notebook] 2026-06-02T05:24:08.614711Z [info ] Wait until Notebook test-auth-notebook is deleted [ocp_resources Notebook] 2026-06-02T05:24:08.614991Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-06-02T05:24:09.648793Z [info ] Elapsed time: 1.0170753002166748 [0:00:01.017075] [timeout_sampler] 2026-06-02T05:24:09.648978Z [info ] Delete PersistentVolumeClaim test-auth-notebook [ocp_resources PersistentVolumeClaim] 2026-06-02T05:24:09.678956Z [info ] Deleting {'kind': 'PersistentVolumeClaim', 'apiVersion': 'v1', 'metadata': {'name': 'test-auth-notebook', 'namespace': 'test-auth-notebook', 'uid': 'a29f7e72-83a0-4fe4-8026-b8f771efd33e', 'resourceVersion': '243923730', 'creationTimestamp': '2026-06-02T05:23:49Z', 'labels': {'opendatahub.io/dashboard': 'true'}, 'annotations': {'pv.kubernetes.io/bind-completed': 'yes', 'pv.kubernetes.io/bound-by-controller': 'yes', 'volume.beta.kubernetes.io/storage-provisioner': 'cinder.csi.openstack.org', 'volume.kubernetes.io/selected-node': 'ods-qe-psi-09-p2fn8-worker-0-425l6', 'volume.kubernetes.io/storage-provisioner': 'cinder.csi.openstack.org'}, 'finalizers': ['kubernetes.io/pvc-protection'], 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-02T05:23:49Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:labels': {'.': {}, 'f:opendatahub.io/dashboard': {}}}, 'f:spec': {'f:accessModes': {}, 'f:resources': {'f:requests': {'.': {}, 'f:storage': {}}}, 'f:volumeMode': {}}}}, {'manager': 'kube-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-02T05:23:50Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:pv.kubernetes.io/bind-completed': {}, 'f:pv.kubernetes.io/bound-by-controller': {}, 'f:volume.beta.kubernetes.io/storage-provisioner': {}, 'f:volume.kubernetes.io/storage-provisioner': {}}}, 'f:spec': {'f:volumeName': {}}}}, {'manager': 'kube-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-02T05:23:50Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'f:accessModes': {}, 'f:capacity': {'.': {}, 'f:storage': {}}, 'f:phase': {}}}, 'subresource': 'status'}, {'manager': 'kube-scheduler', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-02T05:23:50Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:volume.kubernetes.io/selected-node': {}}}}}]}, 'spec': {'accessModes': ['ReadWriteOnce'], 'resources': {'requests': {'storage': '10Gi'}}, 'volumeName': 'pvc-a29f7e72-83a0-4fe4-8026-b8f771efd33e', 'storageClassName': 'standard-csi', 'volumeMode': 'Filesystem'}, 'status': {'phase': 'Bound', 'accessModes': ['ReadWriteOnce'], 'capacity': {'storage': '10Gi'}}} [ocp_resources PersistentVolumeClaim] 2026-06-02T05:24:09.698158Z [info ] Wait until PersistentVolumeClaim test-auth-notebook is deleted [ocp_resources PersistentVolumeClaim] 2026-06-02T05:24:09.698388Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-06-02T05:24:10.728822Z [info ] Elapsed time: 1.0146141052246094 [0:00:01.014614] [timeout_sampler] 2026-06-02T05:24:10.745192Z [info ] Delete Project test-auth-notebook [ocp_resources Project] 2026-06-02T05:24:11.020582Z [info ] Deleting {'kind': 'Project', 'apiVersion': 'project.openshift.io/v1', 'metadata': {'name': 'test-auth-notebook', 'uid': '85314cb9-fcad-4044-832d-4cb5b6dbc067', 'resourceVersion': '243923635', 'creationTimestamp': '2026-06-02T05:23:48Z', 'labels': {'kubernetes.io/metadata.name': 'test-auth-notebook', 'opendatahub.io/dashboard': 'true', 'pod-security.kubernetes.io/audit': 'restricted', 'pod-security.kubernetes.io/audit-version': 'latest', 'pod-security.kubernetes.io/warn': 'restricted', 'pod-security.kubernetes.io/warn-version': 'latest'}, 'annotations': {'openshift.io/description': '', 'openshift.io/display-name': '', 'openshift.io/requester': 'htpasswd-cluster-admin-user', 'openshift.io/sa.scc.mcs': 's0:c32,c14', 'openshift.io/sa.scc.supplemental-groups': '1001020000/10000', 'openshift.io/sa.scc.uid-range': '1001020000/10000', 'security.openshift.io/MinimallySufficientPodSecurityStandard': 'restricted'}, 'managedFields': [{'manager': 'pod-security-admission-label-synchronization-controller', 'operation': 'Apply', 'apiVersion': 'v1', 'time': '2026-06-02T05:23:48Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:security.openshift.io/MinimallySufficientPodSecurityStandard': {}}, 'f:labels': {'f:pod-security.kubernetes.io/audit': {}, 'f:pod-security.kubernetes.io/audit-version': {}, 'f:pod-security.kubernetes.io/warn': {}, 'f:pod-security.kubernetes.io/warn-version': {}}}}}, {'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-02T05:23:48Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:labels': {'f:opendatahub.io/dashboard': {}}}}}, {'manager': 'cluster-policy-controller', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-02T05:23:48Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:openshift.io/sa.scc.mcs': {}, 'f:openshift.io/sa.scc.supplemental-groups': {}, 'f:openshift.io/sa.scc.uid-range': {}}}}}, {'manager': 'openshift-apiserver', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-02T05:23:48Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:openshift.io/description': {}, 'f:openshift.io/display-name': {}, 'f:openshift.io/requester': {}}, 'f:labels': {'.': {}, 'f:kubernetes.io/metadata.name': {}}}}}, {'manager': 'openshift-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-06-02T05:23:48Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'f:finalizers': {}}}, 'subresource': 'finalize'}]}, 'spec': {'finalizers': ['kubernetes']}, 'status': {'phase': 'Active'}} [ocp_resources Project] 2026-06-02T05:24:11.052677Z [info ] Wait until Project test-auth-notebook is deleted [ocp_resources Project] 2026-06-02T05:24:11.052857Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] _ 2 of 5 completed, 2 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _ tests/workbenches/notebooks_server/operator/test_imagestream_health.py::test_workbench_imagestreams_health[notebook_imagestreams] 2026-06-02T05:24:19.256141Z [info ] Elapsed time: 8.154499292373657 [0:00:08.154499] [timeout_sampler]  ------------------------------ test_workbench_imagestreams_health[notebook_imagestreams] ------------------------------ -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-06-02T05:24:19.257732Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.257875Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.258031Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.258178Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.258616Z [info ] [cached since 202s ago] ('/home/odh/opendatahub-tests/tests/workbenches/notebooks_server/operator/test_imagestream_health.py::test_workbench_imagestreams_health[notebook_imagestreams]', 1780377859) [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.260756Z [info ] [cached since 202s ago] ('/home/odh/opendatahub-tests/tests/workbenches/notebooks_server/operator/test_imagestream_health.py::test_workbench_imagestreams_health[notebook_imagestreams]', 1780377859) [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.261070Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.261214Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.261392Z [info ] Executing function fixture: label_selector [conftest] 2026-06-02T05:24:19.261532Z [info ] Executing function fixture: expected_imagestream_count [conftest] --------------------------------------------------------- CALL --------------------------------------------------------- 2026-06-02T05:24:19.261792Z [info ] kind: ImageStream api version: image.openshift.io/v1 [ocp_resources.resource] 2026-06-02T05:24:19.337756Z [info ] Checking ImageStreams for label selector 'opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches': expected_count=11, actual_count=11 [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.337852Z [info ] ImageStreams matched for 'opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches': code-server-notebook, jupyter-pytorch-llmcompressor, jupyter-rocm-minimal, jupyter-rocm-pytorch, jupyter-rocm-tensorflow, minimal-gpu, odh-trustyai-notebook, pytorch, s2i-generic-data-science-notebook, s2i-minimal-notebook, tensorflow [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.357696Z [info ] Validating ImageStream code-server-notebook (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.357768Z [info ] ImageStream code-server-notebook tag coverage: spec_tags=['2023.2', '2024.1', '2024.2', '2025.1', '2025.2', '3.4'], status_tags=['2023.2', '2024.1', '2024.2', '2025.1', '2025.2', '3.4'] [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.357815Z [info ] Checked ImageStream tag code-server-notebook:2023.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.357854Z [info ] Checked ImageStream tag code-server-notebook:2024.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.357888Z [info ] Checked ImageStream tag code-server-notebook:2024.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.357917Z [info ] Checked ImageStream tag code-server-notebook:2025.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.357945Z [info ] Checked ImageStream tag code-server-notebook:2025.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.357971Z [info ] Checked ImageStream tag code-server-notebook:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.377810Z [info ] Validating ImageStream jupyter-pytorch-llmcompressor (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.377899Z [info ] ImageStream jupyter-pytorch-llmcompressor tag coverage: spec_tags=['2025.2', '3.4'], status_tags=['2025.2', '3.4'] [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.377943Z [info ] Checked ImageStream tag jupyter-pytorch-llmcompressor:2025.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.377980Z [info ] Checked ImageStream tag jupyter-pytorch-llmcompressor:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.395727Z [info ] Validating ImageStream jupyter-rocm-minimal (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.395837Z [info ] ImageStream jupyter-rocm-minimal tag coverage: spec_tags=['2024.2', '2025.1', '2025.2', '3.4'], status_tags=['2024.2', '2025.1', '2025.2', '3.4'] [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.395887Z [info ] Checked ImageStream tag jupyter-rocm-minimal:2024.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.395930Z [info ] Checked ImageStream tag jupyter-rocm-minimal:2025.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.395966Z [info ] Checked ImageStream tag jupyter-rocm-minimal:2025.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.396002Z [info ] Checked ImageStream tag jupyter-rocm-minimal:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.413988Z [info ] Validating ImageStream jupyter-rocm-pytorch (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.414073Z [info ] ImageStream jupyter-rocm-pytorch tag coverage: spec_tags=['2024.2', '2025.1', '2025.2', '3.4'], status_tags=['2024.2', '2025.1', '2025.2', '3.4'] [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.414119Z [info ] Checked ImageStream tag jupyter-rocm-pytorch:2024.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.414159Z [info ] Checked ImageStream tag jupyter-rocm-pytorch:2025.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.414193Z [info ] Checked ImageStream tag jupyter-rocm-pytorch:2025.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.414224Z [info ] Checked ImageStream tag jupyter-rocm-pytorch:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.432489Z [info ] Validating ImageStream jupyter-rocm-tensorflow (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.432563Z [info ] ImageStream jupyter-rocm-tensorflow tag coverage: spec_tags=['2024.2', '2025.1', '2025.2', '3.4'], status_tags=['2024.2', '2025.1', '2025.2', '3.4'] [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.432604Z [info ] Checked ImageStream tag jupyter-rocm-tensorflow:2024.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.432639Z [info ] Checked ImageStream tag jupyter-rocm-tensorflow:2025.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.432669Z [info ] Checked ImageStream tag jupyter-rocm-tensorflow:2025.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.432696Z [info ] Checked ImageStream tag jupyter-rocm-tensorflow:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.451540Z [info ] Validating ImageStream minimal-gpu (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.451629Z [info ] ImageStream minimal-gpu tag coverage: spec_tags=['1.2', '2023.1', '2023.2', '2024.1', '2024.2', '2025.1', '2025.2', '3.4'], status_tags=['1.2', '2023.1', '2023.2', '2024.1', '2024.2', '2025.1', '2025.2', '3.4'] [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.451671Z [info ] Checked ImageStream tag minimal-gpu:1.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.451706Z [info ] Checked ImageStream tag minimal-gpu:2023.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.451736Z [info ] Checked ImageStream tag minimal-gpu:2023.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.451765Z [info ] Checked ImageStream tag minimal-gpu:2024.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.451793Z [info ] Checked ImageStream tag minimal-gpu:2024.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.451819Z [info ] Checked ImageStream tag minimal-gpu:2025.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.451844Z [info ] Checked ImageStream tag minimal-gpu:2025.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.451871Z [info ] Checked ImageStream tag minimal-gpu:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.471600Z [info ] Validating ImageStream odh-trustyai-notebook (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.471672Z [info ] ImageStream odh-trustyai-notebook tag coverage: spec_tags=['2023.1', '2023.2', '2024.1', '2024.2', '2025.1', '2025.2', '3.4'], status_tags=['2023.1', '2023.2', '2024.1', '2024.2', '2025.1', '2025.2', '3.4'] [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.471713Z [info ] Checked ImageStream tag odh-trustyai-notebook:2023.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.471749Z [info ] Checked ImageStream tag odh-trustyai-notebook:2023.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.471779Z [info ] Checked ImageStream tag odh-trustyai-notebook:2024.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.471808Z [info ] Checked ImageStream tag odh-trustyai-notebook:2024.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.471837Z [info ] Checked ImageStream tag odh-trustyai-notebook:2025.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.471865Z [info ] Checked ImageStream tag odh-trustyai-notebook:2025.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.471893Z [info ] Checked ImageStream tag odh-trustyai-notebook:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.491479Z [info ] Validating ImageStream pytorch (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.491604Z [info ] ImageStream pytorch tag coverage: spec_tags=['1.2', '2023.1', '2023.2', '2024.1', '2024.2', '2025.1', '2025.2', '3.4'], status_tags=['1.2', '2023.1', '2023.2', '2024.1', '2024.2', '2025.1', '2025.2', '3.4'] [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.491648Z [info ] Checked ImageStream tag pytorch:1.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.491682Z [info ] Checked ImageStream tag pytorch:2023.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.491713Z [info ] Checked ImageStream tag pytorch:2023.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.491741Z [info ] Checked ImageStream tag pytorch:2024.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.491767Z [info ] Checked ImageStream tag pytorch:2024.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.491793Z [info ] Checked ImageStream tag pytorch:2025.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.491818Z [info ] Checked ImageStream tag pytorch:2025.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.491843Z [info ] Checked ImageStream tag pytorch:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.510030Z [info ] Validating ImageStream s2i-generic-data-science-notebook (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.510102Z [info ] ImageStream s2i-generic-data-science-notebook tag coverage: spec_tags=['1.2', '2023.1', '2023.2', '2024.1', '2024.2', '2025.1', '2025.2', '3.4'], status_tags=['1.2', '2023.1', '2023.2', '2024.1', '2024.2', '2025.1', '2025.2', '3.4'] [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.510142Z [info ] Checked ImageStream tag s2i-generic-data-science-notebook:1.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.510177Z [info ] Checked ImageStream tag s2i-generic-data-science-notebook:2023.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.510206Z [info ] Checked ImageStream tag s2i-generic-data-science-notebook:2023.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.510234Z [info ] Checked ImageStream tag s2i-generic-data-science-notebook:2024.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.510261Z [info ] Checked ImageStream tag s2i-generic-data-science-notebook:2024.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.510288Z [info ] Checked ImageStream tag s2i-generic-data-science-notebook:2025.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.510336Z [info ] Checked ImageStream tag s2i-generic-data-science-notebook:2025.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.510372Z [info ] Checked ImageStream tag s2i-generic-data-science-notebook:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.532008Z [info ] Validating ImageStream s2i-minimal-notebook (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.532086Z [info ] ImageStream s2i-minimal-notebook tag coverage: spec_tags=['1.2', '2023.1', '2023.2', '2024.1', '2024.2', '2025.1', '2025.2', '3.4'], status_tags=['1.2', '2023.1', '2023.2', '2024.1', '2024.2', '2025.1', '2025.2', '3.4'] [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.532125Z [info ] Checked ImageStream tag s2i-minimal-notebook:1.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.532159Z [info ] Checked ImageStream tag s2i-minimal-notebook:2023.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.532189Z [info ] Checked ImageStream tag s2i-minimal-notebook:2023.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.532218Z [info ] Checked ImageStream tag s2i-minimal-notebook:2024.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.532245Z [info ] Checked ImageStream tag s2i-minimal-notebook:2024.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.532277Z [info ] Checked ImageStream tag s2i-minimal-notebook:2025.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.532304Z [info ] Checked ImageStream tag s2i-minimal-notebook:2025.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.532356Z [info ] Checked ImageStream tag s2i-minimal-notebook:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health PASSED _ 3 of 5 completed, 3 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _ tests/workbenches/notebooks_server/operator/test_imagestream_health.py::test_workbench_imagestreams_health[runtime_imagestreams] 2026-06-02T05:24:19.551213Z [info ] Validating ImageStream tensorflow (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.551294Z [info ] ImageStream tensorflow tag coverage: spec_tags=['1.2', '2023.1', '2023.2', '2024.1', '2024.2', '2025.1', '2025.2', '3.4'], status_tags=['1.2', '2023.1', '2023.2', '2024.1', '2024.2', '2025.1', '2025.2', '3.4'] [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.551375Z [info ] Checked ImageStream tag tensorflow:1.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.551412Z [info ] Checked ImageStream tag tensorflow:2023.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.551444Z [info ] Checked ImageStream tag tensorflow:2023.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.551471Z [info ] Checked ImageStream tag tensorflow:2024.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.551497Z [info ] Checked ImageStream tag tensorflow:2024.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.551524Z [info ] Checked ImageStream tag tensorflow:2025.1 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.551550Z [info ] Checked ImageStream tag tensorflow:2025.2 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.551577Z [info ] Checked ImageStream tag tensorflow:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health  TEST: test_workbench_imagestreams_health[notebook_imagestreams] STATUS: PASSED ------------------------------------------------------- TEARDOWN -------------------------------------------------------  ------------------------------- test_workbench_imagestreams_health[runtime_imagestreams] ------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-06-02T05:24:19.557811Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.557937Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.558059Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.558176Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.558640Z [info ] [cached since 202.3s ago] ('/home/odh/opendatahub-tests/tests/workbenches/notebooks_server/operator/test_imagestream_health.py::test_workbench_imagestreams_health[runtime_imagestreams]', 1780377859) [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.558808Z [info ] [cached since 202.3s ago] ('/home/odh/opendatahub-tests/tests/workbenches/notebooks_server/operator/test_imagestream_health.py::test_workbench_imagestreams_health[runtime_imagestreams]', 1780377859) [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.558940Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.559067Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.559191Z [info ] Executing function fixture: label_selector [conftest] 2026-06-02T05:24:19.559312Z [info ] Executing function fixture: expected_imagestream_count [conftest] --------------------------------------------------------- CALL --------------------------------------------------------- 2026-06-02T05:24:19.578609Z [info ] Checking ImageStreams for label selector 'opendatahub.io/runtime-image=true,platform.opendatahub.io/part-of=workbenches': expected_count=7, actual_count=7 [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.578683Z [info ] ImageStreams matched for 'opendatahub.io/runtime-image=true,platform.opendatahub.io/part-of=workbenches': runtime-datascience, runtime-minimal, runtime-pytorch, runtime-pytorch-llmcompressor, runtime-rocm-pytorch, runtime-rocm-tensorflow, runtime-tensorflow [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.598606Z [info ] Validating ImageStream runtime-datascience (label selector: opendatahub.io/runtime-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.598672Z [info ] ImageStream runtime-datascience tag coverage: spec_tags=['datascience'], status_tags=['datascience'] [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.598711Z [info ] Checked ImageStream tag runtime-datascience:datascience (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.618094Z [info ] Validating ImageStream runtime-minimal (label selector: opendatahub.io/runtime-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.618173Z [info ] ImageStream runtime-minimal tag coverage: spec_tags=['minimal'], status_tags=['minimal'] [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.618221Z [info ] Checked ImageStream tag runtime-minimal:minimal (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.636982Z [info ] Validating ImageStream runtime-pytorch (label selector: opendatahub.io/runtime-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.637096Z [info ] ImageStream runtime-pytorch tag coverage: spec_tags=['pytorch'], status_tags=['pytorch'] [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.637159Z [info ] Checked ImageStream tag runtime-pytorch:pytorch (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.657145Z [info ] Validating ImageStream runtime-pytorch-llmcompressor (label selector: opendatahub.io/runtime-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.657284Z [info ] ImageStream runtime-pytorch-llmcompressor tag coverage: spec_tags=['pytorch-llmcompressor'], status_tags=['pytorch-llmcompressor'] [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.657369Z [info ] Checked ImageStream tag runtime-pytorch-llmcompressor:pytorch-llmcompressor (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.676433Z [info ] Validating ImageStream runtime-rocm-pytorch (label selector: opendatahub.io/runtime-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.676574Z [info ] ImageStream runtime-rocm-pytorch tag coverage: spec_tags=['rocm-pytorch'], status_tags=['rocm-pytorch'] [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.676620Z [info ] Checked ImageStream tag runtime-rocm-pytorch:rocm-pytorch (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.697441Z [info ] Validating ImageStream runtime-rocm-tensorflow (label selector: opendatahub.io/runtime-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.697572Z [info ] ImageStream runtime-rocm-tensorflow tag coverage: spec_tags=['rocm-tensorflow'], status_tags=['rocm-tensorflow'] [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.697628Z [info ] Checked ImageStream tag runtime-rocm-tensorflow:rocm-tensorflow (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health PASSED _ 4 of 5 completed, 4 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _ tests/workbenches/notebooks_server/operator/test_imagestream_health.py::test_workbench_imagestreams_health[trainer_imagestreams] 2026-06-02T05:24:19.718634Z [info ] Validating ImageStream runtime-tensorflow (label selector: opendatahub.io/runtime-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.718708Z [info ] ImageStream runtime-tensorflow tag coverage: spec_tags=['tensorflow'], status_tags=['tensorflow'] [_pytest.compat] name=test_imagestream_health 2026-06-02T05:24:19.718748Z [info ] Checked ImageStream tag runtime-tensorflow:tensorflow (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health  TEST: test_workbench_imagestreams_health[runtime_imagestreams] STATUS: PASSED ------------------------------------------------------- TEARDOWN -------------------------------------------------------  ------------------------------- test_workbench_imagestreams_health[trainer_imagestreams] ------------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-06-02T05:24:19.722891Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.723046Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.725111Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.725543Z [info ] INSERT INTO "OpenDataHubTestTable" (test_name, start_time) VALUES (?, ?) [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.725773Z [info ] [cached since 202.4s ago] ('/home/odh/opendatahub-tests/tests/workbenches/notebooks_server/operator/test_imagestream_health.py::test_workbench_imagestreams_health[trainer_imagestreams]', 1780377859) [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.725986Z [info ] [cached since 202.4s ago] ('/home/odh/opendatahub-tests/tests/workbenches/notebooks_server/operator/test_imagestream_health.py::test_workbench_imagestreams_health[trainer_imagestreams]', 1780377859) [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.726148Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.726302Z [info ] COMMIT  [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.726489Z [info ] Executing function fixture: label_selector [conftest] 2026-06-02T05:24:19.726617Z [info ] Executing function fixture: expected_imagestream_count [conftest] --------------------------------------------------------- CALL --------------------------------------------------------- 2026-06-02T05:24:19.746865Z [info ] Checking ImageStreams for label selector 'opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=trainer': expected_count=3, actual_count=0 [_pytest.compat] name=test_imagestream_health FAILED TEST: test_workbench_imagestreams_health[trainer_imagestreams] STATUS: FAILED 2026-06-02T05:24:19.760694Z [error ] Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 179, in pytest_runtest_call item.runtest() ~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1720, in runtest self.ihook.pytest_pyfunc_call(pyfuncitem=self) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 166, in pytest_pyfunc_call result = testfunction(**testargs) File "/home/odh/opendatahub-tests/tests/workbenches/notebooks_server/operator/test_imagestream_health.py", line 214, in test_workbench_imagestreams_health _validate_imagestreams_with_label( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ imagestreams=imagestreams, ^^^^^^^^^^^^^^^^^^^^^^^^^^ label_selector=label_selector, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ expected_count=expected_imagestream_count, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/tests/workbenches/notebooks_server/operator/test_imagestream_health.py", line 173, in _validate_imagestreams_with_label pytest.fail("\n".join(errors)) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/outcomes.py", line 163, in __call__ raise Failed(msg=reason, pytrace=pytrace) Failed: Expected 3 ImageStreams with label 'opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=trainer', found 0. Found: [] [conftest] 2026-06-02T05:24:19.762075Z [info ] Must-gather collection is enabled for /home/odh/opendatahub-tests/tests/workbenches/notebooks_server/operator/test_imagestream_health.py::test_workbench_imagestreams_health[trainer_imagestreams]. [conftest] 2026-06-02T05:24:19.762237Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.762423Z [info ] BEGIN (implicit)  [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.762578Z [info ] SELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" FROM "OpenDataHubTestTable" WHERE "OpenDataHubTestTable".test_name = ? LIMIT ? OFFSET ? [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.762734Z [info ] SELECT "OpenDataHubTestTable".start_time AS "OpenDataHubTestTable_start_time" FROM "OpenDataHubTestTable" WHERE "OpenDataHubTestTable".test_name = ? LIMIT ? OFFSET ? [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.762920Z [info ] [generated in 0.00019s] ('/home/odh/opendatahub-tests/tests/workbenches/notebooks_server/operator/test_imagestream_health.py::test_workbench_imagestreams_health[trainer_imagestreams]', 1, 0) [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.763244Z [info ] [generated in 0.00019s] ('/home/odh/opendatahub-tests/tests/workbenches/notebooks_server/operator/test_imagestream_health.py::test_workbench_imagestreams_health[trainer_imagestreams]', 1, 0) [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.763431Z [info ] ROLLBACK  [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.763584Z [info ] ROLLBACK  [sqlalchemy.engine.Engine] 2026-06-02T05:24:19.766268Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] 2026-06-02T05:24:19.770880Z [info ] kind: Subscription api version: operators.coreos.com/v1alpha1 [ocp_resources.resource] 2026-06-02T05:24:19.892266Z [info ] Checking subscription rhoai-operator-dev [utilities.infra] name=utilities.infra 2026-06-02T05:24:19.917949Z [info ] Expected CSV: rhods-operator.3.4.0-ea.1 [utilities.infra] name=utilities.infra 2026-06-02T05:24:19.921583Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] 2026-06-02T05:24:20.108658Z [info ] Running oc adm must-gather --dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/workbenches/notebooks_server/operator/test_imagestream_health/test_workbench_imagestreams_health_trainer_imagestreams_/pytest_exception_interact --since=300s --image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:7b394654b91821bd58cfe973c2d28f94b8ae323ed75e2e0de6fee1988b525690 command [pyhelper_utils.shell] 2026-06-02T05:39:20.122504Z [warning ] Failed to collect logs: /home/odh/opendatahub-tests/tests/workbenches/notebooks_server/operator/test_imagestream_health.py::test_workbench_imagestreams_health[trainer_imagestreams]: Command '['oc', 'adm', 'must-gather', '--dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/workbenches/notebooks_server/operator/test_imagestream_health/test_workbench_imagestreams_health_trainer_imagestreams_/pytest_exception_interact', '--since=300s', '--image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:7b394654b91821bd58cfe973c2d28f94b8ae323ed75e2e0de6fee1988b525690']' timed out after 900 seconds Traceback (most recent call last): File "/home/odh/opendatahub-tests/conftest.py", line 530, in pytest_exception_interact collect_rhoai_must_gather( ~~~~~~~~~~~~~~~~~~~~~~~~~^ base_file_name=f"mg-{test_start_time}", ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ since=calculate_must_gather_timer(test_start_time=test_start_time), ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ target_dir=os.path.join(get_must_gather_collector_dir(), "pytest_exception_interact"), ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/utilities/must_gather_collector.py", line 175, in collect_rhoai_must_gather output = run_must_gather(image_url=must_gather_image, target_dir=target_dir, since=f"{since}s") File "/home/odh/opendatahub-tests/utilities/must_gather_collector.py", line 137, in run_must_gather return run_command(command=shlex.split(must_gather_command), check=False, timeout=timeout)[1] ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pyhelper_utils/shell.py", line 59, in run_command sub_process = subprocess.run( command, ...<5 lines>... **kwargs, ) File "/usr/lib64/python3.14/subprocess.py", line 557, in run stdout, stderr = process.communicate(input, timeout=timeout) ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib64/python3.14/subprocess.py", line 1221, in communicate stdout, stderr = self._communicate(input, endtime, timeout) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib64/python3.14/subprocess.py", line 2154, in _communicate self._check_timeout(endtime, orig_timeout, stdout, stderr) ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib64/python3.14/subprocess.py", line 1268, in _check_timeout raise TimeoutExpired( ...<2 lines>... stderr=b''.join(stderr_seq) if stderr_seq else None) subprocess.TimeoutExpired: Command '['oc', 'adm', 'must-gather', '--dest-dir=/home/odh/opendatahub-tests/results/must-gather-collected/workbenches/notebooks_server/operator/test_imagestream_health/test_workbench_imagestreams_health_trainer_imagestreams_/pytest_exception_interact', '--since=300s', '--image=registry.redhat.io/rhoai/odh-must-gather-rhel9@sha256:7b394654b91821bd58cfe973c2d28f94b8ae323ed75e2e0de6fee1988b525690']' timed out after 900 seconds  [conftest] ------------------------------------------------------- TEARDOWN ------------------------------------------------------- ___________ test_workbench_imagestreams_health[trainer_imagestreams] ___________ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 179, in pytest_runtest_call item.runtest() ~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1720, in runtest self.ihook.pytest_pyfunc_call(pyfuncitem=self) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 166, in pytest_pyfunc_call result = testfunction(**testargs) File "/home/odh/opendatahub-tests/tests/workbenches/notebooks_server/operator/test_imagestream_health.py", line 214, in test_workbench_imagestreams_health _validate_imagestreams_with_label( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ imagestreams=imagestreams, ^^^^^^^^^^^^^^^^^^^^^^^^^^ label_selector=label_selector, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ expected_count=expected_imagestream_count, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/tests/workbenches/notebooks_server/operator/test_imagestream_health.py", line 173, in _validate_imagestreams_with_label pytest.fail("\n".join(errors)) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/outcomes.py", line 163, in __call__ raise Failed(msg=reason, pytrace=pytrace) Failed: Expected 3 ImageStreams with label 'opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=trainer', found 0. Found: [] _ 5 of 5 completed, 4 Pass, 1 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _ ===== 1 failed, 4 passed, 8 deselected, 91 warnings in 1102.93s (0:18:22) ====== =================================== FAILURES =================================== ___________ test_workbench_imagestreams_health[trainer_imagestreams] ___________ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 353, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 245, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/skipping.py", line 268, in pytest_runtest_call return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 179, in pytest_runtest_call item.runtest() ~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 1720, in runtest self.ihook.pytest_pyfunc_call(pyfuncitem=self) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 53, in run_old_style_hookwrapper return result.get_result() ~~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_result.py", line 103, in get_result raise exc.with_traceback(tb) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 38, in run_old_style_hookwrapper res = yield ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/python.py", line 166, in pytest_pyfunc_call result = testfunction(**testargs) File "/home/odh/opendatahub-tests/tests/workbenches/notebooks_server/operator/test_imagestream_health.py", line 214, in test_workbench_imagestreams_health _validate_imagestreams_with_label( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ imagestreams=imagestreams, ^^^^^^^^^^^^^^^^^^^^^^^^^^ label_selector=label_selector, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ expected_count=expected_imagestream_count, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/home/odh/opendatahub-tests/tests/workbenches/notebooks_server/operator/test_imagestream_health.py", line 173, in _validate_imagestreams_with_label pytest.fail("\n".join(errors)) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/outcomes.py", line 163, in __call__ raise Failed(msg=reason, pytrace=pytrace) Failed: Expected 3 ImageStreams with label 'opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=trainer', found 0. Found: [] =============================== warnings summary =============================== tests/workbenches/notebooks_server/controller/test_spawning.py: 65 warnings tests/workbenches/notebooks_server/operator/test_imagestream_health.py: 25 warnings /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/urllib3/connectionpool.py:1110: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ods-qe-psi-09.osp.rh-ods.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( tests/workbenches/notebooks_server/operator/test_imagestream_health.py::test_workbench_imagestreams_health[trainer_imagestreams] /home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py:1636: FutureWarning: 'client' arg will be mandatory in the next major release. `config_file` and `context` args will be removed. super().__init__( -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html ------------- generated xml file: /artifacts/workbenches-smoke.xml ------------- =========================== short test summary info ============================ FAILED tests/workbenches/notebooks_server/operator/test_imagestream_health.py::test_workbench_imagestreams_health[trainer_imagestreams] - Failed: Expected 3 ImageStreams with label 'opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=trainer', found 0. Found: [] ===== 1 failed, 4 passed, 8 deselected, 91 warnings in 1102.93s (0:18:22) ======