--- pytest attempt 2026-07-16T06:02:49.037513+00:00 (/.local/bin/uv --directory /home/odh/opendatahub-tests...) --- 2026-07-16T06:02:50.995791Z [info ] Writing tests log to /home/odh/opendatahub-tests/results/pytest-tests.log [conftest] 2026-07-16T06:02:50.996253Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] 2026-07-16T06:02:51.163487Z [info ] kind: DataScienceCluster api version: datasciencecluster.opendatahub.io/v2 [ocp_resources.resource] 2026-07-16T06:02:51.306299Z [info ] kind: DSCInitialization api version: dscinitialization.opendatahub.io/v2 [ocp_resources.resource] ============================= test session starts ============================== platform linux -- Python 3.14.6, pytest-9.1.1, pluggy-1.6.0 -- /home/odh/opendatahub-tests/.venv/bin/python3 cachedir: .pytest_cache metadata: {'Python': '3.14.6', 'Platform': 'Linux-5.14.0-570.120.1.el9_6.x86_64-x86_64-with-glibc2.42', 'Packages': {'pytest': '9.1.1', 'pluggy': '1.6.0'}, 'Plugins': {'anyio': '4.14.0', 'langsmith': '0.9.0', 'asyncio': '1.4.0', 'dependency': '0.6.1', 'html': '4.2.0', 'metadata': '3.1.1', 'order': '1.5.0', 'progress': '1.4.0', 'testconfig': '0.2.0', 'xdist': '3.8.0', 'syrupy': '5.3.2'}} rootdir: /home/odh/opendatahub-tests configfile: pytest.ini plugins: anyio-4.14.0, langsmith-0.9.0, asyncio-1.4.0, dependency-0.6.1, html-4.2.0, metadata-3.1.1, order-1.5.0, progress-1.4.0, testconfig-0.2.0, xdist-3.8.0, syrupy-5.3.2 asyncio: mode=Mode.STRICT, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function collecting ... collected 59 items / 55 deselected / 4 selected tests/workbenches/notebooks_server/controller/test_spawning.py::TestNotebook::test_create_simple_notebook[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0]  test_create_simple_notebook[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0]  -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-07-16T06:02:51.489928Z [info ] Executing session fixture: event_loop_policy [conftest] 2026-07-16T06:02:51.491940Z [info ] Executing session fixture: _syrupy_apply_ide_patches [conftest] 2026-07-16T06:02:51.492090Z [info ] Executing session fixture: admin_client [conftest] 2026-07-16T06:02:51.492288Z [info ] Trying to get client via new_client_from_config [ocp_resources.resource] 2026-07-16T06:02:51.493442Z [info ] Executing session fixture: dsc_resource [conftest] 2026-07-16T06:02:51.493560Z [info ] kind: DataScienceCluster api version: datasciencecluster.opendatahub.io/v2 [ocp_resources.resource] 2026-07-16T06:02:51.635825Z [info ] Executing session fixture: tmp_path_factory [conftest] 2026-07-16T06:02:51.636083Z [info ] Executing session fixture: tests_tmp_dir [conftest] 2026-07-16T06:02:51.637019Z [info ] Executing session fixture: os_path_environment [conftest] 2026-07-16T06:02:51.637220Z [info ] Executing session fixture: tmpdir_factory [conftest] 2026-07-16T06:02:51.637386Z [info ] Executing session fixture: bin_directory [conftest] 2026-07-16T06:02:51.638260Z [info ] Executing session fixture: oc_binary_path [conftest] 2026-07-16T06:02:51.667791Z [info ] kind: ConsoleCLIDownload api version: console.openshift.io/v1 [ocp_resources.resource] 2026-07-16T06:02:51.751129Z [info ] All oc console cli download links: ['https://downloads-openshift-console.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com/amd64/linux/oc.tar'] [utilities.infra] name=utilities.infra 2026-07-16T06:02:51.751293Z [info ] Downloading archive using: url=https://downloads-openshift-console.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com/amd64/linux/oc.tar [utilities.infra] name=utilities.infra 2026-07-16T06:02:51.752304Z [info ] Waiting for 120 seconds [0:02:00], retry every 10 seconds. (Function: utilities.infra._download_with_retry Kwargs: {'url': 'https://downloads-openshift-console.apps.rosa.nmanos-konflux1.durx.p3.openshiftapps.com/amd64/linux/oc.tar'}) [timeout_sampler] 2026-07-16T06:02:51.827238Z [info ] Elapsed time: 5.3882598876953125e-05 [0:00:00.000054] [timeout_sampler] 2026-07-16T06:02:52.461917Z [info ] Extract the downloaded archive. [utilities.infra] name=utilities.infra 2026-07-16T06:02:52.576594Z [info ] Downloaded file: ['oc']  [utilities.infra] name=utilities.infra 2026-07-16T06:02:52.598727Z [info ] Executing session fixture: bin_directory_to_os_path [conftest] 2026-07-16T06:02:52.597141Z [info ] OC binary path: /tmp/pytest-8gozW6GE2SZDxVqhpdJSka/bin0/oc [tests.conftest] name=tests.conftest 2026-07-16T06:02:52.597285Z [info ] Adding /tmp/pytest-8gozW6GE2SZDxVqhpdJSka/bin0 to $PATH [tests.conftest] name=tests.conftest 2026-07-16T06:02:52.599393Z [info ] Executing session fixture: nodes [conftest] 2026-07-16T06:02:53.812551Z [info ] Executing session fixture: dsci_resource [conftest] 2026-07-16T06:02:53.812727Z [info ] kind: DSCInitialization api version: dscinitialization.opendatahub.io/v2 [ocp_resources.resource] 2026-07-16T06:02:53.829921Z [info ] Executing session fixture: record_testsuite_property [conftest] 2026-07-16T06:02:53.830085Z [info ] Executing session fixture: junitxml_plugin [conftest] 2026-07-16T06:02:53.830271Z [info ] Executing session fixture: cluster_sanity_scope_session [conftest] 2026-07-16T06:02:53.829254Z [info ] Check cluster sanity.  [utilities.infra] name=utilities.infra 2026-07-16T06:02:53.830537Z [info ] Verify all nodes are in a healthy condition. [ocp_utilities.infra] 2026-07-16T06:02:53.881104Z [info ] Verify all nodes are schedulable. [ocp_utilities.infra] 2026-07-16T06:02:53.930337Z [info ] Waiting for 120 seconds [0:02:00], retry every 5 seconds. (Function: utilities.infra.wait_for_dsci_status_ready Kwargs: {'dsci_resource': }) [timeout_sampler] 2026-07-16T06:02:53.929693Z [info ] Wait for DSCI default-dsci to be in Ready status. [utilities.infra] name=utilities.infra 2026-07-16T06:02:53.930720Z [info ] Get DSCInitialization default-dsci status [ocp_resources DSCInitialization] 2026-07-16T06:02:53.949982Z [info ] Elapsed time: 0.00012159347534179688 [0:00:00.000122] [timeout_sampler] 2026-07-16T06:02:53.950125Z [info ] Waiting for 120 seconds [0:02:00], retry every 5 seconds. (Function: utilities.infra.wait_for_dsc_status_ready Kwargs: {'dsc_resource': }) [timeout_sampler] 2026-07-16T06:02:53.949496Z [info ] Wait for DSC default-dsc are Ready. [utilities.infra] name=utilities.infra 2026-07-16T06:02:53.950478Z [info ] Get DataScienceCluster default-dsc status [ocp_resources DataScienceCluster] 2026-07-16T06:02:53.972974Z [info ] Elapsed time: 3.314018249511719e-05 [0:00:00.000033] [timeout_sampler] 2026-07-16T06:02:53.973341Z [info ] Executing session fixture: autouse_fixtures [conftest] 2026-07-16T06:02:53.973480Z [info ] Executing session fixture: pytestconfig [conftest] 2026-07-16T06:02:53.973590Z [info ] Executing session fixture: use_unprivileged_client [conftest] 2026-07-16T06:02:53.973705Z [info ] Executing session fixture: kubconfig_filepath [conftest] 2026-07-16T06:02:53.973815Z [info ] Executing session fixture: cluster_authentication [conftest] 2026-07-16T06:02:53.973921Z [info ] kind: Authentication api version: config.openshift.io/v1 [ocp_resources.resource] 2026-07-16T06:02:53.993403Z [info ] Executing session fixture: is_byoidc [conftest] 2026-07-16T06:02:54.014553Z [info ] Executing session fixture: non_admin_user_password [conftest] 2026-07-16T06:02:54.014715Z [info ] Executing session fixture: unprivileged_client [conftest] 2026-07-16T06:02:54.012711Z [warning ] Unprivileged client is not enabled, using admin client [tests.conftest] name=tests.conftest 2026-07-16T06:02:54.015041Z [info ] Executing session fixture: teardown_resources [conftest] 2026-07-16T06:02:54.015222Z [info ] Executing class fixture: unprivileged_model_namespace [conftest] 2026-07-16T06:02:54.015363Z [info ] kind: ProjectRequest api version: project.openshift.io/v1 [ocp_resources.resource] 2026-07-16T06:02:54.015480Z [info ] Create ProjectRequest test-odh-notebook [ocp_resources ProjectRequest] 2026-07-16T06:02:54.015597Z [info ] Posting {'apiVersion': 'project.openshift.io/v1', 'kind': 'ProjectRequest', 'metadata': {'name': 'test-odh-notebook', 'labels': {'opendatahub.io/dashboard': 'true'}}} [ocp_resources ProjectRequest] 2026-07-16T06:02:54.344191Z [info ] kind: Project api version: project.openshift.io/v1 [ocp_resources.resource] 2026-07-16T06:02:54.344391Z [info ] Wait for Project test-odh-notebook status to be Active [ocp_resources Project] 2026-07-16T06:02:54.344508Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_status.lambda: self.exists) [timeout_sampler] 2026-07-16T06:02:54.446815Z [info ] Status of Project test-odh-notebook is Active [ocp_resources Project] 2026-07-16T06:02:54.447004Z [info ] Elapsed time: 5.5789947509765625e-05 [0:00:00.000056] [timeout_sampler] 2026-07-16T06:02:54.447281Z [info ] ResourceEdits: Updating data for resource Namespace test-odh-notebook [ocp_resources.resource] 2026-07-16T06:02:54.447414Z [info ] Update Namespace test-odh-notebook: {'metadata': {'labels': {'opendatahub.io/dashboard': 'true'}, 'name': 'test-odh-notebook'}} [ocp_resources Namespace] 2026-07-16T06:02:54.546690Z [info ] Executing function fixture: minimal_image [conftest] 2026-07-16T06:02:54.649486Z [info ] kind: ClusterServiceVersion api version: operators.coreos.com/v1alpha1 [ocp_resources.resource] 2026-07-16T06:02:54.814058Z [info ] Executing function fixture: notebook_image [conftest] 2026-07-16T06:02:55.014310Z [info ] kind: Config api version: imageregistry.operator.openshift.io/v1 [ocp_resources.resource] 2026-07-16T06:02:55.078253Z [info ] Image registry management state: managed, available: True [utilities.infra] name=utilities.infra 2026-07-16T06:02:55.080667Z [info ] Executing function fixture: users_persistent_volume_claim [conftest] 2026-07-16T06:02:55.080803Z [info ] Create PersistentVolumeClaim test-odh-notebook [ocp_resources PersistentVolumeClaim] 2026-07-16T06:02:55.080935Z [info ] Posting {'apiVersion': 'v1', 'kind': 'PersistentVolumeClaim', 'metadata': {'name': 'test-odh-notebook', 'labels': {'opendatahub.io/dashboard': 'true'}, 'namespace': 'test-odh-notebook'}, 'spec': {'volumeMode': 'Filesystem', 'accessModes': ['ReadWriteOnce'], 'resources': {'requests': {'storage': '10Gi'}}}} [ocp_resources PersistentVolumeClaim] 2026-07-16T06:02:55.560822Z [info ] Executing function fixture: default_notebook [conftest] 2026-07-16T06:02:55.652503Z [info ] kind: Notebook api version: kubeflow.org/v1 [ocp_resources.resource] 2026-07-16T06:02:55.652699Z [info ] Create Notebook test-odh-notebook [ocp_resources Notebook] 2026-07-16T06:02:55.652900Z [info ] Posting {'apiVersion': 'kubeflow.org/v1', 'kind': 'Notebook', 'metadata': {'annotations': {'notebooks.opendatahub.io/inject-auth': 'true', 'opendatahub.io/accelerator-name': '', 'notebooks.opendatahub.io/last-image-selection': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.5'}, 'finalizers': ['notebook.opendatahub.io/kube-rbac-proxy-cleanup'], 'labels': {'app': 'test-odh-notebook', 'opendatahub.io/dashboard': 'true', 'opendatahub.io/odh-managed': 'true'}, 'name': 'test-odh-notebook', 'namespace': 'test-odh-notebook'}, 'spec': {'template': {'spec': {'affinity': {}, 'containers': [{'env': [{'name': 'NOTEBOOK_ARGS', 'value': "--ServerApp.port=8888\n --ServerApp.token=''\n --ServerApp.password=''\n --ServerApp.base_url=/notebook/test-odh-notebook/test-odh-notebook\n --ServerApp.quit_button=False\n"}, {'name': 'JUPYTER_IMAGE', 'value': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.5'}], 'image': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.5', 'imagePullPolicy': 'Always', 'livenessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/notebook/test-odh-notebook/test-odh-notebook/api', 'port': 'notebook-port', 'scheme': 'HTTP'}, 'initialDelaySeconds': 10, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'name': 'test-odh-notebook', 'ports': [{'containerPort': 8888, 'name': 'notebook-port', 'protocol': 'TCP'}], 'readinessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/notebook/test-odh-notebook/test-odh-notebook/api', 'port': 'notebook-port', 'scheme': 'HTTP'}, 'initialDelaySeconds': 10, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'resources': {'limits': {'cpu': '2', 'memory': '4Gi'}, 'requests': {'cpu': '1', 'memory': '1Gi'}}, 'volumeMounts': [{'mountPath': '/opt/app-root/src', 'name': 'test-odh-notebook'}, {'mountPath': '/dev/shm', 'name': 'shm'}], 'workingDir': '/opt/app-root/src'}], 'enableServiceLinks': False, 'serviceAccountName': 'test-odh-notebook', 'volumes': [{'name': 'test-odh-notebook', 'persistentVolumeClaim': {'claimName': 'test-odh-notebook'}}, {'emptyDir': {'medium': 'Memory'}, 'name': 'shm'}, {'name': 'kube-rbac-proxy-config', 'configMap': {'defaultMode': 420, 'name': 'test-kube-rbac-proxy-config'}}, {'name': 'kube-rbac-proxy-tls-certificates', 'secret': {'defaultMode': 420, 'secretName': 'test-kube-rbac-proxy-tls'}}]}}}} [ocp_resources Notebook] 2026-07-16T06:02:58.568662Z [info ] Executing function fixture: notebook_pod [conftest] 2026-07-16T06:02:58.568828Z [info ] Wait until Pod test-odh-notebook-0 is created [ocp_resources Pod] 2026-07-16T06:02:58.568957Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-16T06:03:02.983449Z [info ] Elapsed time: 4.368188858032227 [0:00:04.368189] [timeout_sampler] 2026-07-16T06:03:02.983757Z [info ] Wait for Pod/test-odh-notebook-0's 'Ready' condition to be 'True' [ocp_resources Pod] 2026-07-16T06:03:02.983878Z [info ] Wait until Pod test-odh-notebook-0 is created [ocp_resources Pod] 2026-07-16T06:03:02.983989Z [info ] Waiting for 120 seconds [0:02:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-16T06:03:03.000972Z [info ] Elapsed time: 2.86102294921875e-05 [0:00:00.000029] [timeout_sampler] 2026-07-16T06:03:03.001320Z [info ] Waiting for 119.98215627670288 seconds [0:01:59.982156], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] PASSED2026-07-16T06:03:25.125580Z [info ] Elapsed time: 22.088401079177856 [0:00:22.088401] [timeout_sampler] --------------------------------------------------------- CALL ---------------------------------------------------------  TEST: TestNotebook.test_create_simple_notebook[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0] STATUS: PASSED ------------------------------------------------------- TEARDOWN ------------------------------------------------------- 2026-07-16T06:03:25.126235Z [info ] Delete Notebook test-odh-notebook [ocp_resources Notebook] 2026-07-16T06:03:25.173897Z [info ] Deleting {'apiVersion': 'kubeflow.org/v1', 'kind': 'Notebook', 'metadata': {'annotations': {'notebooks.opendatahub.io/inject-auth': 'true', 'notebooks.opendatahub.io/last-image-selection': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.5', 'opendatahub.io/accelerator-name': ''}, 'creationTimestamp': '2026-07-16T06:02:58Z', 'finalizers': ['notebook.opendatahub.io/kube-rbac-proxy-cleanup', 'notebook.opendatahub.io/httproute-cleanup', 'notebook.opendatahub.io/referencegrant-cleanup'], 'generation': 1, 'labels': {'app': 'test-odh-notebook', 'opendatahub.io/dashboard': 'true', 'opendatahub.io/odh-managed': 'true'}, 'managedFields': [{'apiVersion': 'kubeflow.org/v1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:notebooks.opendatahub.io/inject-auth': {}, 'f:notebooks.opendatahub.io/last-image-selection': {}, 'f:opendatahub.io/accelerator-name': {}}, 'f:finalizers': {'.': {}, 'v:"notebook.opendatahub.io/kube-rbac-proxy-cleanup"': {}}, 'f:labels': {'.': {}, 'f:app': {}, 'f:opendatahub.io/dashboard': {}, 'f:opendatahub.io/odh-managed': {}}}, 'f:spec': {'.': {}, 'f:template': {'.': {}, 'f:spec': {'.': {}, 'f:affinity': {}, 'f:containers': {'.': {}, 'k:{"name":"test-odh-notebook"}': {'.': {}, 'f:env': {'.': {}, 'k:{"name":"JUPYTER_IMAGE"}': {'.': {}, 'f:name': {}, 'f:value': {}}, 'k:{"name":"NOTEBOOK_ARGS"}': {'.': {}, 'f:name': {}, 'f:value': {}}}, 'f:image': {}, 'f:imagePullPolicy': {}, 'f:livenessProbe': {'.': {}, 'f:failureThreshold': {}, 'f:httpGet': {'.': {}, 'f:path': {}, 'f:port': {}, 'f:scheme': {}}, 'f:initialDelaySeconds': {}, 'f:periodSeconds': {}, 'f:successThreshold': {}, 'f:timeoutSeconds': {}}, 'f:name': {}, 'f:ports': {'.': {}, 'k:{"containerPort":8888,"protocol":"TCP"}': {'.': {}, 'f:containerPort': {}, 'f:name': {}, 'f:protocol': {}}}, 'f:readinessProbe': {'.': {}, 'f:failureThreshold': {}, 'f:httpGet': {'.': {}, 'f:path': {}, 'f:port': {}, 'f:scheme': {}}, 'f:initialDelaySeconds': {}, 'f:periodSeconds': {}, 'f:successThreshold': {}, 'f:timeoutSeconds': {}}, 'f:resources': {'.': {}, 'f:limits': {'.': {}, 'f:cpu': {}, 'f:memory': {}}, 'f:requests': {'.': {}, 'f:cpu': {}, 'f:memory': {}}}, 'f:volumeMounts': {'.': {}, 'k:{"mountPath":"/dev/shm"}': {'.': {}, 'f:mountPath': {}, 'f:name': {}}, 'k:{"mountPath":"/opt/app-root/src"}': {'.': {}, 'f:mountPath': {}, 'f:name': {}}}, 'f:workingDir': {}}}, 'f:enableServiceLinks': {}, 'f:serviceAccountName': {}, 'f:volumes': {'.': {}, 'k:{"name":"kube-rbac-proxy-config"}': {'.': {}, 'f:configMap': {}, 'f:name': {}}, 'k:{"name":"kube-rbac-proxy-tls-certificates"}': {'.': {}, 'f:name': {}, 'f:secret': {'.': {}, 'f:defaultMode': {}, 'f:secretName': {}}}, 'k:{"name":"shm"}': {'.': {}, 'f:emptyDir': {'.': {}, 'f:medium': {}}, 'f:name': {}}, 'k:{"name":"test-odh-notebook"}': {'.': {}, 'f:name': {}, 'f:persistentVolumeClaim': {'.': {}, 'f:claimName': {}}}}}}}}, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': '2026-07-16T06:02:55Z'}, {'apiVersion': 'kubeflow.org/v1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:finalizers': {'v:"notebook.opendatahub.io/httproute-cleanup"': {}, 'v:"notebook.opendatahub.io/referencegrant-cleanup"': {}}}}, 'manager': 'manager', 'operation': 'Update', 'time': '2026-07-16T06:02:59Z'}, {'apiVersion': 'kubeflow.org/v1beta1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'.': {}, 'f:conditions': {}, 'f:containerState': {'.': {}, 'f:running': {'.': {}, 'f:startedAt': {}}}, 'f:readyReplicas': {}}}, 'manager': 'manager', 'operation': 'Update', 'subresource': 'status', 'time': '2026-07-16T06:03:24Z'}], 'name': 'test-odh-notebook', 'namespace': 'test-odh-notebook', 'resourceVersion': '34884901', 'uid': '4f8422d9-3495-4fa1-ba4a-d21751968654'}, 'spec': {'template': {'spec': {'affinity': {}, 'containers': [{'env': [{'name': 'NOTEBOOK_ARGS', 'value': "--ServerApp.port=8888\n --ServerApp.token=''\n --ServerApp.password=''\n --ServerApp.base_url=/notebook/test-odh-notebook/test-odh-notebook\n --ServerApp.quit_button=False\n"}, {'name': 'JUPYTER_IMAGE', 'value': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.5'}, {'name': 'PIPELINES_SSL_SA_CERTS', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}, {'name': 'KF_PIPELINES_SSL_SA_CERTS', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}, {'name': 'GIT_SSL_CAINFO', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}, {'name': 'PIP_CERT', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}, {'name': 'REQUESTS_CA_BUNDLE', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}, {'name': 'SSL_CERT_FILE', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}], 'image': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.5', 'imagePullPolicy': 'Always', 'livenessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/notebook/test-odh-notebook/test-odh-notebook/api', 'port': 'notebook-port', 'scheme': 'HTTP'}, 'initialDelaySeconds': 10, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'name': 'test-odh-notebook', 'ports': [{'containerPort': 8888, 'name': 'notebook-port', 'protocol': 'TCP'}], 'readinessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/notebook/test-odh-notebook/test-odh-notebook/api', 'port': 'notebook-port', 'scheme': 'HTTP'}, 'initialDelaySeconds': 10, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'resources': {'limits': {'cpu': '2', 'memory': '4Gi'}, 'requests': {'cpu': '1', 'memory': '1Gi'}}, 'volumeMounts': [{'mountPath': '/opt/app-root/src', 'name': 'test-odh-notebook'}, {'mountPath': '/dev/shm', 'name': 'shm'}, {'mountPath': '/etc/pki/tls/custom-certs', 'name': 'trusted-ca', 'readOnly': True}, {'mountPath': '/opt/app-root/pipeline-runtimes/', 'name': 'runtime-images'}], 'workingDir': '/opt/app-root/src'}, {'args': ['--secure-listen-address=0.0.0.0:8443', '--upstream=http://127.0.0.1:8888/', '--logtostderr=true', '--v=10', '--proxy-endpoints-port=8444', '--config-file=/etc/kube-rbac-proxy/config-file.yaml', '--tls-cert-file=/etc/tls/private/tls.crt', '--tls-private-key-file=/etc/tls/private/tls.key', '--auth-header-fields-enabled=true', '--auth-header-user-field-name=X-Auth-Request-User', '--auth-header-groups-field-name=X-Auth-Request-Groups'], 'image': 'registry.redhat.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:1e614e46799fd020ac18d95c06a463421154ce86e59ccb3fa6007e66fed9910e', 'imagePullPolicy': 'Always', 'livenessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/healthz', 'port': 8444, 'scheme': 'HTTPS'}, 'initialDelaySeconds': 30, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'name': 'kube-rbac-proxy', 'ports': [{'containerPort': 8443, 'name': 'kube-rbac-proxy', 'protocol': 'TCP'}], 'readinessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/healthz', 'port': 8444, 'scheme': 'HTTPS'}, 'initialDelaySeconds': 5, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'resources': {'limits': {'cpu': '100m', 'memory': '64Mi'}, 'requests': {'cpu': '100m', 'memory': '64Mi'}}, 'volumeMounts': [{'mountPath': '/etc/kube-rbac-proxy', 'name': 'kube-rbac-proxy-config'}, {'mountPath': '/etc/tls/private', 'name': 'kube-rbac-proxy-tls-certificates'}]}], 'enableServiceLinks': False, 'serviceAccountName': 'test-odh-notebook', 'volumes': [{'name': 'test-odh-notebook', 'persistentVolumeClaim': {'claimName': 'test-odh-notebook'}}, {'emptyDir': {'medium': 'Memory'}, 'name': 'shm'}, {'configMap': {'defaultMode': 420, 'name': 'test-odh-notebook-kube-rbac-proxy-config'}, 'name': 'kube-rbac-proxy-config'}, {'name': 'kube-rbac-proxy-tls-certificates', 'secret': {'defaultMode': 420, 'secretName': 'test-odh-notebook-kube-rbac-proxy-tls'}}, {'configMap': {'name': 'workbench-trusted-ca-bundle', 'optional': True}, 'name': 'trusted-ca'}, {'configMap': {'name': 'pipeline-runtime-images', 'optional': True}, 'name': 'runtime-images'}]}}}, 'status': {'conditions': [{'lastProbeTime': '2026-07-16T06:03:24Z', 'lastTransitionTime': '2026-07-16T06:03:13Z', 'status': 'True', 'type': 'PodReadyToStartContainers'}, {'lastProbeTime': '2026-07-16T06:03:24Z', 'lastTransitionTime': '2026-07-16T06:03:05Z', 'status': 'True', 'type': 'Initialized'}, {'lastProbeTime': '2026-07-16T06:03:24Z', 'lastTransitionTime': '2026-07-16T06:03:24Z', 'status': 'True', 'type': 'Ready'}, {'lastProbeTime': '2026-07-16T06:03:24Z', 'lastTransitionTime': '2026-07-16T06:03:24Z', 'status': 'True', 'type': 'ContainersReady'}, {'lastProbeTime': '2026-07-16T06:03:24Z', 'lastTransitionTime': '2026-07-16T06:03:05Z', 'status': 'True', 'type': 'PodScheduled'}], 'containerState': {'running': {'startedAt': '2026-07-16T06:03:11Z'}}, 'readyReplicas': 1}} [ocp_resources Notebook] 2026-07-16T06:03:25.228796Z [info ] Wait until Notebook test-odh-notebook is deleted [ocp_resources Notebook] 2026-07-16T06:03:25.228976Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-07-16T06:04:06.046499Z [info ] Elapsed time: 40.79936218261719 [0:00:40.799362] [timeout_sampler] 2026-07-16T06:04:06.046793Z [info ] Delete PersistentVolumeClaim test-odh-notebook [ocp_resources PersistentVolumeClaim] 2026-07-16T06:04:06.080696Z [info ] Deleting {'kind': 'PersistentVolumeClaim', 'apiVersion': 'v1', 'metadata': {'name': 'test-odh-notebook', 'namespace': 'test-odh-notebook', 'uid': 'e7bc76cd-6ae1-41e2-8e22-5d644a52161b', 'resourceVersion': '34883788', 'creationTimestamp': '2026-07-16T06:02:55Z', 'labels': {'opendatahub.io/dashboard': 'true'}, 'annotations': {'pv.kubernetes.io/bind-completed': 'yes', 'pv.kubernetes.io/bound-by-controller': 'yes', 'volume.beta.kubernetes.io/storage-provisioner': 'ebs.csi.aws.com', 'volume.kubernetes.io/selected-node': 'ip-10-0-1-195.us-east-2.compute.internal', 'volume.kubernetes.io/storage-provisioner': 'ebs.csi.aws.com'}, 'finalizers': ['kubernetes.io/pvc-protection'], 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-16T06:02:55Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:labels': {'.': {}, 'f:opendatahub.io/dashboard': {}}}, 'f:spec': {'f:accessModes': {}, 'f:resources': {'f:requests': {'.': {}, 'f:storage': {}}}, 'f:volumeMode': {}}}}, {'manager': 'kube-scheduler', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-16T06:03:02Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:volume.kubernetes.io/selected-node': {}}}}}, {'manager': 'kube-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-16T06:03:04Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:pv.kubernetes.io/bind-completed': {}, 'f:pv.kubernetes.io/bound-by-controller': {}, 'f:volume.beta.kubernetes.io/storage-provisioner': {}, 'f:volume.kubernetes.io/storage-provisioner': {}}}, 'f:spec': {'f:volumeName': {}}}}, {'manager': 'kube-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-16T06:03:04Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'f:accessModes': {}, 'f:capacity': {'.': {}, 'f:storage': {}}, 'f:phase': {}}}, 'subresource': 'status'}]}, 'spec': {'accessModes': ['ReadWriteOnce'], 'resources': {'requests': {'storage': '10Gi'}}, 'volumeName': 'pvc-e7bc76cd-6ae1-41e2-8e22-5d644a52161b', 'storageClassName': 'gp3-csi', 'volumeMode': 'Filesystem'}, 'status': {'phase': 'Bound', 'accessModes': ['ReadWriteOnce'], 'capacity': {'storage': '10Gi'}}} [ocp_resources PersistentVolumeClaim] 2026-07-16T06:04:06.100482Z [info ] Wait until PersistentVolumeClaim test-odh-notebook is deleted [ocp_resources PersistentVolumeClaim] 2026-07-16T06:04:06.100661Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-07-16T06:04:08.150837Z [info ] Elapsed time: 2.0331268310546875 [0:00:02.033127] [timeout_sampler] 2026-07-16T06:04:08.167992Z [info ] Delete Project test-odh-notebook [ocp_resources Project] _ 1 of 4 completed, 1 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _ tests/workbenches/notebooks_server/controller/test_spawning.py::TestNotebook::test_create_simple_notebook[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0] ERROR _ ERROR at teardown of TestNotebook.test_create_simple_notebook[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0] _ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1171, in retry_cluster_exceptions for sample in sampler: ^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 171, in __iter__ raise TimeoutExpiredError( self._get_exception_log(exp=last_exp), last_exp=last_exp, elapsed_time=elapsed_time ) timeout_sampler.TimeoutExpiredError: Timed Out: 10 Function: ocp_resources.resource._instance Last exception: ServiceUnavailableError: 503 Reason: Service Unavailable HTTP response headers: HTTPHeaderDict({'Audit-Id': 'd6f2644a-2018-40a1-ab98-89b05762433b', 'Cache-Control': 'no-cache, private', 'Content-Type': 'text/plain; charset=utf-8', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'X-Content-Type-Options': 'nosniff', 'X-Kubernetes-Pf-Flowschema-Uid': '166a5be2-9ec1-4591-b6bd-7ae41ddf7ba0', 'X-Kubernetes-Pf-Prioritylevel-Uid': '80f1606f-0424-4173-ba01-beaca33539cb', 'Date': 'Thu, 16 Jul 2026 06:04:08 GMT', 'Content-Length': '61'}) HTTP response body: b'error trying to reach service: http2: client connection lost\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 373, in request return self.rest_client.GET(url, ~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content=_preload_content, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers) ^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 244, in GET return self.request("GET", url, ~~~~~~~~~~~~^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ _preload_content=_preload_content, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ query_params=query_params) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) . Elapsed time: 0.7764589786529541 [0:00:00.776459] The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 905, in pytest_runtest_teardown return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 199, in pytest_runtest_teardown item.session._setupstate.teardown_exact(nextitem) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 579, in teardown_exact raise exceptions[0] File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 568, in teardown_exact fin() ~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1166, in finish raise exceptions[0] File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1156, in finish fin() ~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1014, in _teardown_yield_fixture next(it) ~~~~^^^^ File "/home/odh/opendatahub-tests/tests/conftest.py", line 636, in unprivileged_model_namespace with create_ns( ~~~~~~~~~^ admin_client=admin_client, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... teardown=teardown_resources, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) as ns: ^ File "/usr/lib64/python3.14/contextlib.py", line 148, in __exit__ next(self.gen) ~~~~^^^^^^^^^^ File "/home/odh/opendatahub-tests/utilities/infra.py", line 173, in create_ns project.clean_up() ~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 872, in clean_up return self.delete(wait=wait, timeout=timeout or self.delete_timeout) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1085, in delete if self.exists: ^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 981, in exists return self.instance ^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1248, in instance return self.retry_cluster_exceptions(func=_instance) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1176, in retry_cluster_exceptions raise exp.last_exp from exp File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 162, in __iter__ yield self.func(*self.func_args, **self.func_kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1246, in _instance return self.api.get(name=self.name) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 112, in get return self.request('get', path, **kwargs) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 57, in inner raise api_exception(e) kubernetes.dynamic.exceptions.ServiceUnavailableError: 503 Reason: Service Unavailable HTTP response headers: HTTPHeaderDict({'Audit-Id': 'd6f2644a-2018-40a1-ab98-89b05762433b', 'Cache-Control': 'no-cache, private', 'Content-Type': 'text/plain; charset=utf-8', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'X-Content-Type-Options': 'nosniff', 'X-Kubernetes-Pf-Flowschema-Uid': '166a5be2-9ec1-4591-b6bd-7ae41ddf7ba0', 'X-Kubernetes-Pf-Prioritylevel-Uid': '80f1606f-0424-4173-ba01-beaca33539cb', 'Date': 'Thu, 16 Jul 2026 06:04:08 GMT', 'Content-Length': '61'}) HTTP response body: b'error trying to reach service: http2: client connection lost\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 373, in request return self.rest_client.GET(url, ~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content=_preload_content, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers) ^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 244, in GET return self.request("GET", url, ~~~~~~~~~~~~^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ _preload_content=_preload_content, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ query_params=query_params) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) tests/workbenches/notebooks_server/controller/test_spawning.py::TestNotebook::test_auth_container_resource_customization[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0]  TEST: TestNotebook.test_create_simple_notebook[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0] [teardown] STATUS: ERROR 2026-07-16T06:04:08.951664Z [error ] Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1171, in retry_cluster_exceptions for sample in sampler: ^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 171, in __iter__ raise TimeoutExpiredError( self._get_exception_log(exp=last_exp), last_exp=last_exp, elapsed_time=elapsed_time ) timeout_sampler.TimeoutExpiredError: Timed Out: 10 Function: ocp_resources.resource._instance Last exception: ServiceUnavailableError: 503 Reason: Service Unavailable HTTP response headers: HTTPHeaderDict({'Audit-Id': 'd6f2644a-2018-40a1-ab98-89b05762433b', 'Cache-Control': 'no-cache, private', 'Content-Type': 'text/plain; charset=utf-8', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'X-Content-Type-Options': 'nosniff', 'X-Kubernetes-Pf-Flowschema-Uid': '166a5be2-9ec1-4591-b6bd-7ae41ddf7ba0', 'X-Kubernetes-Pf-Prioritylevel-Uid': '80f1606f-0424-4173-ba01-beaca33539cb', 'Date': 'Thu, 16 Jul 2026 06:04:08 GMT', 'Content-Length': '61'}) HTTP response body: b'error trying to reach service: http2: client connection lost\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 373, in request return self.rest_client.GET(url, ~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content=_preload_content, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers) ^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 244, in GET return self.request("GET", url, ~~~~~~~~~~~~^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ _preload_content=_preload_content, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ query_params=query_params) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) . Elapsed time: 0.7764589786529541 [0:00:00.776459] The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 905, in pytest_runtest_teardown return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 199, in pytest_runtest_teardown item.session._setupstate.teardown_exact(nextitem) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 579, in teardown_exact raise exceptions[0] File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 568, in teardown_exact fin() ~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1166, in finish raise exceptions[0] File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1156, in finish fin() ~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1014, in _teardown_yield_fixture next(it) ~~~~^^^^ File "/home/odh/opendatahub-tests/tests/conftest.py", line 636, in unprivileged_model_namespace with create_ns( ~~~~~~~~~^ admin_client=admin_client, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... teardown=teardown_resources, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) as ns: ^ File "/usr/lib64/python3.14/contextlib.py", line 148, in __exit__ next(self.gen) ~~~~^^^^^^^^^^ File "/home/odh/opendatahub-tests/utilities/infra.py", line 173, in create_ns project.clean_up() ~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 872, in clean_up return self.delete(wait=wait, timeout=timeout or self.delete_timeout) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1085, in delete if self.exists: ^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 981, in exists return self.instance ^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1248, in instance return self.retry_cluster_exceptions(func=_instance) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1176, in retry_cluster_exceptions raise exp.last_exp from exp File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 162, in __iter__ yield self.func(*self.func_args, **self.func_kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1246, in _instance return self.api.get(name=self.name) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 112, in get return self.request('get', path, **kwargs) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 57, in inner raise api_exception(e) kubernetes.dynamic.exceptions.ServiceUnavailableError: 503 Reason: Service Unavailable HTTP response headers: HTTPHeaderDict({'Audit-Id': 'd6f2644a-2018-40a1-ab98-89b05762433b', 'Cache-Control': 'no-cache, private', 'Content-Type': 'text/plain; charset=utf-8', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'X-Content-Type-Options': 'nosniff', 'X-Kubernetes-Pf-Flowschema-Uid': '166a5be2-9ec1-4591-b6bd-7ae41ddf7ba0', 'X-Kubernetes-Pf-Prioritylevel-Uid': '80f1606f-0424-4173-ba01-beaca33539cb', 'Date': 'Thu, 16 Jul 2026 06:04:08 GMT', 'Content-Length': '61'}) HTTP response body: b'error trying to reach service: http2: client connection lost\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 373, in request return self.rest_client.GET(url, ~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content=_preload_content, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers) ^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 244, in GET return self.request("GET", url, ~~~~~~~~~~~~^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ _preload_content=_preload_content, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ query_params=query_params) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) [conftest]  test_auth_container_resource_customization[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0]  -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-07-16T06:04:08.952231Z [info ] Executing class fixture: unprivileged_model_namespace [conftest] 2026-07-16T06:04:08.952352Z [info ] kind: ProjectRequest api version: project.openshift.io/v1 [ocp_resources.resource] 2026-07-16T06:04:08.952462Z [info ] Create ProjectRequest test-auth-notebook [ocp_resources ProjectRequest] 2026-07-16T06:04:08.952570Z [info ] Posting {'apiVersion': 'project.openshift.io/v1', 'kind': 'ProjectRequest', 'metadata': {'name': 'test-auth-notebook', 'labels': {'opendatahub.io/dashboard': 'true'}}} [ocp_resources ProjectRequest] 2026-07-16T06:04:09.342383Z [info ] kind: Project api version: project.openshift.io/v1 [ocp_resources.resource] 2026-07-16T06:04:09.342548Z [info ] Wait for Project test-auth-notebook status to be Active [ocp_resources Project] 2026-07-16T06:04:09.342669Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_status.lambda: self.exists) [timeout_sampler] 2026-07-16T06:04:09.401522Z [info ] Status of Project test-auth-notebook is Active [ocp_resources Project] 2026-07-16T06:04:09.401904Z [info ] Elapsed time: 3.647804260253906e-05 [0:00:00.000036] [timeout_sampler] 2026-07-16T06:04:09.402211Z [info ] ResourceEdits: Updating data for resource Namespace test-auth-notebook [ocp_resources.resource] 2026-07-16T06:04:09.402375Z [info ] Update Namespace test-auth-notebook: {'metadata': {'labels': {'opendatahub.io/dashboard': 'true'}, 'name': 'test-auth-notebook'}} [ocp_resources Namespace] 2026-07-16T06:04:09.442284Z [info ] Executing function fixture: minimal_image [conftest] 2026-07-16T06:04:09.633411Z [info ] Executing function fixture: notebook_image [conftest] 2026-07-16T06:04:09.745418Z [info ] kind: Config api version: imageregistry.operator.openshift.io/v1 [ocp_resources.resource] 2026-07-16T06:04:09.764042Z [info ] Image registry management state: managed, available: True [utilities.infra] name=utilities.infra 2026-07-16T06:04:09.766303Z [info ] Executing function fixture: users_persistent_volume_claim [conftest] 2026-07-16T06:04:09.766428Z [info ] Create PersistentVolumeClaim test-auth-notebook [ocp_resources PersistentVolumeClaim] 2026-07-16T06:04:09.766551Z [info ] Posting {'apiVersion': 'v1', 'kind': 'PersistentVolumeClaim', 'metadata': {'name': 'test-auth-notebook', 'labels': {'opendatahub.io/dashboard': 'true'}, 'namespace': 'test-auth-notebook'}, 'spec': {'volumeMode': 'Filesystem', 'accessModes': ['ReadWriteOnce'], 'resources': {'requests': {'storage': '10Gi'}}}} [ocp_resources PersistentVolumeClaim] 2026-07-16T06:04:09.811043Z [info ] Executing function fixture: default_notebook [conftest] 2026-07-16T06:04:09.811363Z [info ] kind: Notebook api version: kubeflow.org/v1 [ocp_resources.resource] 2026-07-16T06:04:09.811477Z [info ] Create Notebook test-auth-notebook [ocp_resources Notebook] 2026-07-16T06:04:09.811613Z [info ] Posting {'apiVersion': 'kubeflow.org/v1', 'kind': 'Notebook', 'metadata': {'annotations': {'notebooks.opendatahub.io/inject-auth': 'true', 'opendatahub.io/accelerator-name': '', 'notebooks.opendatahub.io/last-image-selection': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.5', 'notebooks.opendatahub.io/auth-sidecar-cpu-request': '200m', 'notebooks.opendatahub.io/auth-sidecar-memory-request': '128Mi', 'notebooks.opendatahub.io/auth-sidecar-cpu-limit': '500m', 'notebooks.opendatahub.io/auth-sidecar-memory-limit': '256Mi'}, 'finalizers': ['notebook.opendatahub.io/kube-rbac-proxy-cleanup'], 'labels': {'app': 'test-auth-notebook', 'opendatahub.io/dashboard': 'true', 'opendatahub.io/odh-managed': 'true'}, 'name': 'test-auth-notebook', 'namespace': 'test-auth-notebook'}, 'spec': {'template': {'spec': {'affinity': {}, 'containers': [{'env': [{'name': 'NOTEBOOK_ARGS', 'value': "--ServerApp.port=8888\n --ServerApp.token=''\n --ServerApp.password=''\n --ServerApp.base_url=/notebook/test-auth-notebook/test-auth-notebook\n --ServerApp.quit_button=False\n"}, {'name': 'JUPYTER_IMAGE', 'value': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.5'}], 'image': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.5', 'imagePullPolicy': 'Always', 'livenessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/notebook/test-auth-notebook/test-auth-notebook/api', 'port': 'notebook-port', 'scheme': 'HTTP'}, 'initialDelaySeconds': 10, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'name': 'test-auth-notebook', 'ports': [{'containerPort': 8888, 'name': 'notebook-port', 'protocol': 'TCP'}], 'readinessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/notebook/test-auth-notebook/test-auth-notebook/api', 'port': 'notebook-port', 'scheme': 'HTTP'}, 'initialDelaySeconds': 10, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'resources': {'limits': {'cpu': '2', 'memory': '4Gi'}, 'requests': {'cpu': '1', 'memory': '1Gi'}}, 'volumeMounts': [{'mountPath': '/opt/app-root/src', 'name': 'test-auth-notebook'}, {'mountPath': '/dev/shm', 'name': 'shm'}], 'workingDir': '/opt/app-root/src'}], 'enableServiceLinks': False, 'serviceAccountName': 'test-auth-notebook', 'volumes': [{'name': 'test-auth-notebook', 'persistentVolumeClaim': {'claimName': 'test-auth-notebook'}}, {'emptyDir': {'medium': 'Memory'}, 'name': 'shm'}, {'name': 'kube-rbac-proxy-config', 'configMap': {'defaultMode': 420, 'name': 'test-kube-rbac-proxy-config'}}, {'name': 'kube-rbac-proxy-tls-certificates', 'secret': {'defaultMode': 420, 'secretName': 'test-kube-rbac-proxy-tls'}}]}}}} [ocp_resources Notebook] 2026-07-16T06:04:09.992828Z [info ] Executing function fixture: notebook_pod [conftest] 2026-07-16T06:04:09.993214Z [info ] Wait until Pod test-auth-notebook-0 is created [ocp_resources Pod] 2026-07-16T06:04:09.993397Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-16T06:04:12.052491Z [info ] Elapsed time: 2.041720390319824 [0:00:02.041720] [timeout_sampler] 2026-07-16T06:04:12.052667Z [info ] Wait for Pod/test-auth-notebook-0's 'Ready' condition to be 'True' [ocp_resources Pod] 2026-07-16T06:04:12.052787Z [info ] Wait until Pod test-auth-notebook-0 is created [ocp_resources Pod] 2026-07-16T06:04:12.052899Z [info ] Waiting for 120 seconds [0:02:00], retry every 1 seconds. (Function: ocp_resources.resource.wait.lambda: self.exists) [timeout_sampler] 2026-07-16T06:04:12.072602Z [info ] Elapsed time: 3.0517578125e-05 [0:00:00.000031] [timeout_sampler] 2026-07-16T06:04:12.072936Z [info ] Waiting for 119.97964715957642 seconds [0:01:59.979647], retry every 1 seconds. (Function: ocp_resources.resource.wait_for_condition.lambda: self.instance) [timeout_sampler] 2026-07-16T06:04:34.839680Z [info ] Elapsed time: 22.733075857162476 [0:00:22.733076] [timeout_sampler] --------------------------------------------------------- CALL --------------------------------------------------------- PASSED TEST: TestNotebook.test_auth_container_resource_customization[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0] STATUS: PASSED ------------------------------------------------------- TEARDOWN ------------------------------------------------------- 2026-07-16T06:04:34.858818Z [info ] Delete Notebook test-auth-notebook [ocp_resources Notebook] 2026-07-16T06:04:34.909259Z [info ] Deleting {'apiVersion': 'kubeflow.org/v1', 'kind': 'Notebook', 'metadata': {'annotations': {'notebooks.opendatahub.io/auth-sidecar-cpu-limit': '500m', 'notebooks.opendatahub.io/auth-sidecar-cpu-request': '200m', 'notebooks.opendatahub.io/auth-sidecar-memory-limit': '256Mi', 'notebooks.opendatahub.io/auth-sidecar-memory-request': '128Mi', 'notebooks.opendatahub.io/inject-auth': 'true', 'notebooks.opendatahub.io/last-image-selection': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.5', 'opendatahub.io/accelerator-name': ''}, 'creationTimestamp': '2026-07-16T06:04:09Z', 'finalizers': ['notebook.opendatahub.io/kube-rbac-proxy-cleanup', 'notebook.opendatahub.io/httproute-cleanup', 'notebook.opendatahub.io/referencegrant-cleanup'], 'generation': 1, 'labels': {'app': 'test-auth-notebook', 'opendatahub.io/dashboard': 'true', 'opendatahub.io/odh-managed': 'true'}, 'managedFields': [{'apiVersion': 'kubeflow.org/v1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:notebooks.opendatahub.io/auth-sidecar-cpu-limit': {}, 'f:notebooks.opendatahub.io/auth-sidecar-cpu-request': {}, 'f:notebooks.opendatahub.io/auth-sidecar-memory-limit': {}, 'f:notebooks.opendatahub.io/auth-sidecar-memory-request': {}, 'f:notebooks.opendatahub.io/inject-auth': {}, 'f:notebooks.opendatahub.io/last-image-selection': {}, 'f:opendatahub.io/accelerator-name': {}}, 'f:finalizers': {'.': {}, 'v:"notebook.opendatahub.io/kube-rbac-proxy-cleanup"': {}}, 'f:labels': {'.': {}, 'f:app': {}, 'f:opendatahub.io/dashboard': {}, 'f:opendatahub.io/odh-managed': {}}}, 'f:spec': {'.': {}, 'f:template': {'.': {}, 'f:spec': {'.': {}, 'f:affinity': {}, 'f:containers': {'.': {}, 'k:{"name":"test-auth-notebook"}': {'.': {}, 'f:env': {'.': {}, 'k:{"name":"JUPYTER_IMAGE"}': {'.': {}, 'f:name': {}, 'f:value': {}}, 'k:{"name":"NOTEBOOK_ARGS"}': {'.': {}, 'f:name': {}, 'f:value': {}}}, 'f:image': {}, 'f:imagePullPolicy': {}, 'f:livenessProbe': {'.': {}, 'f:failureThreshold': {}, 'f:httpGet': {'.': {}, 'f:path': {}, 'f:port': {}, 'f:scheme': {}}, 'f:initialDelaySeconds': {}, 'f:periodSeconds': {}, 'f:successThreshold': {}, 'f:timeoutSeconds': {}}, 'f:name': {}, 'f:ports': {'.': {}, 'k:{"containerPort":8888,"protocol":"TCP"}': {'.': {}, 'f:containerPort': {}, 'f:name': {}, 'f:protocol': {}}}, 'f:readinessProbe': {'.': {}, 'f:failureThreshold': {}, 'f:httpGet': {'.': {}, 'f:path': {}, 'f:port': {}, 'f:scheme': {}}, 'f:initialDelaySeconds': {}, 'f:periodSeconds': {}, 'f:successThreshold': {}, 'f:timeoutSeconds': {}}, 'f:resources': {'.': {}, 'f:limits': {'.': {}, 'f:cpu': {}, 'f:memory': {}}, 'f:requests': {'.': {}, 'f:cpu': {}, 'f:memory': {}}}, 'f:volumeMounts': {'.': {}, 'k:{"mountPath":"/dev/shm"}': {'.': {}, 'f:mountPath': {}, 'f:name': {}}, 'k:{"mountPath":"/opt/app-root/src"}': {'.': {}, 'f:mountPath': {}, 'f:name': {}}}, 'f:workingDir': {}}}, 'f:enableServiceLinks': {}, 'f:serviceAccountName': {}, 'f:volumes': {'.': {}, 'k:{"name":"kube-rbac-proxy-config"}': {'.': {}, 'f:configMap': {}, 'f:name': {}}, 'k:{"name":"kube-rbac-proxy-tls-certificates"}': {'.': {}, 'f:name': {}, 'f:secret': {'.': {}, 'f:defaultMode': {}, 'f:secretName': {}}}, 'k:{"name":"shm"}': {'.': {}, 'f:emptyDir': {'.': {}, 'f:medium': {}}, 'f:name': {}}, 'k:{"name":"test-auth-notebook"}': {'.': {}, 'f:name': {}, 'f:persistentVolumeClaim': {'.': {}, 'f:claimName': {}}}}}}}}, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': '2026-07-16T06:04:09Z'}, {'apiVersion': 'kubeflow.org/v1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:finalizers': {'v:"notebook.opendatahub.io/httproute-cleanup"': {}, 'v:"notebook.opendatahub.io/referencegrant-cleanup"': {}}}}, 'manager': 'manager', 'operation': 'Update', 'time': '2026-07-16T06:04:10Z'}, {'apiVersion': 'kubeflow.org/v1beta1', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'.': {}, 'f:conditions': {}, 'f:containerState': {'.': {}, 'f:running': {'.': {}, 'f:startedAt': {}}}, 'f:readyReplicas': {}}}, 'manager': 'manager', 'operation': 'Update', 'subresource': 'status', 'time': '2026-07-16T06:04:34Z'}], 'name': 'test-auth-notebook', 'namespace': 'test-auth-notebook', 'resourceVersion': '34886867', 'uid': '16ec6818-db24-4903-903d-5f9e2fa8f341'}, 'spec': {'template': {'spec': {'affinity': {}, 'containers': [{'env': [{'name': 'NOTEBOOK_ARGS', 'value': "--ServerApp.port=8888\n --ServerApp.token=''\n --ServerApp.password=''\n --ServerApp.base_url=/notebook/test-auth-notebook/test-auth-notebook\n --ServerApp.quit_button=False\n"}, {'name': 'JUPYTER_IMAGE', 'value': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.5'}, {'name': 'SSL_CERT_FILE', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}, {'name': 'PIPELINES_SSL_SA_CERTS', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}, {'name': 'KF_PIPELINES_SSL_SA_CERTS', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}, {'name': 'GIT_SSL_CAINFO', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}, {'name': 'PIP_CERT', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}, {'name': 'REQUESTS_CA_BUNDLE', 'value': '/etc/pki/tls/custom-certs/ca-bundle.crt'}], 'image': 'image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/s2i-minimal-notebook:3.5', 'imagePullPolicy': 'Always', 'livenessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/notebook/test-auth-notebook/test-auth-notebook/api', 'port': 'notebook-port', 'scheme': 'HTTP'}, 'initialDelaySeconds': 10, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'name': 'test-auth-notebook', 'ports': [{'containerPort': 8888, 'name': 'notebook-port', 'protocol': 'TCP'}], 'readinessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/notebook/test-auth-notebook/test-auth-notebook/api', 'port': 'notebook-port', 'scheme': 'HTTP'}, 'initialDelaySeconds': 10, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'resources': {'limits': {'cpu': '2', 'memory': '4Gi'}, 'requests': {'cpu': '1', 'memory': '1Gi'}}, 'volumeMounts': [{'mountPath': '/opt/app-root/src', 'name': 'test-auth-notebook'}, {'mountPath': '/dev/shm', 'name': 'shm'}, {'mountPath': '/etc/pki/tls/custom-certs', 'name': 'trusted-ca', 'readOnly': True}, {'mountPath': '/opt/app-root/pipeline-runtimes/', 'name': 'runtime-images'}], 'workingDir': '/opt/app-root/src'}, {'args': ['--secure-listen-address=0.0.0.0:8443', '--upstream=http://127.0.0.1:8888/', '--logtostderr=true', '--v=10', '--proxy-endpoints-port=8444', '--config-file=/etc/kube-rbac-proxy/config-file.yaml', '--tls-cert-file=/etc/tls/private/tls.crt', '--tls-private-key-file=/etc/tls/private/tls.key', '--auth-header-fields-enabled=true', '--auth-header-user-field-name=X-Auth-Request-User', '--auth-header-groups-field-name=X-Auth-Request-Groups'], 'image': 'registry.redhat.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:1e614e46799fd020ac18d95c06a463421154ce86e59ccb3fa6007e66fed9910e', 'imagePullPolicy': 'Always', 'livenessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/healthz', 'port': 8444, 'scheme': 'HTTPS'}, 'initialDelaySeconds': 30, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'name': 'kube-rbac-proxy', 'ports': [{'containerPort': 8443, 'name': 'kube-rbac-proxy', 'protocol': 'TCP'}], 'readinessProbe': {'failureThreshold': 3, 'httpGet': {'path': '/healthz', 'port': 8444, 'scheme': 'HTTPS'}, 'initialDelaySeconds': 5, 'periodSeconds': 5, 'successThreshold': 1, 'timeoutSeconds': 1}, 'resources': {'limits': {'cpu': '500m', 'memory': '256Mi'}, 'requests': {'cpu': '200m', 'memory': '128Mi'}}, 'volumeMounts': [{'mountPath': '/etc/kube-rbac-proxy', 'name': 'kube-rbac-proxy-config'}, {'mountPath': '/etc/tls/private', 'name': 'kube-rbac-proxy-tls-certificates'}]}], 'enableServiceLinks': False, 'serviceAccountName': 'test-auth-notebook', 'volumes': [{'name': 'test-auth-notebook', 'persistentVolumeClaim': {'claimName': 'test-auth-notebook'}}, {'emptyDir': {'medium': 'Memory'}, 'name': 'shm'}, {'configMap': {'defaultMode': 420, 'name': 'test-auth-notebook-kube-rbac-proxy-config'}, 'name': 'kube-rbac-proxy-config'}, {'name': 'kube-rbac-proxy-tls-certificates', 'secret': {'defaultMode': 420, 'secretName': 'test-auth-notebook-kube-rbac-proxy-tls'}}, {'configMap': {'name': 'workbench-trusted-ca-bundle', 'optional': True}, 'name': 'trusted-ca'}, {'configMap': {'name': 'pipeline-runtime-images', 'optional': True}, 'name': 'runtime-images'}]}}}, 'status': {'conditions': [{'lastProbeTime': '2026-07-16T06:04:34Z', 'lastTransitionTime': '2026-07-16T06:04:23Z', 'status': 'True', 'type': 'PodReadyToStartContainers'}, {'lastProbeTime': '2026-07-16T06:04:34Z', 'lastTransitionTime': '2026-07-16T06:04:14Z', 'status': 'True', 'type': 'Initialized'}, {'lastProbeTime': '2026-07-16T06:04:34Z', 'lastTransitionTime': '2026-07-16T06:04:34Z', 'status': 'True', 'type': 'Ready'}, {'lastProbeTime': '2026-07-16T06:04:34Z', 'lastTransitionTime': '2026-07-16T06:04:34Z', 'status': 'True', 'type': 'ContainersReady'}, {'lastProbeTime': '2026-07-16T06:04:34Z', 'lastTransitionTime': '2026-07-16T06:04:14Z', 'status': 'True', 'type': 'PodScheduled'}], 'containerState': {'running': {'startedAt': '2026-07-16T06:04:21Z'}}, 'readyReplicas': 1}} [ocp_resources Notebook] 2026-07-16T06:04:34.945572Z [info ] Wait until Notebook test-auth-notebook is deleted [ocp_resources Notebook] 2026-07-16T06:04:34.945745Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-07-16T06:04:35.986053Z [info ] Elapsed time: 1.0196919441223145 [0:00:01.019692] [timeout_sampler] 2026-07-16T06:04:35.986351Z [info ] Delete PersistentVolumeClaim test-auth-notebook [ocp_resources PersistentVolumeClaim] 2026-07-16T06:04:36.024373Z [info ] Deleting {'kind': 'PersistentVolumeClaim', 'apiVersion': 'v1', 'metadata': {'name': 'test-auth-notebook', 'namespace': 'test-auth-notebook', 'uid': '51bcaf3e-4de6-40b3-9ee2-21336427b985', 'resourceVersion': '34886422', 'creationTimestamp': '2026-07-16T06:04:09Z', 'labels': {'opendatahub.io/dashboard': 'true'}, 'annotations': {'pv.kubernetes.io/bind-completed': 'yes', 'pv.kubernetes.io/bound-by-controller': 'yes', 'volume.beta.kubernetes.io/storage-provisioner': 'ebs.csi.aws.com', 'volume.kubernetes.io/selected-node': 'ip-10-0-1-195.us-east-2.compute.internal', 'volume.kubernetes.io/storage-provisioner': 'ebs.csi.aws.com'}, 'finalizers': ['kubernetes.io/pvc-protection'], 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-16T06:04:09Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:labels': {'.': {}, 'f:opendatahub.io/dashboard': {}}}, 'f:spec': {'f:accessModes': {}, 'f:resources': {'f:requests': {'.': {}, 'f:storage': {}}}, 'f:volumeMode': {}}}}, {'manager': 'kube-scheduler', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-16T06:04:11Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:volume.kubernetes.io/selected-node': {}}}}}, {'manager': 'kube-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-16T06:04:13Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:pv.kubernetes.io/bind-completed': {}, 'f:pv.kubernetes.io/bound-by-controller': {}, 'f:volume.beta.kubernetes.io/storage-provisioner': {}, 'f:volume.kubernetes.io/storage-provisioner': {}}}, 'f:spec': {'f:volumeName': {}}}}, {'manager': 'kube-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-16T06:04:13Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'f:accessModes': {}, 'f:capacity': {'.': {}, 'f:storage': {}}, 'f:phase': {}}}, 'subresource': 'status'}]}, 'spec': {'accessModes': ['ReadWriteOnce'], 'resources': {'requests': {'storage': '10Gi'}}, 'volumeName': 'pvc-51bcaf3e-4de6-40b3-9ee2-21336427b985', 'storageClassName': 'gp3-csi', 'volumeMode': 'Filesystem'}, 'status': {'phase': 'Bound', 'accessModes': ['ReadWriteOnce'], 'capacity': {'storage': '10Gi'}}} [ocp_resources PersistentVolumeClaim] 2026-07-16T06:04:36.047811Z [info ] Wait until PersistentVolumeClaim test-auth-notebook is deleted [ocp_resources PersistentVolumeClaim] 2026-07-16T06:04:36.047987Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] 2026-07-16T06:04:44.218357Z [info ] Elapsed time: 8.14979600906372 [0:00:08.149796] [timeout_sampler] 2026-07-16T06:04:44.240117Z [info ] Delete Project test-auth-notebook [ocp_resources Project] 2026-07-16T06:04:44.289587Z [info ] Deleting {'kind': 'Project', 'apiVersion': 'project.openshift.io/v1', 'metadata': {'name': 'test-auth-notebook', 'uid': '7d69afae-2983-40fd-b1f0-08101dcf4d4c', 'resourceVersion': '34886255', 'creationTimestamp': '2026-07-16T06:04:09Z', 'labels': {'kubernetes.io/metadata.name': 'test-auth-notebook', 'opendatahub.io/dashboard': 'true', 'pod-security.kubernetes.io/audit': 'restricted', 'pod-security.kubernetes.io/audit-version': 'latest', 'pod-security.kubernetes.io/warn': 'restricted', 'pod-security.kubernetes.io/warn-version': 'latest'}, 'annotations': {'openshift.io/description': '', 'openshift.io/display-name': '', 'openshift.io/requester': 'system:serviceaccount:kube-system:olminstall-cluster-admin', 'openshift.io/sa.scc.mcs': 's0:c44,c19', 'openshift.io/sa.scc.supplemental-groups': '1001930000/10000', 'openshift.io/sa.scc.uid-range': '1001930000/10000', 'security.openshift.io/MinimallySufficientPodSecurityStandard': 'restricted'}, 'managedFields': [{'manager': 'cluster-policy-controller', 'operation': 'Apply', 'apiVersion': 'v1', 'time': '2026-07-16T06:04:09Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:openshift.io/sa.scc.mcs': {}, 'f:openshift.io/sa.scc.supplemental-groups': {}, 'f:openshift.io/sa.scc.uid-range': {}}}}}, {'manager': 'pod-security-admission-label-synchronization-controller', 'operation': 'Apply', 'apiVersion': 'v1', 'time': '2026-07-16T06:04:09Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'f:security.openshift.io/MinimallySufficientPodSecurityStandard': {}}, 'f:labels': {'f:pod-security.kubernetes.io/audit': {}, 'f:pod-security.kubernetes.io/audit-version': {}, 'f:pod-security.kubernetes.io/warn': {}, 'f:pod-security.kubernetes.io/warn-version': {}}}}}, {'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-16T06:04:09Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:labels': {'f:opendatahub.io/dashboard': {}}}}}, {'manager': 'openshift-apiserver', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-16T06:04:09Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:metadata': {'f:annotations': {'.': {}, 'f:openshift.io/description': {}, 'f:openshift.io/display-name': {}, 'f:openshift.io/requester': {}}, 'f:labels': {'.': {}, 'f:kubernetes.io/metadata.name': {}}}}}, {'manager': 'openshift-controller-manager', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2026-07-16T06:04:09Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'f:finalizers': {}}}, 'subresource': 'finalize'}]}, 'spec': {'finalizers': ['kubernetes']}, 'status': {'phase': 'Active'}} [ocp_resources Project] 2026-07-16T06:04:44.323640Z [info ] Wait until Project test-auth-notebook is deleted [ocp_resources Project] 2026-07-16T06:04:44.323838Z [info ] Waiting for 240 seconds [0:04:00], retry every 1 seconds. (Function: ocp_resources.resource.wait_deleted.lambda: self.exists) [timeout_sampler] _ 2 of 4 completed, 2 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _ tests/workbenches/notebooks_server/operator/test_imagestream_health.py::test_workbench_imagestreams_health[test_notebook_imagestreams] 2026-07-16T06:04:52.522370Z [info ] Elapsed time: 8.170754671096802 [0:00:08.170755] [timeout_sampler]  ---------------------------- test_workbench_imagestreams_health[test_notebook_imagestreams] ---------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-07-16T06:04:52.522902Z [info ] Executing function fixture: label_selector [conftest] 2026-07-16T06:04:52.523015Z [info ] Executing function fixture: expected_imagestream_count [conftest] 2026-07-16T06:04:52.523132Z [info ] Executing function fixture: latest_tags_only [conftest] --------------------------------------------------------- CALL --------------------------------------------------------- 2026-07-16T06:04:52.523402Z [info ] kind: ImageStream api version: image.openshift.io/v1 [ocp_resources.resource] 2026-07-16T06:04:52.838821Z [info ] Checking ImageStreams for label selector 'opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches': expected_count=11, actual_count=11 [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.838947Z [info ] ImageStreams matched for 'opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches': code-server-notebook, jupyter-pytorch-llmcompressor, jupyter-rocm-minimal, jupyter-rocm-pytorch, jupyter-rocm-tensorflow, minimal-gpu, odh-trustyai-notebook, pytorch, s2i-generic-data-science-notebook, s2i-minimal-notebook, tensorflow [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.858140Z [info ] Validating ImageStream code-server-notebook (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.858230Z [info ] ImageStream code-server-notebook tag coverage: spec_tags=['3.4', '3.5'], status_tags=['2025.1', '2025.2', '3.4', '3.5'] [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.858280Z [info ] Checked ImageStream tag code-server-notebook:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.858324Z [info ] Checked ImageStream tag code-server-notebook:3.5 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.878400Z [info ] Validating ImageStream jupyter-pytorch-llmcompressor (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.878483Z [info ] ImageStream jupyter-pytorch-llmcompressor tag coverage: spec_tags=['3.4', '3.5'], status_tags=['2025.2', '3.4', '3.5'] [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.878531Z [info ] Checked ImageStream tag jupyter-pytorch-llmcompressor:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.878573Z [info ] Checked ImageStream tag jupyter-pytorch-llmcompressor:3.5 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.897903Z [info ] Validating ImageStream jupyter-rocm-minimal (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.897971Z [info ] ImageStream jupyter-rocm-minimal tag coverage: spec_tags=['3.4', '3.5'], status_tags=['2025.1', '2025.2', '3.4', '3.5'] [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.898010Z [info ] Checked ImageStream tag jupyter-rocm-minimal:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.898043Z [info ] Checked ImageStream tag jupyter-rocm-minimal:3.5 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.917395Z [info ] Validating ImageStream jupyter-rocm-pytorch (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.917477Z [info ] ImageStream jupyter-rocm-pytorch tag coverage: spec_tags=['3.4', '3.5'], status_tags=['2025.1', '2025.2', '3.4', '3.5'] [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.917522Z [info ] Checked ImageStream tag jupyter-rocm-pytorch:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.917559Z [info ] Checked ImageStream tag jupyter-rocm-pytorch:3.5 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.937268Z [info ] Validating ImageStream jupyter-rocm-tensorflow (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.937336Z [info ] ImageStream jupyter-rocm-tensorflow tag coverage: spec_tags=['3.4', '3.5'], status_tags=['2025.1', '2025.2', '3.4', '3.5'] [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.937374Z [info ] Checked ImageStream tag jupyter-rocm-tensorflow:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.937405Z [info ] Checked ImageStream tag jupyter-rocm-tensorflow:3.5 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.957229Z [info ] Validating ImageStream minimal-gpu (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.957345Z [info ] ImageStream minimal-gpu tag coverage: spec_tags=['3.4', '3.5'], status_tags=['2025.1', '2025.2', '3.4', '3.5'] [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.957398Z [info ] Checked ImageStream tag minimal-gpu:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.957442Z [info ] Checked ImageStream tag minimal-gpu:3.5 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.977658Z [info ] Validating ImageStream odh-trustyai-notebook (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.977746Z [info ] ImageStream odh-trustyai-notebook tag coverage: spec_tags=['3.4', '3.5'], status_tags=['2025.1', '2025.2', '3.4', '3.5'] [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.977800Z [info ] Checked ImageStream tag odh-trustyai-notebook:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.977854Z [info ] Checked ImageStream tag odh-trustyai-notebook:3.5 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.997374Z [info ] Validating ImageStream pytorch (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.997458Z [info ] ImageStream pytorch tag coverage: spec_tags=['3.4', '3.5'], status_tags=['2025.1', '2025.2', '3.4', '3.5'] [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.997506Z [info ] Checked ImageStream tag pytorch:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:52.997545Z [info ] Checked ImageStream tag pytorch:3.5 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.017126Z [info ] Validating ImageStream s2i-generic-data-science-notebook (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.017212Z [info ] ImageStream s2i-generic-data-science-notebook tag coverage: spec_tags=['3.4', '3.5'], status_tags=['2025.1', '2025.2', '3.4', '3.5'] [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.017252Z [info ] Checked ImageStream tag s2i-generic-data-science-notebook:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.017284Z [info ] Checked ImageStream tag s2i-generic-data-science-notebook:3.5 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.037216Z [info ] Validating ImageStream s2i-minimal-notebook (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.037299Z [info ] ImageStream s2i-minimal-notebook tag coverage: spec_tags=['3.4', '3.5'], status_tags=['2025.1', '2025.2', '3.4', '3.5'] [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.037345Z [info ] Checked ImageStream tag s2i-minimal-notebook:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.037384Z [info ] Checked ImageStream tag s2i-minimal-notebook:3.5 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health PASSED2026-07-16T06:04:53.056839Z [info ] Validating ImageStream tensorflow (label selector: opendatahub.io/notebook-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.056909Z [info ] ImageStream tensorflow tag coverage: spec_tags=['3.4', '3.5'], status_tags=['2025.1', '2025.2', '3.4', '3.5'] [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.056946Z [info ] Checked ImageStream tag tensorflow:3.4 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health _ 3 of 4 completed, 3 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _ tests/workbenches/notebooks_server/operator/test_imagestream_health.py::test_workbench_imagestreams_health[test_runtime_imagestreams] 2026-07-16T06:04:53.056977Z [info ] Checked ImageStream tag tensorflow:3.5 (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health  TEST: test_workbench_imagestreams_health[test_notebook_imagestreams] STATUS: PASSED ------------------------------------------------------- TEARDOWN -------------------------------------------------------  ---------------------------- test_workbench_imagestreams_health[test_runtime_imagestreams] ---------------------------- -------------------------------------------------------- SETUP -------------------------------------------------------- 2026-07-16T06:04:53.060260Z [info ] Executing function fixture: label_selector [conftest] 2026-07-16T06:04:53.060370Z [info ] Executing function fixture: expected_imagestream_count [conftest] 2026-07-16T06:04:53.060471Z [info ] Executing function fixture: latest_tags_only [conftest] --------------------------------------------------------- CALL --------------------------------------------------------- 2026-07-16T06:04:53.083518Z [info ] Checking ImageStreams for label selector 'opendatahub.io/runtime-image=true,platform.opendatahub.io/part-of=workbenches': expected_count=7, actual_count=7 [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.083578Z [info ] ImageStreams matched for 'opendatahub.io/runtime-image=true,platform.opendatahub.io/part-of=workbenches': runtime-datascience, runtime-minimal, runtime-pytorch, runtime-pytorch-llmcompressor, runtime-rocm-pytorch, runtime-rocm-tensorflow, runtime-tensorflow [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.113331Z [info ] Validating ImageStream runtime-datascience (label selector: opendatahub.io/runtime-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.113447Z [info ] ImageStream runtime-datascience tag coverage: spec_tags=['datascience'], status_tags=['datascience'] [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.113503Z [info ] Checked ImageStream tag runtime-datascience:datascience (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.135236Z [info ] Validating ImageStream runtime-minimal (label selector: opendatahub.io/runtime-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.135310Z [info ] ImageStream runtime-minimal tag coverage: spec_tags=['minimal'], status_tags=['minimal'] [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.135354Z [info ] Checked ImageStream tag runtime-minimal:minimal (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.156779Z [info ] Validating ImageStream runtime-pytorch (label selector: opendatahub.io/runtime-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.156875Z [info ] ImageStream runtime-pytorch tag coverage: spec_tags=['pytorch'], status_tags=['pytorch'] [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.156922Z [info ] Checked ImageStream tag runtime-pytorch:pytorch (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.179617Z [info ] Validating ImageStream runtime-pytorch-llmcompressor (label selector: opendatahub.io/runtime-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.179695Z [info ] ImageStream runtime-pytorch-llmcompressor tag coverage: spec_tags=['pytorch-llmcompressor'], status_tags=['pytorch-llmcompressor'] [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.179740Z [info ] Checked ImageStream tag runtime-pytorch-llmcompressor:pytorch-llmcompressor (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.201613Z [info ] Validating ImageStream runtime-rocm-pytorch (label selector: opendatahub.io/runtime-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.201712Z [info ] ImageStream runtime-rocm-pytorch tag coverage: spec_tags=['rocm-pytorch'], status_tags=['rocm-pytorch'] [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.201753Z [info ] Checked ImageStream tag runtime-rocm-pytorch:rocm-pytorch (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.223881Z [info ] Validating ImageStream runtime-rocm-tensorflow (label selector: opendatahub.io/runtime-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.223955Z [info ] ImageStream runtime-rocm-tensorflow tag coverage: spec_tags=['rocm-tensorflow'], status_tags=['rocm-tensorflow'] [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.223998Z [info ] Checked ImageStream tag runtime-rocm-tensorflow:rocm-tensorflow (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health PASSED2026-07-16T06:04:53.247745Z [info ] Validating ImageStream runtime-tensorflow (label selector: opendatahub.io/runtime-image=true,platform.opendatahub.io/part-of=workbenches) [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.247821Z [info ] ImageStream runtime-tensorflow tag coverage: spec_tags=['tensorflow'], status_tags=['tensorflow'] [_pytest.compat] name=test_imagestream_health 2026-07-16T06:04:53.247868Z [info ] Checked ImageStream tag runtime-tensorflow:tensorflow (items_count=1, import_success=N/A) [_pytest.compat] name=test_imagestream_health  TEST: test_workbench_imagestreams_health[test_runtime_imagestreams] STATUS: PASSED ------------------------------------------------------- TEARDOWN ------------------------------------------------------- _ 4 of 4 completed, 4 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _ ============ 4 passed, 55 deselected, 1 error in 121.89s (0:02:01) ============= ==================================== ERRORS ==================================== _ ERROR at teardown of TestNotebook.test_create_simple_notebook[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0] _ Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1171, in retry_cluster_exceptions for sample in sampler: ^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 171, in __iter__ raise TimeoutExpiredError( self._get_exception_log(exp=last_exp), last_exp=last_exp, elapsed_time=elapsed_time ) timeout_sampler.TimeoutExpiredError: Timed Out: 10 Function: ocp_resources.resource._instance Last exception: ServiceUnavailableError: 503 Reason: Service Unavailable HTTP response headers: HTTPHeaderDict({'Audit-Id': 'd6f2644a-2018-40a1-ab98-89b05762433b', 'Cache-Control': 'no-cache, private', 'Content-Type': 'text/plain; charset=utf-8', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'X-Content-Type-Options': 'nosniff', 'X-Kubernetes-Pf-Flowschema-Uid': '166a5be2-9ec1-4591-b6bd-7ae41ddf7ba0', 'X-Kubernetes-Pf-Prioritylevel-Uid': '80f1606f-0424-4173-ba01-beaca33539cb', 'Date': 'Thu, 16 Jul 2026 06:04:08 GMT', 'Content-Length': '61'}) HTTP response body: b'error trying to reach service: http2: client connection lost\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 373, in request return self.rest_client.GET(url, ~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content=_preload_content, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers) ^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 244, in GET return self.request("GET", url, ~~~~~~~~~~~~^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ _preload_content=_preload_content, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ query_params=query_params) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) . Elapsed time: 0.7764589786529541 [0:00:00.776459] The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 361, in from_call result: TResult | None = func() ~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 250, in lambda: runtest_hook(item=item, **kwds), ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_hooks.py", line 512, in __call__ return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_manager.py", line 120, in _hookexec return self._inner_hookexec(hook_name, methods, kwargs, firstresult) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 167, in _multicall raise exception File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 139, in _multicall teardown.throw(exception) ~~~~~~~~~~~~~~^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/capture.py", line 905, in pytest_runtest_teardown return (yield) ^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/pluggy/_callers.py", line 121, in _multicall res = hook_impl.function(*args) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 199, in pytest_runtest_teardown item.session._setupstate.teardown_exact(nextitem) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 579, in teardown_exact raise exceptions[0] File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/runner.py", line 568, in teardown_exact fin() ~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1166, in finish raise exceptions[0] File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1156, in finish fin() ~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/_pytest/fixtures.py", line 1014, in _teardown_yield_fixture next(it) ~~~~^^^^ File "/home/odh/opendatahub-tests/tests/conftest.py", line 636, in unprivileged_model_namespace with create_ns( ~~~~~~~~~^ admin_client=admin_client, ^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... teardown=teardown_resources, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) as ns: ^ File "/usr/lib64/python3.14/contextlib.py", line 148, in __exit__ next(self.gen) ~~~~^^^^^^^^^^ File "/home/odh/opendatahub-tests/utilities/infra.py", line 173, in create_ns project.clean_up() ~~~~~~~~~~~~~~~~^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 872, in clean_up return self.delete(wait=wait, timeout=timeout or self.delete_timeout) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1085, in delete if self.exists: ^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 981, in exists return self.instance ^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1248, in instance return self.retry_cluster_exceptions(func=_instance) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1176, in retry_cluster_exceptions raise exp.last_exp from exp File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/timeout_sampler/__init__.py", line 162, in __iter__ yield self.func(*self.func_args, **self.func_kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/ocp_resources/resource.py", line 1246, in _instance return self.api.get(name=self.name) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 112, in get return self.request('get', path, **kwargs) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 57, in inner raise api_exception(e) kubernetes.dynamic.exceptions.ServiceUnavailableError: 503 Reason: Service Unavailable HTTP response headers: HTTPHeaderDict({'Audit-Id': 'd6f2644a-2018-40a1-ab98-89b05762433b', 'Cache-Control': 'no-cache, private', 'Content-Type': 'text/plain; charset=utf-8', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'X-Content-Type-Options': 'nosniff', 'X-Kubernetes-Pf-Flowschema-Uid': '166a5be2-9ec1-4591-b6bd-7ae41ddf7ba0', 'X-Kubernetes-Pf-Prioritylevel-Uid': '80f1606f-0424-4173-ba01-beaca33539cb', 'Date': 'Thu, 16 Jul 2026 06:04:08 GMT', 'Content-Length': '61'}) HTTP response body: b'error trying to reach service: http2: client connection lost\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 373, in request return self.rest_client.GET(url, ~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content=_preload_content, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers) ^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 244, in GET return self.request("GET", url, ~~~~~~~~~~~~^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ _preload_content=_preload_content, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ query_params=query_params) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) - generated xml file: /workspace/tests-shared/tests-payload/results/workbenches-smoke.xml - _ 4 of 4 completed, 4 Pass, 0 Fail, 0 Skip, 0 XPass, 0 XFail, 0 Error, 0 ReRun _ =========================== short test summary info ============================ ERROR tests/workbenches/notebooks_server/controller/test_spawning.py::TestNotebook::test_create_simple_notebook[unprivileged_model_namespace0-users_persistent_volume_claim0-default_notebook0-notebook_pod0] - kubernetes.dynamic.exceptions.ServiceUnavailableError: 503 Reason: Service Unavailable HTTP response headers: HTTPHeaderDict({'Audit-Id': 'd6f2644a-2018-40a1-ab98-89b05762433b', 'Cache-Control': 'no-cache, private', 'Content-Type': 'text/plain; charset=utf-8', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'X-Content-Type-Options': 'nosniff', 'X-Kubernetes-Pf-Flowschema-Uid': '166a5be2-9ec1-4591-b6bd-7ae41ddf7ba0', 'X-Kubernetes-Pf-Prioritylevel-Uid': '80f1606f-0424-4173-ba01-beaca33539cb', 'Date': 'Thu, 16 Jul 2026 06:04:08 GMT', 'Content-Length': '61'}) HTTP response body: b'error trying to reach service: http2: client connection lost\n' Original traceback: File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 55, in inner resp = func(self, *args, **kwargs) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/dynamic/client.py", line 277, in request api_response = self.client.call_api( path, ...<11 lines>... _request_timeout=params.get('_request_timeout') ) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ path_params, query_params, header_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... _return_http_data_only, collection_formats, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content, _request_timeout, _host) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( method, url, query_params=query_params, headers=header_params, post_params=post_params, body=body, _preload_content=_preload_content, _request_timeout=_request_timeout) File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/api_client.py", line 373, in request return self.rest_client.GET(url, ~~~~~~~~~~~~~~~~~~~~^^^^^ query_params=query_params, ^^^^^^^^^^^^^^^^^^^^^^^^^^ _preload_content=_preload_content, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers) ^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 244, in GET return self.request("GET", url, ~~~~~~~~~~~~^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ _preload_content=_preload_content, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ _request_timeout=_request_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ query_params=query_params) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/odh/opendatahub-tests/.venv/lib64/python3.14/site-packages/kubernetes/client/rest.py", line 238, in request raise ApiException(http_resp=r) ============ 4 passed, 55 deselected, 1 error in 121.89s (0:02:01) =============