--- BVT pytest attempt 2026-05-31T18:24:21.969902+00:00 (/.local/bin/uv run pytest...) ---
2026-05-31T18:24:23.607890Z [info     ] Writing tests log to /home/odh/opendatahub-tests/results/pytest-tests.log [conftest]
2026-05-31T18:24:23.608196Z [info     ] Skipping global config update for collect-only or setup-plan [conftest]
============================= test session starts ==============================
platform linux -- Python 3.14.5, pytest-9.0.3, pluggy-1.6.0 -- /home/odh/opendatahub-tests/.venv/bin/python
cachedir: .pytest_cache
metadata: {'Python': '3.14.5', 'Platform': 'Linux-5.14.0-427.115.1.el9_4.x86_64-x86_64-with-glibc2.42', 'Packages': {'pytest': '9.0.3', 'pluggy': '1.6.0'}, 'Plugins': {'anyio': '4.13.0', 'langsmith': '0.8.7', 'asyncio': '1.4.0', 'dependency': '0.6.1', 'html': '4.2.0', 'metadata': '3.1.1', 'order': '1.4.0', 'progress': '1.4.0', 'testconfig': '0.2.0', 'xdist': '3.8.0', 'syrupy': '5.2.0'}}
rootdir: /home/odh/opendatahub-tests
configfile: pytest.ini
plugins: anyio-4.13.0, langsmith-0.8.7, asyncio-1.4.0, dependency-0.6.1, html-4.2.0, metadata-3.1.1, order-1.4.0, progress-1.4.0, testconfig-0.2.0, xdist-3.8.0, syrupy-5.2.0
asyncio: mode=Mode.STRICT, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function
collecting ... collected 35 items / 28 deselected / 7 selected

<Dir opendatahub-tests>
  <Package tests>
    <Package ogx>
      <Dir operator>
        <Module test_ogx_server.py>
          <Class TestOgxServer>
            Test class that implements multiple tests to verify OGX distribution functionality.
            
            This class contains tests that validate various aspects of the OGX operator
            and its distribution components, including image validation and configuration checks.
            <Function test_ogx_server_verify_images[unprivileged_model_namespace0-ogx_server0]>
              Verify that OgxServer container images meet the requirements:
              1. Images are hosted in registry.redhat.io
              2. Images use sha256 digest instead of tags
              3. Images are listed in the CSV's relatedImages section
      <Dir vector_io>
        <Module test_vector_stores.py>
          <Class TestOgxVectorStores>
            Test class for OGX OpenAI Compatible Vector Stores API
            
            Note: multiple vector_io providers and datasets are tested via pytest parametrize
            
            For more information about this API, see:
            - https://github.com/ogx-ai/ogx-client-python/blob/main/api.md#vectorstores
            - https://github.com/openai/openai-python/blob/main/api.md#vectorstores
            <Function test_vector_stores_file_upload[vector_io:milvus-remote, files: s3, embedding: vllm-embedding, dataset:IBM_2025_Q4_EARNINGS]>
              Verify vector store files listing after document upload.
              
              Given: A vector store populated with the parametrized dataset documents.
              When: The vector_stores.files.list API is called with filter="completed".
              Then: The list returns exactly one completed file per uploaded document,
                  confirming ingestion is visible through the OpenAI-compatible API.
            <Function test_vector_stores_search[vector_io:milvus-remote, files: s3, embedding: vllm-embedding, dataset:IBM_2025_Q4_EARNINGS]>
              Test vector_stores search functionality using the search endpoint.
              
              Given: A vector store populated with the parametrized dataset documents
              When: Queries from the dataset QA ground truth are executed per retrieval mode
              Then: Each mode returns relevant results with proper metadata and content
            <Function test_response_file_search_tool_invocation[vector_io:milvus-remote, files: s3, embedding: vllm-embedding, dataset:IBM_2025_Q4_EARNINGS]>
              Test file_search tool invocation and results via the responses API.
              
              Sends a question from the dataset QA ground truth to the responses API with the
              file_search tool attached to the vector_store fixture. Asserts the response contains
              a completed file_search_call with results carrying file metadata, and that the
              message includes file_citation annotations with file_id and filename.
            <Function test_vector_stores_file_upload[vector_io:pgvector, files: local, embedding: vllm-embedding, dataset:IBM_2025_Q4_EARNINGS]>
              Verify vector store files listing after document upload.
              
              Given: A vector store populated with the parametrized dataset documents.
              When: The vector_stores.files.list API is called with filter="completed".
              Then: The list returns exactly one completed file per uploaded document,
                  confirming ingestion is visible through the OpenAI-compatible API.
            <Function test_vector_stores_search[vector_io:pgvector, files: local, embedding: vllm-embedding, dataset:IBM_2025_Q4_EARNINGS]>
              Test vector_stores search functionality using the search endpoint.
              
              Given: A vector store populated with the parametrized dataset documents
              When: Queries from the dataset QA ground truth are executed per retrieval mode
              Then: Each mode returns relevant results with proper metadata and content
            <Function test_response_file_search_tool_invocation[vector_io:pgvector, files: local, embedding: vllm-embedding, dataset:IBM_2025_Q4_EARNINGS]>
              Test file_search tool invocation and results via the responses API.
              
              Sends a question from the dataset QA ground truth to the responses API with the
              file_search tool attached to the vector_store fixture. Asserts the response contains
              a completed file_search_call with results carrying file metadata, and that the
              message includes file_citation annotations with file_id and filename.

=============================== warnings summary ===============================
tests/ogx/vector_io/test_vector_stores_evaluation.py:6
tests/ogx/vector_io/test_vector_stores_evaluation.py:6
  /home/odh/opendatahub-tests/tests/ogx/vector_io/test_vector_stores_evaluation.py:6: DeprecationWarning: Importing AnswerRelevancy from 'ragas.metrics' is deprecated and will be removed in v1.0. Please use 'ragas.metrics.collections' instead. Example: from ragas.metrics.collections import AnswerRelevancy
    from ragas.metrics import AnswerRelevancy, ContextPrecision, ContextRecall, Faithfulness

tests/ogx/vector_io/test_vector_stores_evaluation.py:6
tests/ogx/vector_io/test_vector_stores_evaluation.py:6
  /home/odh/opendatahub-tests/tests/ogx/vector_io/test_vector_stores_evaluation.py:6: DeprecationWarning: Importing ContextPrecision from 'ragas.metrics' is deprecated and will be removed in v1.0. Please use 'ragas.metrics.collections' instead. Example: from ragas.metrics.collections import ContextPrecision
    from ragas.metrics import AnswerRelevancy, ContextPrecision, ContextRecall, Faithfulness

tests/ogx/vector_io/test_vector_stores_evaluation.py:6
tests/ogx/vector_io/test_vector_stores_evaluation.py:6
  /home/odh/opendatahub-tests/tests/ogx/vector_io/test_vector_stores_evaluation.py:6: DeprecationWarning: Importing ContextRecall from 'ragas.metrics' is deprecated and will be removed in v1.0. Please use 'ragas.metrics.collections' instead. Example: from ragas.metrics.collections import ContextRecall
    from ragas.metrics import AnswerRelevancy, ContextPrecision, ContextRecall, Faithfulness

tests/ogx/vector_io/test_vector_stores_evaluation.py:6
tests/ogx/vector_io/test_vector_stores_evaluation.py:6
  /home/odh/opendatahub-tests/tests/ogx/vector_io/test_vector_stores_evaluation.py:6: DeprecationWarning: Importing Faithfulness from 'ragas.metrics' is deprecated and will be removed in v1.0. Please use 'ragas.metrics.collections' instead. Example: from ragas.metrics.collections import Faithfulness
    from ragas.metrics import AnswerRelevancy, ContextPrecision, ContextRecall, Faithfulness

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
----------------- generated xml file: /artifacts/ogx-smoke.xml -----------------
================ 7/35 tests collected (28 deselected) in 1.51s =================