It looks like this is your first time using Cypress: 15.17.0 ❯ Verifying Cypress can run /cypress_cache/15.17.0/Cypress ✔ Verified Cypress! /cypress_cache/15.17.0/Cypress Opening Cypress... Warning: The allowCypressEnv configuration option is enabled. This allows any browser code to read values from Cypress.env(). This is insecure and will be removed in a future major version. 1. Replace Cypress.env() calls with cy.env() (for sensitive values) or Cypress.expose() (for public configuration) 2. Set allowCypressEnv: false in your Cypress configuration to disable Cypress.env() Learn more: https://on.cypress.io/cypress-env-migration @cypress/grep: filtering using tag(s) "@SmokeSet1" ================================================================================ (Run Starting) ┌────────────────────────────────────────────────────────────────────────────────────────────────┐ │ Cypress: 15.17.0 │ │ Browser: Electron 138 (headless) │ │ Node Version: v22.22.0 (/usr/bin/node-22) │ │ Specs: 18 found (applications/testAboutDialog.cy.ts, dashboardNavigation/testApplicat │ │ ionLinks.cy.ts, dashboardNavigation/testManifestLinks.cy.ts, dataScienceProjec │ │ ts/testProjectAdminPermissions.cy.ts, featureStore/testFeatureStoreRbac.cy.ts, │ │ learningResources/test...) │ │ Searched: cypress/tests/e2e/applications/testAboutDialog.cy.ts, cypress/tests/e2e/dashbo │ │ ardNavigation/testApplicationLinks.cy.ts, cypress/tests/e2e/dashboardNavigatio │ │ n/testManifestLinks.cy.ts, cypress/tests/e2e/dataScienceProjects/testProjectAd │ │ minPermissions.cy.ts, cypress/tests/e2e/featureStore/testFeatureStoreRbac.cy.t │ │ s, cypress/tests/e2e/learningResources/testCustomResourceCreation.cy.ts, cypre │ │ ss/tests/e2e/modelCatalog/testCatalogSettingsAvailable.cy.ts, cypress/tests/e2 │ │ e/modelCatalog/testModelCatalogAvailable.cy.ts, cypress/tests/e2e/modelCatalog │ │ /testPerformanceFiltersAvailable.cy.ts, cypress/tests/e2e/applications/enabled │ │ /testNotebookAdministration.cy.ts, cypress/tests/e2e/applications/explore/test │ │ EnabledISVs.cy.ts, cypress/tests/e2e/dataScienceProjects/workbenches/testWorkb │ │ enchStorageClasses.cy.ts, cypress/tests/e2e/dataScienceProjects/workbenches/wo │ │ rkbenches.cy.ts, cypress/tests/e2e/modelTraining/trainJobs/testTrainjobLifecyc │ │ le.cy.ts, cypress/tests/e2e/modelTraining/trainJobs/testTrainjobProgression.cy │ │ .ts, cypress/tests/e2e/settings/hardwareProfiles/testDeleteAppliedHardwareProf │ │ ile.cy.ts, cypress/tests/e2e/settings/hardwareProfiles/testHardwareProfiles.cy │ │ .ts, cypress/tests/e2e/settings/hardwareProfiles/testModifyAppliedHardwareProf │ │ ile.cy.ts │ │ Experiments: experimentalInteractiveRunEvents=true,experimentalMemoryManagement=true │ └────────────────────────────────────────────────────────────────────────────────────────────────┘ Remove output folder /workspace/tests-shared/tests-payload/results/SmokeSet1/e2e ──────────────────────────────────────────────────────────────────────────────────────────────────── Running: applications/testAboutDialog.cy.ts (1 of 18) [2026-07-02T17:52:51.490Z] [INFO] Setting tests timeout to: 480 seconds Verify RHODS About Dialog [2026-07-02T17:52:51.513Z] [INFO] Starting 480s timeout for: Verify RHODS About Dialog contains correct information [2026-07-02T17:52:51.527Z] [INFO] Test title: Verify RHODS About Dialog contains correct information [2026-07-02T17:52:51.542Z] [INFO] Test tags: ["@Smoke","@SmokeSet1","@Dashboard","@RHOAIENG-21403","@NonConcurrent"] [2026-07-02T17:52:51.552Z] [INFO] Skip tags: ["@Bug","@Maintain","@Featureflagged","@FeatureStore","@FeatureStoreCI","@ConnectionTypesCI","@SettingsCI","@MaaSCI","@MaasSubscriptions","@ODS-327","@ODS-492","@ModelServingCI","@KServeCI","@ModelServing","@LLMDServingCI","@ProjectsCI","@PipelinesCI","@Pipelines","@ci-dashboard-regression-tags","@ModelRegistryCI","@AutoMLCI","@Tier1","@HardwareProfilesCI","@HardwareProfileModelServing","@ODS-327","@ODS-492"] [2026-07-02T17:52:51.563Z] [INFO] Grep tags: ["@SmokeSet1"] [2026-07-02T17:52:51.583Z] [INFO] Auto-detecting installed product (RHOAI or ODH)... [2026-07-02T17:52:52.399Z] [INFO] [EXEC] oc get csv -n redhat-ods-operator -o json | jq -r '[.items[] | select(.spec.displayName | test("Red Hat OpenShift AI")) | select(.status.phase != "Failed")] | first // empty' [2026-07-02T17:52:52.414Z] [INFO] Command exit code: 0 [2026-07-02T17:52:52.443Z] [INFO] Prepare the CSV JSON for the tests according to the installed Product: Red Hat OpenShift AI [2026-07-02T17:52:52.968Z] [INFO] [EXEC] oc get csv -n redhat-ods-operator -o json | jq -r '[.items[] | select(.spec.displayName | test("Red Hat OpenShift AI")) | select(.status.phase != "Failed")] | first // empty' [2026-07-02T17:52:52.985Z] [INFO] Command exit code: 0 [2026-07-02T17:52:53.017Z] [INFO] [STEP 1] Login to Red Hat OpenShift AI [2026-07-02T17:52:53.036Z] [INFO] Navigate to: https://rh-ai.apps.ods-qe-psi-23.osp.rh-ods.com/ [2026-07-02T17:52:53.049Z] [INFO] BYOIDC cluster detected - using Keycloak authentication [2026-07-02T17:52:54.178Z] [INFO] Keycloak login flow detected - completing authentication [2026-07-02T17:52:56.953Z] [INFO] [STEP 2] Open the About dialog [2026-07-02T17:52:58.680Z] [INFO] [STEP 3] Verify product 'Red Hat OpenShift AI' in About dialog [2026-07-02T17:52:58.741Z] [INFO] [STEP 4] Verify product 'Red Hat OpenShift AI' in About image [2026-07-02T17:52:58.774Z] [INFO] [STEP 5] Verify Red Hat OpenShift AI version in About dialog [2026-07-02T17:52:58.812Z] [INFO] [STEP 6] Verify Red Hat OpenShift AI channel in About dialog [2026-07-02T17:52:59.275Z] [INFO] [EXEC] oc get subscription -A -o json | jq -r '.items[] | select(.status.installedCSV != null) | select(.status.installedCSV | test("rhods-operator")) | .spec.channel' | head -n 1 [2026-07-02T17:52:59.282Z] [INFO] Command exit code: 0 [2026-07-02T17:52:59.302Z] [INFO] [STEP 7] Verify admin access level [2026-07-02T17:52:59.366Z] [INFO] Verify versions in About dialog's table for component: Dashboard [2026-07-02T17:52:59.725Z] [INFO] [EXEC] oc get Dashboard -A -o jsonpath='{.items[*].status.releases[*].version}' [2026-07-02T17:52:59.732Z] [INFO] Command exit code: 0 [2026-07-02T17:52:59.758Z] [INFO] Retrieved version of Dashboard: [2026-07-02T17:52:59.781Z] [INFO] Verify versions in About dialog's table for component: Pipelines [2026-07-02T17:53:00.230Z] [INFO] [EXEC] oc get Pipelines -A -o jsonpath='{.items[*].status.releases[*].version}' [2026-07-02T17:53:00.256Z] [INFO] Command exit code: 0 [2026-07-02T17:53:00.304Z] [INFO] Retrieved version of Pipelines: [2026-07-02T17:53:00.310Z] [INFO] Verify versions in About dialog's table for component: Kueue [2026-07-02T17:53:00.648Z] [INFO] [EXEC] oc get Kueue -A -o jsonpath='{.items[*].status.releases[*].version}' [2026-07-02T17:53:00.678Z] [INFO] Command exit code: 0 [2026-07-02T17:53:00.757Z] [INFO] Retrieved version of Kueue: [2026-07-02T17:53:00.826Z] [INFO] Verify versions in About dialog's table for component: Model registry [2026-07-02T17:53:01.192Z] [INFO] [EXEC] oc get Modelregistry -A -o jsonpath='{.items[*].status.releases[*].version}' [2026-07-02T17:53:01.200Z] [INFO] Command exit code: 0 [2026-07-02T17:53:01.234Z] [INFO] Retrieved version of Model registry: latest latest [2026-07-02T17:53:01.275Z] [INFO] Verify versions in About dialog's table for component: Feast operator [2026-07-02T17:53:01.784Z] [INFO] [EXEC] oc get Feastoperator -A -o jsonpath='{.items[*].status.releases[*].version}' [2026-07-02T17:53:01.835Z] [INFO] Command exit code: 0 [2026-07-02T17:53:01.844Z] [INFO] Retrieved version of Feast operator: 0.63.0 [2026-07-02T17:53:01.857Z] [INFO] Verify versions in About dialog's table for component: Model server and metrics [2026-07-02T17:53:02.774Z] [INFO] [EXEC] oc get Modelserverandmetrics -A -o jsonpath='{.items[*].status.releases[*].version}' [2026-07-02T17:53:02.883Z] [INFO] Command exit code: 1 [2026-07-02T17:53:02.929Z] [INFO] Failed to retrieve version of Model server and metrics: error: the server doesn't have a resource type "Modelserverandmetrics" [2026-07-02T17:53:02.941Z] [INFO] Verify versions in About dialog's table for component: Ray [2026-07-02T17:53:03.537Z] [INFO] [EXEC] oc get Ray -A -o jsonpath='{.items[*].status.releases[*].version}' [2026-07-02T17:53:03.545Z] [INFO] Command exit code: 0 [2026-07-02T17:53:03.662Z] [INFO] Retrieved version of Ray: 1.4.2 [2026-07-02T17:53:03.672Z] [INFO] Verify versions in About dialog's table for component: Training operator [2026-07-02T17:53:04.393Z] [INFO] [EXEC] oc get Trainingoperator -A -o jsonpath='{.items[*].status.releases[*].version}' [2026-07-02T17:53:04.529Z] [INFO] Command exit code: 0 [2026-07-02T17:53:04.572Z] [INFO] Retrieved version of Training operator: 1.9.0 [2026-07-02T17:53:04.580Z] [INFO] Verify versions in About dialog's table for component: TrustyAI [2026-07-02T17:53:05.342Z] [INFO] [EXEC] oc get TrustyAI -A -o jsonpath='{.items[*].status.releases[*].version}' [2026-07-02T17:53:05.385Z] [INFO] Command exit code: 0 [2026-07-02T17:53:05.478Z] [INFO] Retrieved version of TrustyAI: v1.37.0 v0.28.0 v1.37.0 v0.4.8 0.9.4 v0.2.0 v0.2.1 v0.3.0 [2026-07-02T17:53:05.567Z] [INFO] Verify versions in About dialog's table for component: Workbenches [2026-07-02T17:53:06.339Z] [INFO] [EXEC] oc get Workbenches -A -o jsonpath='{.items[*].status.releases[*].version}' [2026-07-02T17:53:06.473Z] [INFO] Command exit code: 0 [2026-07-02T17:53:06.559Z] [INFO] Retrieved version of Workbenches: 1.10.0 [2026-07-02T17:53:06.628Z] [INFO] Verify versions in About dialog's table for component: Trainer [2026-07-02T17:53:07.450Z] [INFO] [EXEC] oc get Trainer -A -o jsonpath='{.items[*].status.releases[*].version}' [2026-07-02T17:53:07.492Z] [INFO] Command exit code: 0 [2026-07-02T17:53:07.577Z] [INFO] Retrieved version of Trainer: 2.1.0 [2026-07-02T17:53:07.585Z] [INFO] Verify versions in About dialog's table for component: MLflow [2026-07-02T17:53:08.347Z] [INFO] [EXEC] oc get MLflow -A -o jsonpath='{.items[*].status.releases[*].version}' [2026-07-02T17:53:08.355Z] [INFO] Command exit code: 0 [2026-07-02T17:53:08.366Z] [INFO] Retrieved version of MLflow: ✓ Verify RHODS About Dialog contains correct information (17049ms) 1 passing (17s) [mochawesome] Report JSON saved to /workspace/tests-shared/tests-payload/results/SmokeSet1/e2e/.jsons/mochawesome.json (Results) ┌────────────────────────────────────────────────────────────────────────────────────────────────┐ │ Tests: 1 │ │ Passing: 1 │ │ Failing: 0 │ │ Pending: 0 │ │ Skipped: 0 │ │ Screenshots: 0 │ │ Video: false │ │ Duration: 17 seconds │ │ Spec Ran: applications/testAboutDialog.cy.ts │ └────────────────────────────────────────────────────────────────────────────────────────────────┘ ──────────────────────────────────────────────────────────────────────────────────────────────────── Running: dashboardNavigation/testApplicationLinks.cy.ts (2 of 18) [2026-07-02T17:53:13.275Z] [INFO] Setting tests timeout to: 480 seconds Verify the RHOAI Application and Switcher links in the Dashboard Navigation [2026-07-02T17:53:13.361Z] [INFO] Starting 480s timeout for: Verify the various application tabs and switcher links are operational [2026-07-02T17:53:13.368Z] [INFO] Test title: Verify the various application tabs and switcher links are operational [2026-07-02T17:53:13.378Z] [INFO] Test tags: ["@Smoke","@SmokeSet1","@ODS-771","@Dashboard","@NonConcurrent"] [2026-07-02T17:53:13.434Z] [INFO] Skip tags: ["@Bug","@Maintain","@Featureflagged","@FeatureStore","@FeatureStoreCI","@ConnectionTypesCI","@SettingsCI","@MaaSCI","@MaasSubscriptions","@ODS-327","@ODS-492","@ModelServingCI","@KServeCI","@ModelServing","@LLMDServingCI","@ProjectsCI","@PipelinesCI","@Pipelines","@ci-dashboard-regression-tags","@ModelRegistryCI","@AutoMLCI","@Tier1","@HardwareProfilesCI","@HardwareProfileModelServing","@ODS-327","@ODS-492"] [2026-07-02T17:53:13.453Z] [INFO] Grep tags: ["@SmokeSet1"] [2026-07-02T17:53:13.468Z] [INFO] [STEP 1] Log into the application [2026-07-02T17:53:13.481Z] [INFO] Navigate to: https://rh-ai.apps.ods-qe-psi-23.osp.rh-ods.com/ [2026-07-02T17:53:13.536Z] [INFO] BYOIDC cluster detected - using Keycloak authentication [2026-07-02T17:53:14.428Z] [INFO] Keycloak login flow detected - completing authentication [2026-07-02T17:53:16.879Z] [INFO] [STEP 2] Click the Application Launcher [2026-07-02T17:53:17.857Z] [INFO] [STEP 3] Extract the Application and Switcher URLs [2026-07-02T17:53:18.236Z] [INFO] Extracted URLs: /, https://console-openshift-console.apps.ods-qe-psi-23.osp.rh-ods.com:, https://cloud.redhat.com/openshift/details/08d34ac2-63f6-4e09-b558-f16eb18d64cf, /, /projects, /ai-hub/models, /maas/tokens, /develop-train/feature-store/overview, /develop-train/feature-store/entities, /develop-train/feature-store/data-sources, /develop-train/feature-store/datasets, /develop-train/feature-store/features, /develop-train/feature-store/feature-views, /develop-train/feature-store/feature-services, /develop-train/pipelines/definitions, /develop-train/pipelines/runs, /develop-train/pipelines/artifacts, /develop-train/pipelines/executions, /develop-train/mlflow/experiments, /develop-train/training-jobs, /develop-train/automl, /observe-monitor/workload-metrics, /learning-resources, /applications/enabled, /applications/explore [2026-07-02T17:53:18.347Z] [INFO] Verify that each URL is accessible and that a 200 is returned [2026-07-02T17:53:18.649Z] [INFO] ✅ / - Status: 200 [2026-07-02T17:53:19.234Z] [INFO] ✅ https://console-openshift-console.apps.ods-qe-psi-23.osp.rh-ods.com: - Status: 200 [2026-07-02T17:53:19.965Z] [INFO] ✅ https://cloud.redhat.com/openshift/details/08d34ac2-63f6-4e09-b558-f16eb18d64cf - Status: 200 [2026-07-02T17:53:20.143Z] [INFO] ✅ / - Status: 200 [2026-07-02T17:53:20.267Z] [INFO] ✅ /projects - Status: 200 [2026-07-02T17:53:20.367Z] [INFO] ✅ /ai-hub/models - Status: 200 [2026-07-02T17:53:20.464Z] [INFO] ✅ /maas/tokens - Status: 200 [2026-07-02T17:53:20.779Z] [INFO] ✅ /develop-train/feature-store/overview - Status: 200 [2026-07-02T17:53:20.947Z] [INFO] ✅ /develop-train/feature-store/entities - Status: 200 [2026-07-02T17:53:21.079Z] [INFO] ✅ /develop-train/feature-store/data-sources - Status: 200 [2026-07-02T17:53:21.270Z] [INFO] ✅ /develop-train/feature-store/datasets - Status: 200 [2026-07-02T17:53:21.439Z] [INFO] ✅ /develop-train/feature-store/features - Status: 200 [2026-07-02T17:53:21.538Z] [INFO] ✅ /develop-train/feature-store/feature-views - Status: 200 [2026-07-02T17:53:21.673Z] [INFO] ✅ /develop-train/feature-store/feature-services - Status: 200 [2026-07-02T17:53:21.857Z] [INFO] ✅ /develop-train/pipelines/definitions - Status: 200 [2026-07-02T17:53:21.968Z] [INFO] ✅ /develop-train/pipelines/runs - Status: 200 [2026-07-02T17:53:22.153Z] [INFO] ✅ /develop-train/pipelines/artifacts - Status: 200 [2026-07-02T17:53:22.369Z] [INFO] ✅ /develop-train/pipelines/executions - Status: 200 [2026-07-02T17:53:22.566Z] [INFO] ✅ /develop-train/mlflow/experiments - Status: 200 [2026-07-02T17:53:22.769Z] [INFO] ✅ /develop-train/training-jobs - Status: 200 [2026-07-02T17:53:22.834Z] [INFO] ✅ /develop-train/automl - Status: 200 [2026-07-02T17:53:22.865Z] [INFO] ✅ /observe-monitor/workload-metrics - Status: 200 [2026-07-02T17:53:22.937Z] [INFO] ✅ /learning-resources - Status: 200 [2026-07-02T17:53:22.975Z] [INFO] ✅ /applications/enabled - Status: 200 [2026-07-02T17:53:23.039Z] [INFO] ✅ /applications/explore - Status: 200 ✓ Verify the various application tabs and switcher links are operational (9916ms) 1 passing (10s) [mochawesome] Report JSON saved to /workspace/tests-shared/tests-payload/results/SmokeSet1/e2e/.jsons/mochawesome_001.json (Results) ┌────────────────────────────────────────────────────────────────────────────────────────────────┐ │ Tests: 1 │ │ Passing: 1 │ │ Failing: 0 │ │ Pending: 0 │ │ Skipped: 0 │ │ Screenshots: 0 │ │ Video: false │ │ Duration: 10 seconds │ │ Spec Ran: dashboardNavigation/testApplicationLinks.cy.ts │ └────────────────────────────────────────────────────────────────────────────────────────────────┘ ──────────────────────────────────────────────────────────────────────────────────────────────────── Running: dashboardNavigation/testManifestLinks.cy.ts (3 of 18) [2026-07-02T17:53:30.151Z] [INFO] Setting tests timeout to: 480 seconds Verify that all the URLs referenced in the Manifest directory are operational - Validates URL format and checks for common mistakes in manifest files (fast, stable) - Checks URL reachability with tolerance for transient errors (429, 502, 503, 504) [2026-07-02T17:53:30.260Z] [INFO] No tests were executed. Skipping soft assertions. 0 passing (577ms) 2 pending [mochawesome] Report JSON saved to /workspace/tests-shared/tests-payload/results/SmokeSet1/e2e/.jsons/mochawesome_002.json (Results) ┌────────────────────────────────────────────────────────────────────────────────────────────────┐ │ Tests: 2 │ │ Passing: 0 │ │ Failing: 0 │ │ Pending: 2 │ │ Skipped: 0 │ │ Screenshots: 0 │ │ Video: false │ │ Duration: 0 seconds │ │ Spec Ran: dashboardNavigation/testManifestLinks.cy.ts │ └────────────────────────────────────────────────────────────────────────────────────────────────┘ ──────────────────────────────────────────────────────────────────────────────────────────────────── Running: dataScienceProjects/testProjectAdminPermissions.cy.ts (4 of 18) [2026-07-02T17:53:39.158Z] [INFO] Setting tests timeout to: 480 seconds Verify that users can provide admin project permissions to non-admin users/groups [2026-07-02T17:53:39.241Z] [INFO] Starting 480s timeout for: Verify that user can be added as an Admin for a Project [2026-07-02T17:53:39.246Z] [INFO] Test title: Verify that user can be added as an Admin for a Project [2026-07-02T17:53:39.257Z] [INFO] Test tags: ["@Smoke","@SmokeSet1","@ODS-2194","@ODS-2201","@ODS-2208","@Dashboard"] [2026-07-02T17:53:39.329Z] [INFO] Skip tags: ["@Bug","@Maintain","@Featureflagged","@FeatureStore","@FeatureStoreCI","@ConnectionTypesCI","@SettingsCI","@MaaSCI","@MaasSubscriptions","@ODS-327","@ODS-492","@ModelServingCI","@KServeCI","@ModelServing","@LLMDServingCI","@ProjectsCI","@PipelinesCI","@Pipelines","@ci-dashboard-regression-tags","@ModelRegistryCI","@AutoMLCI","@Tier1","@HardwareProfilesCI","@HardwareProfileModelServing","@ODS-327","@ODS-492"] [2026-07-02T17:53:39.347Z] [INFO] Grep tags: ["@SmokeSet1"] [2026-07-02T17:53:39.443Z] [INFO] Loaded project name: cypress-user-perm-test-526006 [2026-07-02T17:53:39.455Z] [INFO] Executing command: oc get project "cypress-user-perm-test-526006" -o name [2026-07-02T17:53:40.636Z] [INFO] [EXEC] oc get project "cypress-user-perm-test-526006" -o name [2026-07-02T17:53:40.737Z] [INFO] Command result: {"stdout":"","stderr":"Error from server (NotFound): namespaces \"cypress-user-perm-test-526006\" not found","exitCode":1} [2026-07-02T17:53:40.748Z] [INFO] Project 'cypress-user-perm-test-526006' does not exist. [2026-07-02T17:53:40.851Z] [INFO] Creating project cypress-user-perm-test-526006 [2026-07-02T17:53:41.650Z] [INFO] [EXEC] oc new-project cypress-user-perm-test-526006 [2026-07-02T17:53:42.566Z] [INFO] [EXEC] oc label namespace cypress-user-perm-test-526006 opendatahub.io/dashboard=true --overwrite [2026-07-02T17:53:42.638Z] [INFO] Executing command: oc get project "cypress-user-perm-test-526006" -o name [2026-07-02T17:53:43.567Z] [INFO] [EXEC] oc get project "cypress-user-perm-test-526006" -o name [2026-07-02T17:53:43.645Z] [INFO] Command result: {"stdout":"project.project.openshift.io/cypress-user-perm-test-526006","stderr":"","exitCode":0} [2026-07-02T17:53:43.733Z] [INFO] Project 'cypress-user-perm-test-526006' exists. [2026-07-02T17:53:43.748Z] [INFO] Project cypress-user-perm-test-526006 confirmed to be created and verified successfully [2026-07-02T17:53:43.765Z] [INFO] [STEP 1] Log into the application [2026-07-02T17:53:43.835Z] [INFO] Navigate to: https://rh-ai.apps.ods-qe-psi-23.osp.rh-ods.com/ [2026-07-02T17:53:43.842Z] [INFO] BYOIDC cluster detected - using Keycloak authentication [2026-07-02T17:53:44.837Z] [INFO] Keycloak login flow detected - completing authentication [2026-07-02T17:53:50.032Z] [INFO] [STEP 2] Navigate to the Project list tab and search for cypress-user-perm-test-526006 [2026-07-02T17:53:57.235Z] [INFO] [STEP 3] Assign admin user Project Permissions [2026-07-02T17:54:07.253Z] [INFO] [STEP 4] Save the user and validate that odh-user1 has been saved with admin permissions ✓ Verify that user can be added as an Admin for a Project (28589ms) [2026-07-02T17:54:08.440Z] [INFO] Starting 480s timeout for: Verify user can assign access permissions to user group [2026-07-02T17:54:08.444Z] [INFO] Test title: Verify user can assign access permissions to user group [2026-07-02T17:54:08.453Z] [INFO] Test tags: ["@Smoke","@SmokeSet1","@ODS-2194","@ODS-2201","@ODS-2208","@Dashboard","@NonConcurrent"] [2026-07-02T17:54:08.462Z] [INFO] Skip tags: ["@Bug","@Maintain","@Featureflagged","@FeatureStore","@FeatureStoreCI","@ConnectionTypesCI","@SettingsCI","@MaaSCI","@MaasSubscriptions","@ODS-327","@ODS-492","@ModelServingCI","@KServeCI","@ModelServing","@LLMDServingCI","@ProjectsCI","@PipelinesCI","@Pipelines","@ci-dashboard-regression-tags","@ModelRegistryCI","@AutoMLCI","@Tier1","@HardwareProfilesCI","@HardwareProfileModelServing","@ODS-327","@ODS-492"] [2026-07-02T17:54:08.535Z] [INFO] Grep tags: ["@SmokeSet1"] - Verify user can assign access permissions to user group [2026-07-02T17:54:08.648Z] [INFO] Starting 480s timeout for: Verify that user can access the created project with Admin rights [2026-07-02T17:54:08.651Z] [INFO] Test title: Verify that user can access the created project with Admin rights [2026-07-02T17:54:08.657Z] [INFO] Test tags: ["@Smoke","@SmokeSet1","@ODS-2194","@ODS-2201","@ODS-2208","@Dashboard","@NonConcurrent"] [2026-07-02T17:54:08.729Z] [INFO] Skip tags: ["@Bug","@Maintain","@Featureflagged","@FeatureStore","@FeatureStoreCI","@ConnectionTypesCI","@SettingsCI","@MaaSCI","@MaasSubscriptions","@ODS-327","@ODS-492","@ModelServingCI","@KServeCI","@ModelServing","@LLMDServingCI","@ProjectsCI","@PipelinesCI","@Pipelines","@ci-dashboard-regression-tags","@ModelRegistryCI","@AutoMLCI","@Tier1","@HardwareProfilesCI","@HardwareProfileModelServing","@ODS-327","@ODS-492"] [2026-07-02T17:54:08.736Z] [INFO] Grep tags: ["@SmokeSet1"] [2026-07-02T17:54:08.750Z] [INFO] [STEP 1] Log into the application as non-admin [2026-07-02T17:54:08.830Z] [INFO] Navigate to: https://rh-ai.apps.ods-qe-psi-23.osp.rh-ods.com/ [2026-07-02T17:54:08.836Z] [INFO] BYOIDC cluster detected - using Keycloak authentication [2026-07-02T17:54:09.532Z] [INFO] Keycloak login flow detected - completing authentication [2026-07-02T17:54:11.834Z] [INFO] [STEP 2] Verify that the user has access to the created project and can access Permissions [2026-07-02T17:54:20.225Z] [INFO] Deleting Project cypress-user-perm-test-526006 after the test has finished. [2026-07-02T17:54:21.831Z] [INFO] [EXEC] oc delete project cypress-user-perm-test-526006 --wait=false --ignore-not-found ✓ Verify that user can access the created project with Admin rights (10470ms) 2 passing (43s) 1 pending [mochawesome] Report JSON saved to /workspace/tests-shared/tests-payload/results/SmokeSet1/e2e/.jsons/mochawesome_003.json (Results) ┌────────────────────────────────────────────────────────────────────────────────────────────────┐ │ Tests: 3 │ │ Passing: 2 │ │ Failing: 0 │ │ Pending: 1 │ │ Skipped: 0 │ │ Screenshots: 0 │ │ Video: false │ │ Duration: 43 seconds │ │ Spec Ran: dataScienceProjects/testProjectAdminPermissions.cy.ts │ └────────────────────────────────────────────────────────────────────────────────────────────────┘ ──────────────────────────────────────────────────────────────────────────────────────────────────── Running: featureStore/testFeatureStoreRbac.cy.ts (5 of 18) [2026-07-02T17:54:33.331Z] [INFO] Setting tests timeout to: 480 seconds Verify RBAC scoped Feature Store discovery by namespace access - Admin user can discover the Feature Store project - Non-admin user without namespace access cannot discover the Feature Store project [2026-07-02T17:54:33.541Z] [INFO] No tests were executed. Skipping soft assertions. 0 passing (705ms) 2 pending [mochawesome] Report JSON saved to /workspace/tests-shared/tests-payload/results/SmokeSet1/e2e/.jsons/mochawesome_004.json (Results) ┌────────────────────────────────────────────────────────────────────────────────────────────────┐ │ Tests: 2 │ │ Passing: 0 │ │ Failing: 0 │ │ Pending: 2 │ │ Skipped: 0 │ │ Screenshots: 0 │ │ Video: false │ │ Duration: 0 seconds │ │ Spec Ran: featureStore/testFeatureStoreRbac.cy.ts │ └────────────────────────────────────────────────────────────────────────────────────────────────┘ ──────────────────────────────────────────────────────────────────────────────────────────────────── Running: learningResources/testCustomResourceCreation.cy.ts (6 of 18) [2026-07-02T17:54:43.229Z] [INFO] Setting tests timeout to: 480 seconds Create a custom resource Quickstart by using Dashboard CRDs [2026-07-02T17:54:43.345Z] [INFO] Starting 480s timeout for: Upload custom resource and verify [2026-07-02T17:54:43.430Z] [INFO] Test title: Upload custom resource and verify [2026-07-02T17:54:43.540Z] [INFO] Test tags: ["@Smoke","@SmokeSet1","@ODS-697","@Dashboard","@NonConcurrent"] [2026-07-02T17:54:43.635Z] [INFO] Skip tags: ["@Bug","@Maintain","@Featureflagged","@FeatureStore","@FeatureStoreCI","@ConnectionTypesCI","@SettingsCI","@MaaSCI","@MaasSubscriptions","@ODS-327","@ODS-492","@ModelServingCI","@KServeCI","@ModelServing","@LLMDServingCI","@ProjectsCI","@PipelinesCI","@Pipelines","@ci-dashboard-regression-tags","@ModelRegistryCI","@AutoMLCI","@Tier1","@HardwareProfilesCI","@HardwareProfileModelServing","@ODS-327","@ODS-492"] [2026-07-02T17:54:43.738Z] [INFO] Grep tags: ["@SmokeSet1"] [2026-07-02T17:54:43.932Z] [INFO] Loaded resources data: { "resources": { "CustomQuickStart": [ { "kind": "OdhQuickStart", "labelSelector": "app=custom-odsci-app", "createdName": "TEST - Custom Quick Start", "metaDataName": "custom-quick-start-test", "description": "This quick start is a TEST!!!", "yamlPath": "import/custom_quickstart.yaml" } ], "CustomApplication": [ { "kind": "OdhApplication", "labelSelector": "app=custom-odsci-app", "createdName": "TEST - Custom ODS-CI Application", "metaDataName": "custom-odsci-app-doc", "description": "Custom Application is a test item created by ODS-CI to test creation of custom d", "yamlPath": "import/custom_app.yaml" } ], "CustomHowTo": [ { "namespace": "opendatahub", "kind": "OdhDocument", "labelSelector": "app=custom-odsci-app", "createdName": "TEST - Custom How-To Documentation", "metaDataName": "custom-doc-howto-test", "description": "Custom How-To is a test item created by ODS-CI suite in order to test creation o", "yamlPath": "import/custom_doc_howto.yaml" } ], "CustomTutorial": [ { "kind": "OdhDocument", "labelSelector": "app=custom-odsci-app", "createdName": "TEST - Custom Tutorial Documentation", "metaDataName": "custom-doc-tutorial-test", "description": "Custom Tutorial is a test item created by ODS-CI suite in order to test creation", "yamlPath": "import/custom_doc_tutorial.yaml" } ] } } [2026-07-02T17:54:43.942Z] [INFO] YAML path for CustomQuickStart: import/custom_quickstart.yaml [2026-07-02T17:54:44.045Z] [INFO] Executing command: oc apply -f "/tmp/temp_1783014883956.yaml" -n redhat-ods-applications [2026-07-02T17:54:45.048Z] [INFO] [EXEC] oc apply -f "/tmp/temp_1783014883956.yaml" -n redhat-ods-applications [2026-07-02T17:54:45.069Z] [INFO] Command executed successfully: odhquickstart.console.openshift.io/custom-quick-start-test created [2026-07-02T17:54:45.528Z] [INFO] [EXEC] rm /tmp/temp_1783014883956.yaml [2026-07-02T17:54:45.569Z] [INFO] Executing command: oc apply -f "/tmp/temp_1783014885538.yaml" -n redhat-ods-applications [2026-07-02T17:54:46.458Z] [INFO] [EXEC] oc apply -f "/tmp/temp_1783014885538.yaml" -n redhat-ods-applications [2026-07-02T17:54:46.539Z] [INFO] Command executed successfully: odhapplication.dashboard.opendatahub.io/custom-odsci-app created [2026-07-02T17:54:46.855Z] [INFO] [EXEC] rm /tmp/temp_1783014885538.yaml [2026-07-02T17:54:47.027Z] [INFO] Executing command: oc apply -f "/tmp/temp_1783014886936.yaml" -n redhat-ods-applications [2026-07-02T17:54:47.766Z] [INFO] [EXEC] oc apply -f "/tmp/temp_1783014886936.yaml" -n redhat-ods-applications [2026-07-02T17:54:47.849Z] [INFO] Command executed successfully: odhdocument.dashboard.opendatahub.io/custom-doc-howto-test created [2026-07-02T17:54:48.155Z] [INFO] [EXEC] rm /tmp/temp_1783014886936.yaml [2026-07-02T17:54:48.250Z] [INFO] Executing command: oc apply -f "/tmp/temp_1783014888164.yaml" -n redhat-ods-applications [2026-07-02T17:54:49.057Z] [INFO] [EXEC] oc apply -f "/tmp/temp_1783014888164.yaml" -n redhat-ods-applications [2026-07-02T17:54:49.129Z] [INFO] Command executed successfully: odhdocument.dashboard.opendatahub.io/custom-doc-tutorial-test created [2026-07-02T17:54:49.563Z] [INFO] [EXEC] rm /tmp/temp_1783014888164.yaml [2026-07-02T17:54:49.651Z] [INFO] All resources have been set up successfully. [2026-07-02T17:54:49.740Z] [INFO] [STEP 1] Log into the application [2026-07-02T17:54:49.835Z] [INFO] Navigate to: https://rh-ai.apps.ods-qe-psi-23.osp.rh-ods.com/ [2026-07-02T17:54:49.844Z] [INFO] BYOIDC cluster detected - using Keycloak authentication [2026-07-02T17:54:51.037Z] [INFO] Keycloak login flow detected - completing authentication [2026-07-02T17:54:54.542Z] [INFO] [STEP 2] Navigate to Resources tab and search for the Custom Resources [2026-07-02T17:54:54.650Z] [INFO] Navigate to: https://rh-ai.apps.ods-qe-psi-23.osp.rh-ods.com/learning-resources [2026-07-02T17:54:54.673Z] [INFO] BYOIDC cluster detected - using Keycloak authentication [2026-07-02T17:54:58.032Z] [INFO] [STEP 3] Check for newly created resources [2026-07-02T17:54:58.546Z] [INFO] Starting resource check for 4 resources. [2026-07-02T17:54:58.780Z] [INFO] Checking for resource: TEST - Custom Quick Start [2026-07-02T17:54:59.987Z] [INFO] Waiting for card with id: custom-quick-start-test [2026-07-02T17:56:26.730Z] [INFO] ✅ Resource found: TEST - Custom Quick Start [2026-07-02T17:56:26.776Z] [INFO] Checking for resource: TEST - Custom ODS-CI Application [2026-07-02T17:56:27.293Z] [INFO] Waiting for card with id: custom-odsci-app-doc [2026-07-02T17:56:27.579Z] [INFO] ✅ Resource found: TEST - Custom ODS-CI Application [2026-07-02T17:56:27.652Z] [INFO] Checking for resource: TEST - Custom How-To Documentation [2026-07-02T17:56:28.677Z] [INFO] Waiting for card with id: custom-doc-howto-test [2026-07-02T17:56:29.070Z] [INFO] ✅ Resource found: TEST - Custom How-To Documentation [2026-07-02T17:56:29.144Z] [INFO] Checking for resource: TEST - Custom Tutorial Documentation [2026-07-02T17:56:29.711Z] [INFO] Waiting for card with id: custom-doc-tutorial-test [2026-07-02T17:56:29.963Z] [INFO] ✅ Resource found: TEST - Custom Tutorial Documentation [2026-07-02T17:56:30.247Z] [INFO] Executing command: oc delete OdhQuickStart -n redhat-ods-applications -l app=custom-odsci-app [2026-07-02T17:56:30.825Z] [INFO] [EXEC] oc delete OdhQuickStart -n redhat-ods-applications -l app=custom-odsci-app [2026-07-02T17:56:31.027Z] [INFO] Command execution result: {"stdout":"odhquickstart.console.openshift.io \"custom-quick-start-test\" deleted","stderr":"","exitCode":0} [2026-07-02T17:56:31.035Z] [INFO] Custom resource deleted successfully. [2026-07-02T17:56:31.127Z] [INFO] Executing command: oc delete OdhApplication -n redhat-ods-applications -l app=custom-odsci-app [2026-07-02T17:56:31.658Z] [INFO] [EXEC] oc delete OdhApplication -n redhat-ods-applications -l app=custom-odsci-app [2026-07-02T17:56:31.740Z] [INFO] Command execution result: {"stdout":"odhapplication.dashboard.opendatahub.io \"custom-odsci-app\" deleted","stderr":"","exitCode":0} [2026-07-02T17:56:31.793Z] [INFO] Custom resource deleted successfully. [2026-07-02T17:56:31.862Z] [INFO] Executing command: oc delete OdhDocument -n redhat-ods-applications -l app=custom-odsci-app [2026-07-02T17:56:32.443Z] [INFO] [EXEC] oc delete OdhDocument -n redhat-ods-applications -l app=custom-odsci-app [2026-07-02T17:56:32.525Z] [INFO] Command execution result: {"stdout":"odhdocument.dashboard.opendatahub.io \"custom-doc-howto-test\" deleted\nodhdocument.dashboard.opendatahub.io \"custom-doc-tutorial-test\" deleted","stderr":"","exitCode":0} [2026-07-02T17:56:32.582Z] [INFO] Custom resource deleted successfully. [2026-07-02T17:56:32.587Z] [INFO] Executing command: oc delete OdhDocument -n redhat-ods-applications -l app=custom-odsci-app [2026-07-02T17:56:33.141Z] [INFO] [EXEC] oc delete OdhDocument -n redhat-ods-applications -l app=custom-odsci-app [2026-07-02T17:56:33.241Z] [INFO] Command execution result: {"stdout":"No resources found","stderr":"","exitCode":0} [2026-07-02T17:56:33.340Z] [INFO] Custom resource deleted successfully. [2026-07-02T17:56:33.429Z] [INFO] All resources have been cleaned up successfully. ✓ Upload custom resource and verify (107109ms) 1 passing (2m) [mochawesome] Report JSON saved to /workspace/tests-shared/tests-payload/results/SmokeSet1/e2e/.jsons/mochawesome_005.json (Results) ┌────────────────────────────────────────────────────────────────────────────────────────────────┐ │ Tests: 1 │ │ Passing: 1 │ │ Failing: 0 │ │ Pending: 0 │ │ Skipped: 0 │ │ Screenshots: 0 │ │ Video: false │ │ Duration: 1 minute, 50 seconds │ │ Spec Ran: learningResources/testCustomResourceCreation.cy.ts │ └────────────────────────────────────────────────────────────────────────────────────────────────┘ ──────────────────────────────────────────────────────────────────────────────────────────────────── Running: modelCatalog/testCatalogSettingsAvailable.cy.ts (7 of 18) [2026-07-02T17:56:37.464Z] [INFO] Setting tests timeout to: 480 seconds Verify Model Catalog Settings Access Control [2026-07-02T17:56:37.475Z] [INFO] Starting 480s timeout for: Admin user can access Model catalog settings [2026-07-02T17:56:37.478Z] [INFO] Test title: Admin user can access Model catalog settings [2026-07-02T17:56:37.533Z] [INFO] Test tags: ["@Smoke","@SmokeSet1","@Dashboard","@ModelCatalog"] [2026-07-02T17:56:37.540Z] [INFO] Skip tags: ["@Bug","@Maintain","@Featureflagged","@FeatureStore","@FeatureStoreCI","@ConnectionTypesCI","@SettingsCI","@MaaSCI","@MaasSubscriptions","@ODS-327","@ODS-492","@ModelServingCI","@KServeCI","@ModelServing","@LLMDServingCI","@ProjectsCI","@PipelinesCI","@Pipelines","@ci-dashboard-regression-tags","@ModelRegistryCI","@AutoMLCI","@Tier1","@HardwareProfilesCI","@HardwareProfileModelServing","@ODS-327","@ODS-492"] [2026-07-02T17:56:37.548Z] [INFO] Grep tags: ["@SmokeSet1"] [2026-07-02T17:56:37.561Z] [INFO] [STEP 1] Log into the application as admin with aiCatalogSettings flag enabled [2026-07-02T17:56:37.569Z] [INFO] Navigate to: https://rh-ai.apps.ods-qe-psi-23.osp.rh-ods.com/ [2026-07-02T17:56:37.573Z] [INFO] BYOIDC cluster detected - using Keycloak authentication [2026-07-02T17:56:38.256Z] [INFO] Keycloak login flow detected - completing authentication [2026-07-02T17:56:40.447Z] [INFO] [STEP 2] Navigate to Model catalog settings [2026-07-02T17:56:43.665Z] [INFO] [STEP 3] Verify add source button is visible ✓ Admin user can access Model catalog settings (6355ms) [2026-07-02T17:56:43.902Z] [INFO] Starting 480s timeout for: Non-admin user cannot access Model catalog settings [2026-07-02T17:56:43.905Z] [INFO] Test title: Non-admin user cannot access Model catalog settings [2026-07-02T17:56:43.911Z] [INFO] Test tags: ["@Smoke","@SmokeSet1","@Dashboard","@ModelCatalog"] [2026-07-02T17:56:43.927Z] [INFO] Skip tags: ["@Bug","@Maintain","@Featureflagged","@FeatureStore","@FeatureStoreCI","@ConnectionTypesCI","@SettingsCI","@MaaSCI","@MaasSubscriptions","@ODS-327","@ODS-492","@ModelServingCI","@KServeCI","@ModelServing","@LLMDServingCI","@ProjectsCI","@PipelinesCI","@Pipelines","@ci-dashboard-regression-tags","@ModelRegistryCI","@AutoMLCI","@Tier1","@HardwareProfilesCI","@HardwareProfileModelServing","@ODS-327","@ODS-492"] [2026-07-02T17:56:43.932Z] [INFO] Grep tags: ["@SmokeSet1"] [2026-07-02T17:56:43.943Z] [INFO] [STEP 1] Log into the application as non-admin user [2026-07-02T17:56:43.951Z] [INFO] Navigate to: https://rh-ai.apps.ods-qe-psi-23.osp.rh-ods.com/ [2026-07-02T17:56:43.955Z] [INFO] BYOIDC cluster detected - using Keycloak authentication [2026-07-02T17:56:44.464Z] [INFO] Keycloak login flow detected - completing authentication [2026-07-02T17:56:45.935Z] [INFO] [STEP 2] Verify Model catalog settings nav item is not visible for non-admin [2026-07-02T17:56:46.362Z] [INFO] [STEP 3] Attempt to navigate to Model catalog settings directly [2026-07-02T17:56:47.169Z] [INFO] [STEP 4] Verify page not found is displayed ✓ Non-admin user cannot access Model catalog settings 2 passing (11s) [mochawesome] Report JSON saved to /workspace/tests-shared/tests-payload/results/SmokeSet1/e2e/.jsons/mochawesome_006.json (Results) ┌────────────────────────────────────────────────────────────────────────────────────────────────┐ │ Tests: 2 │ │ Passing: 2 │ │ Failing: 0 │ │ Pending: 0 │ │ Skipped: 0 │ │ Screenshots: 0 │ │ Video: false │ │ Duration: 10 seconds │ │ Spec Ran: modelCatalog/testCatalogSettingsAvailable.cy.ts │ └────────────────────────────────────────────────────────────────────────────────────────────────┘ ──────────────────────────────────────────────────────────────────────────────────────────────────── Running: modelCatalog/testModelCatalogAvailable.cy.ts (8 of 18) [2026-07-02T17:56:52.379Z] [INFO] Setting tests timeout to: 480 seconds Verifies that Model Catalog is available for different users [2026-07-02T17:56:52.430Z] [INFO] Starting 480s timeout for: Verifies that Model Catalog is available for an admin user [2026-07-02T17:56:52.434Z] [INFO] Test title: Verifies that Model Catalog is available for an admin user [2026-07-02T17:56:52.442Z] [INFO] Test tags: ["@Smoke","@SmokeSet1","@Dashboard","@ModelCatalog","@ModelCatalogCI"] [2026-07-02T17:56:52.452Z] [INFO] Skip tags: ["@Bug","@Maintain","@Featureflagged","@FeatureStore","@FeatureStoreCI","@ConnectionTypesCI","@SettingsCI","@MaaSCI","@MaasSubscriptions","@ODS-327","@ODS-492","@ModelServingCI","@KServeCI","@ModelServing","@LLMDServingCI","@ProjectsCI","@PipelinesCI","@Pipelines","@ci-dashboard-regression-tags","@ModelRegistryCI","@AutoMLCI","@Tier1","@HardwareProfilesCI","@HardwareProfileModelServing","@ODS-327","@ODS-492"] [2026-07-02T17:56:52.461Z] [INFO] Grep tags: ["@SmokeSet1"] [2026-07-02T17:56:52.534Z] [INFO] Verifies that Model Catalog pods, Services and ConfigMaps are available [2026-07-02T17:56:52.544Z] [INFO] Verifying Model Catalog backend resources [2026-07-02T17:56:52.552Z] [INFO] Model Registry namespace: rhoai-model-registries [2026-07-02T17:56:52.556Z] [INFO] Verifying model-catalog deployment: oc get deployment model-catalog -n rhoai-model-registries [2026-07-02T17:56:53.035Z] [INFO] [EXEC] oc get deployment model-catalog -n rhoai-model-registries [2026-07-02T17:56:53.055Z] [INFO] Command exit code: 0 [2026-07-02T17:56:53.064Z] [INFO] ✓ model-catalog deployment exists in rhoai-model-registries [2026-07-02T17:56:53.069Z] [INFO] Verifying default-catalog-sources ConfigMap: oc get configmap default-catalog-sources -n rhoai-model-registries [2026-07-02T17:56:53.543Z] [INFO] [EXEC] oc get configmap default-catalog-sources -n rhoai-model-registries [2026-07-02T17:56:53.551Z] [INFO] Command exit code: 0 [2026-07-02T17:56:53.561Z] [INFO] ✓ default-catalog-sources ConfigMap exists in rhoai-model-registries [2026-07-02T17:56:53.566Z] [INFO] Verifying model-catalog service: oc get service model-catalog -n rhoai-model-registries [2026-07-02T17:56:54.077Z] [INFO] [EXEC] oc get service model-catalog -n rhoai-model-registries [2026-07-02T17:56:54.084Z] [INFO] Command exit code: 0 [2026-07-02T17:56:54.091Z] [INFO] ✓ model-catalog service exists in rhoai-model-registries [2026-07-02T17:56:54.095Z] [INFO] Ensure at least one model catalog source is enabled [2026-07-02T17:56:54.127Z] [INFO] Ensuring model catalog source 'redhat_ai_models' is enabled [2026-07-02T17:56:54.632Z] [INFO] [EXEC] oc get configmap default-catalog-sources -n rhoai-model-registries -o jsonpath='{.data.sources\.yaml}' | if command -v yq >/dev/null 2>&1; then yq '.catalogs[] | select(.id == "redhat_ai_models") | .enabled' else python3 -c 'import sys, yaml, json; json.dump(yaml.safe_load(sys.stdin), sys.stdout)' 2>/dev/null | jq -r '.catalogs[] | select(.id == "redhat_ai_models") | .enabled // empty' fi [2026-07-02T17:56:54.650Z] [INFO] Command exit code: 0 [2026-07-02T17:56:54.656Z] [INFO] Source redhat_ai_models is currently enabled: true [2026-07-02T17:56:54.664Z] [INFO] ✓ Source redhat_ai_models is already enabled, no action needed [2026-07-02T17:56:54.676Z] [INFO] [STEP 1] Login as admin user [2026-07-02T17:56:54.686Z] [INFO] Navigate to: https://rh-ai.apps.ods-qe-psi-23.osp.rh-ods.com/ [2026-07-02T17:56:54.690Z] [INFO] BYOIDC cluster detected - using Keycloak authentication [2026-07-02T17:56:55.478Z] [INFO] Keycloak login flow detected - completing authentication [2026-07-02T17:56:57.872Z] [INFO] [STEP 2] Navigate to Model Catalog [2026-07-02T17:56:57.953Z] [INFO] Navigate to: https://rh-ai.apps.ods-qe-psi-23.osp.rh-ods.com/ai-hub/models/catalog [2026-07-02T17:56:57.975Z] [INFO] BYOIDC cluster detected - using Keycloak authentication [2026-07-02T17:57:02.169Z] [INFO] [STEP 3] Wait for model catalog cards to appear [2026-07-02T17:57:02.255Z] [INFO] [STEP 4] Polling for model catalog cards (max 10 attempts) [2026-07-02T17:57:12.317Z] [INFO] Attempt 1/10: cards=12, emptyState=false, elapsed=7.6s [2026-07-02T17:57:12.331Z] [INFO] ✅ Model catalog cards are now visible (found 12 cards) [2026-07-02T17:57:12.367Z] [INFO] [STEP 5] Check if Model Catalog content is displayed ✓ Verifies that Model Catalog is available for an admin user (20143ms) [2026-07-02T17:57:12.730Z] [INFO] Starting 480s timeout for: Verifies that Model Catalog is available for a regular user [2026-07-02T17:57:12.737Z] [INFO] Test title: Verifies that Model Catalog is available for a regular user [2026-07-02T17:57:12.744Z] [INFO] Test tags: ["@Smoke","@SmokeSet1","@Dashboard","@ModelCatalog","@ModelCatalogCI"] [2026-07-02T17:57:12.751Z] [INFO] Skip tags: ["@Bug","@Maintain","@Featureflagged","@FeatureStore","@FeatureStoreCI","@ConnectionTypesCI","@SettingsCI","@MaaSCI","@MaasSubscriptions","@ODS-327","@ODS-492","@ModelServingCI","@KServeCI","@ModelServing","@LLMDServingCI","@ProjectsCI","@PipelinesCI","@Pipelines","@ci-dashboard-regression-tags","@ModelRegistryCI","@AutoMLCI","@Tier1","@HardwareProfilesCI","@HardwareProfileModelServing","@ODS-327","@ODS-492"] [2026-07-02T17:57:12.757Z] [INFO] Grep tags: ["@SmokeSet1"] [2026-07-02T17:57:12.772Z] [INFO] [STEP 1] Login as LDAP user [2026-07-02T17:57:12.828Z] [INFO] Navigate to: https://rh-ai.apps.ods-qe-psi-23.osp.rh-ods.com/ [2026-07-02T17:57:12.834Z] [INFO] BYOIDC cluster detected - using Keycloak authentication [2026-07-02T17:57:13.489Z] [INFO] Keycloak login flow detected - completing authentication [2026-07-02T17:57:14.668Z] [INFO] [STEP 2] Navigate to Model Catalog [2026-07-02T17:57:14.830Z] [INFO] Navigate to: https://rh-ai.apps.ods-qe-psi-23.osp.rh-ods.com/ai-hub/models/catalog [2026-07-02T17:57:14.848Z] [INFO] BYOIDC cluster detected - using Keycloak authentication [2026-07-02T17:57:17.979Z] [INFO] [STEP 3] Wait for model catalog cards to appear [2026-07-02T17:57:18.088Z] [INFO] [STEP 4] Polling for model catalog cards (max 10 attempts) [2026-07-02T17:57:28.170Z] [INFO] Attempt 1/10: cards=12, emptyState=false, elapsed=5.4s [2026-07-02T17:57:28.175Z] [INFO] ✅ Model catalog cards are now visible (found 12 cards) [2026-07-02T17:57:28.196Z] [INFO] [STEP 5] Check if Model Catalog content is displayed ✓ Verifies that Model Catalog is available for a regular user (15697ms) 2 passing (36s) [mochawesome] Report JSON saved to /workspace/tests-shared/tests-payload/results/SmokeSet1/e2e/.jsons/mochawesome_007.json (Results) ┌────────────────────────────────────────────────────────────────────────────────────────────────┐ │ Tests: 2 │ │ Passing: 2 │ │ Failing: 0 │ │ Pending: 0 │ │ Skipped: 0 │ │ Screenshots: 0 │ │ Video: false │ │ Duration: 36 seconds │ │ Spec Ran: modelCatalog/testModelCatalogAvailable.cy.ts │ └────────────────────────────────────────────────────────────────────────────────────────────────┘ ──────────────────────────────────────────────────────────────────────────────────────────────────── Running: modelCatalog/testPerformanceFiltersAvailable.cy.ts (9 of 18) [2026-07-02T17:57:32.257Z] [INFO] Setting tests timeout to: 480 seconds Verify Performance Filters are available on RHOAI [2026-07-02T17:57:32.279Z] [INFO] Starting 480s timeout for: Performance view toggle enables filters and shows benchmark data on validated models [2026-07-02T17:57:32.327Z] [INFO] Test title: Performance view toggle enables filters and shows benchmark data on validated models [2026-07-02T17:57:32.351Z] [INFO] Test tags: ["@Smoke","@SmokeSet1","@Dashboard","@ModelCatalog"] [2026-07-02T17:57:32.360Z] [INFO] Skip tags: ["@Bug","@Maintain","@Featureflagged","@FeatureStore","@FeatureStoreCI","@ConnectionTypesCI","@SettingsCI","@MaaSCI","@MaasSubscriptions","@ODS-327","@ODS-492","@ModelServingCI","@KServeCI","@ModelServing","@LLMDServingCI","@ProjectsCI","@PipelinesCI","@Pipelines","@ci-dashboard-regression-tags","@ModelRegistryCI","@AutoMLCI","@Tier1","@HardwareProfilesCI","@HardwareProfileModelServing","@ODS-327","@ODS-492"] [2026-07-02T17:57:32.369Z] [INFO] Grep tags: ["@SmokeSet1"] [2026-07-02T17:57:32.388Z] [INFO] Check if the operator is RHOAI [2026-07-02T17:57:32.930Z] [INFO] [EXEC] oc get subscription -A -o json | jq -r '.items[] | select(.spec.name=="rhods-operator") | .spec.channel' [2026-07-02T17:57:32.949Z] [INFO] Command exit code: 0 [2026-07-02T17:57:32.960Z] [INFO] RHOAI confirmed (subscription channel="beta"). [2026-07-02T17:57:32.983Z] [INFO] Detect model-catalog namespace [2026-07-02T17:57:33.975Z] [INFO] [EXEC] oc get deployments --all-namespaces -o json | jq -r '.items[] | select(.metadata.name=="model-catalog") | .metadata.namespace' | head -n1 [2026-07-02T17:57:33.992Z] [INFO] Waiting for model-catalog deployment to have a ready pod in namespace rhoai-model-registries... [2026-07-02T17:57:34.585Z] [INFO] [EXEC] oc wait --for=jsonpath='{.status.readyReplicas}'=1 deployment/model-catalog -n rhoai-model-registries --timeout=120s [2026-07-02T17:57:34.593Z] [INFO] model-catalog deployment wait result: deployment.apps/model-catalog condition met [2026-07-02T17:57:34.607Z] [INFO] ✓ model-catalog deployment has a ready pod in namespace rhoai-model-registries [2026-07-02T17:57:34.657Z] [INFO] Ensuring model catalog source 'redhat_ai_models' is enabled [2026-07-02T17:57:35.134Z] [INFO] [EXEC] oc get configmap default-catalog-sources -n rhoai-model-registries -o jsonpath='{.data.sources\.yaml}' | if command -v yq >/dev/null 2>&1; then yq '.catalogs[] | select(.id == "redhat_ai_models") | .enabled' else python3 -c 'import sys, yaml, json; json.dump(yaml.safe_load(sys.stdin), sys.stdout)' 2>/dev/null | jq -r '.catalogs[] | select(.id == "redhat_ai_models") | .enabled // empty' fi [2026-07-02T17:57:35.162Z] [INFO] Command exit code: 0 [2026-07-02T17:57:35.187Z] [INFO] Source redhat_ai_models is currently enabled: true [2026-07-02T17:57:35.226Z] [INFO] ✓ Source redhat_ai_models is already enabled, no action needed [2026-07-02T17:57:35.247Z] [INFO] [STEP 1] Login as admin user [2026-07-02T17:57:35.259Z] [INFO] Navigate to: https://rh-ai.apps.ods-qe-psi-23.osp.rh-ods.com/ [2026-07-02T17:57:35.264Z] [INFO] BYOIDC cluster detected - using Keycloak authentication [2026-07-02T17:57:35.962Z] [INFO] Keycloak login flow detected - completing authentication [2026-07-02T17:57:38.181Z] [INFO] [STEP 2] Navigate to Model Catalog [2026-07-02T17:57:38.240Z] [INFO] Navigate to: https://rh-ai.apps.ods-qe-psi-23.osp.rh-ods.com/ai-hub/models/catalog [2026-07-02T17:57:38.266Z] [INFO] BYOIDC cluster detected - using Keycloak authentication [2026-07-02T17:57:41.773Z] [INFO] [STEP 3] Wait for model catalog cards to appear [2026-07-02T17:57:42.185Z] [INFO] [STEP 4] Polling for model catalog cards (max 10 attempts) [2026-07-02T17:57:52.329Z] [INFO] Attempt 1/10: cards=12, emptyState=false, elapsed=7.0s [2026-07-02T17:57:52.336Z] [INFO] ✅ Model catalog cards are now visible (found 12 cards) [2026-07-02T17:57:52.343Z] [INFO] [STEP 5] Verify toggle exists and is OFF by default [2026-07-02T17:57:52.438Z] [INFO] [STEP 6] Turn ON performance view toggle [2026-07-02T17:57:52.660Z] [INFO] [STEP 7] Verify performance toolbar filters appear [2026-07-02T17:58:03.826Z] [INFO] Starting 480s timeout for: Performance view toggle enables filters and shows benchmark data on validated models [2026-07-02T17:58:03.832Z] [INFO] Test title: Performance view toggle enables filters and shows benchmark data on validated models [2026-07-02T17:58:03.838Z] [INFO] Test tags: ["@Smoke","@SmokeSet1","@Dashboard","@ModelCatalog"] [2026-07-02T17:58:03.846Z] [INFO] Skip tags: ["@Bug","@Maintain","@Featureflagged","@FeatureStore","@FeatureStoreCI","@ConnectionTypesCI","@SettingsCI","@MaaSCI","@MaasSubscriptions","@ODS-327","@ODS-492","@ModelServingCI","@KServeCI","@ModelServing","@LLMDServingCI","@ProjectsCI","@PipelinesCI","@Pipelines","@ci-dashboard-regression-tags","@ModelRegistryCI","@AutoMLCI","@Tier1","@HardwareProfilesCI","@HardwareProfileModelServing","@ODS-327","@ODS-492"] [2026-07-02T17:58:03.852Z] [INFO] Grep tags: ["@SmokeSet1"] [2026-07-02T17:58:03.869Z] [INFO] Check if the operator is RHOAI [2026-07-02T17:58:04.677Z] [INFO] [EXEC] oc get subscription -A -o json | jq -r '.items[] | select(.spec.name=="rhods-operator") | .spec.channel' [2026-07-02T17:58:04.729Z] [INFO] Command exit code: 0 [2026-07-02T17:58:04.740Z] [INFO] RHOAI confirmed (subscription channel="beta"). [2026-07-02T17:58:04.755Z] [INFO] Detect model-catalog namespace [2026-07-02T17:58:05.616Z] [INFO] [EXEC] oc get deployments --all-namespaces -o json | jq -r '.items[] | select(.metadata.name=="model-catalog") | .metadata.namespace' | head -n1 [2026-07-02T17:58:05.628Z] [INFO] Waiting for model-catalog deployment to have a ready pod in namespace rhoai-model-registries... [2026-07-02T17:58:06.083Z] [INFO] [EXEC] oc wait --for=jsonpath='{.status.readyReplicas}'=1 deployment/model-catalog -n rhoai-model-registries --timeout=120s [2026-07-02T17:58:06.093Z] [INFO] model-catalog deployment wait result: deployment.apps/model-catalog condition met [2026-07-02T17:58:06.099Z] [INFO] ✓ model-catalog deployment has a ready pod in namespace rhoai-model-registries [2026-07-02T17:58:06.108Z] [INFO] Ensuring model catalog source 'redhat_ai_models' is enabled [2026-07-02T17:58:06.576Z] [INFO] [EXEC] oc get configmap default-catalog-sources -n rhoai-model-registries -o jsonpath='{.data.sources\.yaml}' | if command -v yq >/dev/null 2>&1; then yq '.catalogs[] | select(.id == "redhat_ai_models") | .enabled' else python3 -c 'import sys, yaml, json; json.dump(yaml.safe_load(sys.stdin), sys.stdout)' 2>/dev/null | jq -r '.catalogs[] | select(.id == "redhat_ai_models") | .enabled // empty' fi [2026-07-02T17:58:06.583Z] [INFO] Command exit code: 0 [2026-07-02T17:58:06.590Z] [INFO] Source redhat_ai_models is currently enabled: true [2026-07-02T17:58:06.596Z] [INFO] ✓ Source redhat_ai_models is already enabled, no action needed [2026-07-02T17:58:06.649Z] [INFO] [STEP 1] Login as admin user [2026-07-02T17:58:06.664Z] [INFO] Navigate to: https://rh-ai.apps.ods-qe-psi-23.osp.rh-ods.com/ [2026-07-02T17:58:06.668Z] [INFO] BYOIDC cluster detected - using Keycloak authentication [2026-07-02T17:58:07.199Z] [INFO] Keycloak login flow detected - completing authentication [2026-07-02T17:58:08.398Z] [INFO] [STEP 2] Navigate to Model Catalog [2026-07-02T17:58:08.550Z] [INFO] Navigate to: https://rh-ai.apps.ods-qe-psi-23.osp.rh-ods.com/ai-hub/models/catalog [2026-07-02T17:58:08.562Z] [INFO] BYOIDC cluster detected - using Keycloak authentication [2026-07-02T17:58:10.686Z] [INFO] [STEP 3] Wait for model catalog cards to appear [2026-07-02T17:58:10.737Z] [INFO] [STEP 4] Polling for model catalog cards (max 10 attempts) [2026-07-02T17:58:20.783Z] [INFO] Attempt 1/10: cards=12, emptyState=false, elapsed=4.1s [2026-07-02T17:58:20.788Z] [INFO] ✅ Model catalog cards are now visible (found 12 cards) [2026-07-02T17:58:20.793Z] [INFO] [STEP 5] Verify toggle exists and is OFF by default [2026-07-02T17:58:20.844Z] [INFO] [STEP 6] Turn ON performance view toggle [2026-07-02T17:58:21.010Z] [INFO] [STEP 7] Verify performance toolbar filters appear 1) Performance view toggle enables filters and shows benchmark data on validated models [2026-07-02T17:58:31.536Z] [INFO] Navigate back to Model Catalog and disable performance view toggle [2026-07-02T17:58:31.587Z] [INFO] Navigate to: https://rh-ai.apps.ods-qe-psi-23.osp.rh-ods.com/ai-hub/models/catalog [2026-07-02T17:58:31.593Z] [INFO] BYOIDC cluster detected - using Keycloak authentication [2026-07-02T17:58:33.381Z] [INFO] Polling for model catalog cards (max 10 attempts) [2026-07-02T17:58:43.401Z] [INFO] Attempt 1/10: cards=12, emptyState=false, elapsed=1.9s [2026-07-02T17:58:43.405Z] [INFO] ✅ Model catalog cards are now visible (found 12 cards) 0 passing (1m) 1 failing 1) Verify Performance Filters are available on RHOAI Performance view toggle enables filters and shows benchmark data on validated models: Test steps were: 1. Check if the operator is RHOAI 2. Detect model-catalog namespace 3. Ensuring model catalog source 'redhat_ai_models' is enabled 4. Login as admin user 5. Navigate to: https://rh-ai.apps.ods-qe-psi-23.osp.rh-ods.com/ 6. Navigate to Model Catalog 7. Navigate to: https://rh-ai.apps.ods-qe-psi-23.osp.rh-ods.com/ai-hub/models/catalog 8. Wait for model catalog cards to appear 9. Polling for model catalog cards (max 10 attempts) 10. Verify toggle exists and is OFF by default 11. Turn ON performance view toggle 12. Verify performance toolbar filters appear Timed out retrying after 10000ms: Unable to find an element by: [data-testid="cold-start-load-time-filter"] Ignored nodes: comments, script, style Red Hat OpenShift AI