=== RUN TestOdhOperator/DSCInitialization_and_DataScienceCluster_validation_E2E_Tests/Validate_DSCI_webhook_denies_invalid_PEM_on_update testing.go:1913: test executed panic(nil) or runtime.Goexit: subtest may have called FailNow on a parent test --- FAIL: TestOdhOperator/DSCInitialization_and_DataScienceCluster_validation_E2E_Tests/Validate_DSCI_webhook_denies_invalid_PEM_on_update (300.01s) === RUN TestOdhOperator/DSCInitialization_and_DataScienceCluster_validation_E2E_Tests 2026-07-07T11:05:56Z INFO Cluster config {"Operator Namespace": "redhat-ods-operator", "Application Namespace": "redhat-ods-applications", "Release": {"name":"OpenShift AI Self-Managed","version":"3.5.0-ea.2"}, "Cluster": {"type":"OpenShift","version":"4.19.18"}} test_context_test.go:1675: Timed out after 300.009s. Webhook should deny update with invalid PEM in customCABundle The function passed to Eventually failed at /workspace/tests/e2e/test_context_test.go:1664 with: Webhook should deny update with invalid PEM in customCABundle Expected an error to have occurred. Got: <nil>: nil --- FAIL: TestOdhOperator/DSCInitialization_and_DataScienceCluster_validation_E2E_Tests (300.39s) === RUN TestOdhOperator 2026/07/07 11:05:56 ARTIFACT_DIR not set, skipping periodic metrics collection 2026/07/07 11:11:06 TEST FAILURE DETECTED: DSCInitialization and DataScienceCluster validation E2E Tests 2026/07/07 11:11:06 === RUNNING CLUSTER DIAGNOSTICS (triggered by test:DSCInitialization and DataScienceCluster validation E2E Tests) === 2026/07/07 11:11:07 === CLUSTER STATE === 2026/07/07 11:11:07 Node: ods-qe-psi-07-b4mqp-master-0 2026/07/07 11:11:07 Condition MemoryPressure: False - kubelet has sufficient memory available 2026/07/07 11:11:07 Condition DiskPressure: False - kubelet has no disk pressure 2026/07/07 11:11:07 Condition PIDPressure: False - kubelet has sufficient PID available 2026/07/07 11:11:07 Condition Ready: True - kubelet is posting ready status 2026/07/07 11:11:07 Resources: 11500m CPU, 23450728Ki memory allocatable (of 12000m CPU, 24601704Ki memory capacity) 2026/07/07 11:11:07 Node: ods-qe-psi-07-b4mqp-master-1 2026/07/07 11:11:07 Condition MemoryPressure: False - kubelet has sufficient memory available 2026/07/07 11:11:07 Condition DiskPressure: False - kubelet has no disk pressure 2026/07/07 11:11:07 Condition PIDPressure: False - kubelet has sufficient PID available 2026/07/07 11:11:07 Condition Ready: True - kubelet is posting ready status 2026/07/07 11:11:07 Resources: 11500m CPU, 23452748Ki memory allocatable (of 12000m CPU, 24603724Ki memory capacity) 2026/07/07 11:11:07 Node: ods-qe-psi-07-b4mqp-master-2 2026/07/07 11:11:07 Condition MemoryPressure: False - kubelet has sufficient memory available 2026/07/07 11:11:07 Condition DiskPressure: False - kubelet has no disk pressure 2026/07/07 11:11:07 Condition PIDPressure: False - kubelet has sufficient PID available 2026/07/07 11:11:07 Condition Ready: True - kubelet is posting ready status 2026/07/07 11:11:07 Resources: 11500m CPU, 23450732Ki memory allocatable (of 12000m CPU, 24601708Ki memory capacity) 2026/07/07 11:11:07 Node: ods-qe-psi-07-b4mqp-worker-0-gc6qk 2026/07/07 11:11:07 Condition MemoryPressure: False - kubelet has sufficient memory available 2026/07/07 11:11:07 Condition DiskPressure: False - kubelet has no disk pressure 2026/07/07 11:11:07 Condition PIDPressure: False - kubelet has sufficient PID available 2026/07/07 11:11:07 Condition Ready: True - kubelet is posting ready status 2026/07/07 11:11:07 Resources: 11500m CPU, 23450728Ki memory allocatable (of 12000m CPU, 24601704Ki memory capacity) 2026/07/07 11:11:07 Node: ods-qe-psi-07-b4mqp-worker-0-jcdqk 2026/07/07 11:11:07 Condition MemoryPressure: False - kubelet has sufficient memory available 2026/07/07 11:11:07 Condition DiskPressure: False - kubelet has no disk pressure 2026/07/07 11:11:07 Condition PIDPressure: False - kubelet has sufficient PID available 2026/07/07 11:11:07 Condition Ready: True - kubelet is posting ready status 2026/07/07 11:11:07 Resources: 11500m CPU, 23452748Ki memory allocatable (of 12000m CPU, 24603724Ki memory capacity) 2026/07/07 11:11:07 Node: ods-qe-psi-07-b4mqp-worker-0-jd4pm 2026/07/07 11:11:07 Condition MemoryPressure: False - kubelet has sufficient memory available 2026/07/07 11:11:07 Condition DiskPressure: False - kubelet has no disk pressure 2026/07/07 11:11:07 Condition PIDPressure: False - kubelet has sufficient PID available 2026/07/07 11:11:07 Condition Ready: True - kubelet is posting ready status 2026/07/07 11:11:07 Resources: 11500m CPU, 23452736Ki memory allocatable (of 12000m CPU, 24603712Ki memory capacity) 2026/07/07 11:11:07 Node: ods-qe-psi-07-b4mqp-worker-0-tx6lc 2026/07/07 11:11:07 Condition MemoryPressure: False - kubelet has sufficient memory available 2026/07/07 11:11:07 Condition DiskPressure: False - kubelet has no disk pressure 2026/07/07 11:11:07 Condition PIDPressure: False - kubelet has sufficient PID available 2026/07/07 11:11:07 Condition Ready: True - kubelet is posting ready status 2026/07/07 11:11:07 Resources: 11500m CPU, 23452744Ki memory allocatable (of 12000m CPU, 24603720Ki memory capacity) 2026/07/07 11:11:07 Node: ods-qe-psi-07-b4mqp-worker-0-wvlfv 2026/07/07 11:11:07 Condition MemoryPressure: False - kubelet has sufficient memory available 2026/07/07 11:11:07 Condition DiskPressure: False - kubelet has no disk pressure 2026/07/07 11:11:07 Condition PIDPressure: False - kubelet has sufficient PID available 2026/07/07 11:11:07 Condition Ready: True - kubelet is posting ready status 2026/07/07 11:11:07 Resources: 11500m CPU, 23450720Ki memory allocatable (of 12000m CPU, 24601696Ki memory capacity) 2026/07/07 11:11:07 === DEPLOYMENTS === 2026/07/07 11:11:07 Namespace: redhat-ods-applications 2026/07/07 11:11:07 Deployment dashboard-redirect: 2/2 (READY) 2026/07/07 11:11:07 Deployment data-science-pipelines-operator-controller-manager: 1/1 (READY) 2026/07/07 11:11:07 Deployment feast-operator-controller-manager: 1/1 (READY) 2026/07/07 11:11:07 Deployment kserve-controller-manager: 1/1 (READY) 2026/07/07 11:11:07 Deployment kubeflow-trainer-controller-manager: 1/1 (READY) 2026/07/07 11:11:07 Deployment kubeflow-training-operator: 1/1 (READY) 2026/07/07 11:11:07 Deployment kuberay-operator: 1/1 (READY) 2026/07/07 11:11:07 Deployment llmisvc-controller-manager: 1/1 (READY) 2026/07/07 11:11:07 Deployment maas-api: 1/1 (READY) 2026/07/07 11:11:07 Deployment maas-controller: 1/1 (READY) 2026/07/07 11:11:07 Deployment maas-postgres: 1/1 (READY) 2026/07/07 11:11:07 Deployment mlflow-operator-controller-manager: 1/1 (READY) 2026/07/07 11:11:07 Deployment model-registry-operator-controller-manager: 1/1 (READY) 2026/07/07 11:11:07 Deployment model-serving-api: 1/1 (READY) 2026/07/07 11:11:07 Deployment notebook-controller-deployment: 1/1 (READY) 2026/07/07 11:11:07 Deployment odh-model-controller: 1/1 (READY) 2026/07/07 11:11:07 Deployment odh-notebook-controller-manager: 1/1 (READY) 2026/07/07 11:11:07 Deployment ogx-k8s-operator-controller-manager: 1/1 (READY) 2026/07/07 11:11:07 Deployment postgres: 1/1 (READY) 2026/07/07 11:11:07 Deployment rhods-dashboard: 2/2 (READY) 2026/07/07 11:11:07 Deployment spark-operator-controller: 1/1 (READY) 2026/07/07 11:11:07 Deployment spark-operator-webhook: 1/1 (READY) 2026/07/07 11:11:07 Deployment trustyai-service-operator-controller-manager: 1/1 (READY) 2026/07/07 11:11:07 Namespace: kube-system 2026/07/07 11:11:07 === PODS === 2026/07/07 11:11:07 Failed to collect pod data: redhat-ods-applications/maas-controller-656b6867cb-knvsn: container manager restarts=14; redhat-ods-applications/trustyai-service-operator-controller-manager-6f7f88c874-w9dhm: container manager restarts=2 2026/07/07 11:11:07 === OPERATOR STATUS === 2026/07/07 11:11:07 Operator deployment: 3/3 ready 2026/07/07 11:11:07 === DSCI STATUS === 2026/07/07 11:11:07 Failed to collect DSCI data: default-dsci unhealthy conditions: MonitoringStackAvailable=False; TempoAvailable=False; OpenTelemetryCollectorAvailable=False; AlertingAvailable=False; ThanosQuerierAvailable=False; PersesAvailable=False; NodeMetricsEndpointAvailable=False 2026/07/07 11:11:07 === DSC STATUS === 2026/07/07 11:11:07 Failed to collect DSC data: default-dsc unhealthy conditions: MaaSPrerequisitesAvailable=False 2026/07/07 11:11:07 === RECENT EVENTS === 2026/07/07 11:11:07 11:07:58 WARN Pod/maas-controller-656b6867cb-knvsn: FailedToRetrieveImagePullSecret - Unable to retrieve some image pull secrets (maas-controller-dockercfg-kc6l7); attempting to pull the image may not succeed. 2026/07/07 11:11:07 === RESOURCE QUOTAS === 2026/07/07 11:11:07 No resource quotas found in monitored namespaces 2026/07/07 11:11:07 Classification for DSCInitialization and DataScienceCluster validation E2E Tests: infrastructure/dsci-unhealthy (code=1009, confidence=medium) 2026/07/07 11:11:07 Evidence: DSCI default-dsci unhealthy: default-dsci unhealthy conditions: MonitoringStackAvailable=False; TempoAvailable=False; OpenTelemetryCollectorAvailable=False; AlertingAvailable=False; ThanosQuerierAvailable=False; PersesAvailable=False; NodeMetricsEndpointAvailable=False FAILURE_CLASSIFICATION: {"category":"infrastructure","subcategory":"dsci-unhealthy","error_code":1009,"evidence":["DSCI default-dsci unhealthy: default-dsci unhealthy conditions: MonitoringStackAvailable=False; TempoAvailable=False; OpenTelemetryCollectorAvailable=False; AlertingAvailable=False; ThanosQuerierAvailable=False; PersesAvailable=False; NodeMetricsEndpointAvailable=False"],"confidence":"medium"} 2026/07/07 11:11:07 Diagnostics complete for failed test: DSCInitialization and DataScienceCluster validation E2E Tests controller_test.go:478: Stopping: DSCInitialization and DataScienceCluster validation E2E Tests test failed. 2026/07/07 11:11:07 Circuit breaker: failure classified as infrastructure/dsci-unhealthy (code=1009) 2026/07/07 11:11:07 Circuit breaker: infrastructure/unknown failure recorded (1/3) Deletion Policy: Never. Skipping deletion tests. 2026/07/07 11:15:20 Circuit breaker: no trips during this run (threshold=3) --- FAIL: TestOdhOperator (564.28s)