==================== ISSUES SUMMARY ==================== ========== ODH/RHOAI ISSUES SUMMARY (status, events, highlights only) ========== 55m Warning FailedMount pod/model-registry-operator-controller-manager-5599bddbb9-zxxpj MountVolume.SetUp failed for volume "cert" : secret "model-registry-operator-webhook-service" not found 55m Warning FailedMount pod/odh-model-controller-bc67559db-hjqkl MountVolume.SetUp failed for volume "cert" : secret "odh-model-controller-webhook-cert" not found 55m Warning FailedMount pod/data-science-pipelines-operator-controller-manager-99b5876tr82d MountVolume.SetUp failed for volume "config" : configmap "data-science-pipelines-operator-dspo-config" not found 55m Warning FailedMount pod/odh-notebook-controller-manager-64ddcd494c-nkk99 MountVolume.SetUp failed for volume "webhook-cert" : secret "odh-notebook-controller-webhook-cert" not found 55m Warning FailedCreate replicaset/model-serving-api-67c44bccdf Error creating: pods "model-serving-api-67c44bccdf-" is forbidden: error looking up service account redhat-ods-applications/model-serving-api: serviceaccount "model-serving-api" not found 55m Warning FailedCreate replicaset/notebook-controller-deployment-6cb948c95d Error creating: pods "notebook-controller-deployment-6cb948c95d-" is forbidden: error looking up service account redhat-ods-applications/notebook-controller-service-account: serviceaccount "notebook-controller-service-account" not found 55m Warning FailedMount pod/kuberay-operator-796bfd97f7-2t85q MountVolume.SetUp failed for volume "cert" : secret "kuberay-webhook-server-cert" not found 55m Warning FailedCreate replicaset/rhods-dashboard-74d95cd57c Error creating: pods "rhods-dashboard-74d95cd57c-" is forbidden: error looking up service account redhat-ods-applications/rhods-dashboard: serviceaccount "rhods-dashboard" not found 55m Warning FailedMount pod/rhods-dashboard-74d95cd57c-j4s5q MountVolume.SetUp failed for volume "modules-sa-token" : secret "odh-dashboard-modules-token" not found 55m Warning FailedMount pod/rhods-dashboard-74d95cd57c-9nfm5 MountVolume.SetUp failed for volume "modules-sa-token" : secret "odh-dashboard-modules-token" not found 55m Warning FailedMount pod/kserve-controller-manager-7747874bf-62j4m MountVolume.SetUp failed for volume "cert" : secret "kserve-webhook-server-cert" not found 55m Warning FailedMount pod/llmisvc-controller-manager-78dcbbdc6c-ccb6f MountVolume.SetUp failed for volume "cert" : secret "llmisvc-webhook-server-cert" not found 41m Warning FailedCreate replicaset/spark-operator-controller-55c9b477df Error creating: pods "spark-operator-controller-55c9b477df-" is forbidden: error looking up service account redhat-ods-applications/spark-operator-controller: serviceaccount "spark-operator-controller" not found 9m12s Warning FailedCreate replicaset/spark-operator-controller-55c9b477df Error creating: pods "spark-operator-controller-55c9b477df-" is forbidden: error looking up service account redhat-ods-applications/spark-operator-controller: serviceaccount "spark-operator-controller" not found 8m3s Warning FailedMount pod/spark-pi-d9bh0ttd3scc7b3etva0-driver MountVolume.SetUp failed for volume "spark-conf-volume-driver" : configmap "spark-drv-bd089c9f64187d88-conf-map" not found 6m12s Warning FailedMount pod/scheduled-spark-pi-d9bh1htd3scc7b3etvag-1784090853000852083-driver MountVolume.SetUp failed for volume "spark-conf-volume-driver" : configmap "spark-drv-a76ed99f641a2e61-conf-map" not found 6m12s Warning FailedMount pod/scheduled-spark-pi-d9bh1htd3scc7b3etvag-1784090853000852083-driver MountVolume.SetUp failed for volume "pod-template-volume" : configmap "scheduled-spark-pi-d9bh1htd3scc7b3etvag-1784090853000852083-d9bdb49f641a1c67-driver-podspec-conf-map" not found 56m Warning AppliedWithWarnings installplan/install-lhzc6 1 warning(s) generated during installation of operator "rhods-operator.3.5.0-ea.1" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1 17m Warning Deleting modelregistry/test-model-registry-662874 Custom Resource test-model-registry-662874 is being deleted from the namespace rhoai-model-registries 17m Warning Deleting modelregistry/test-model-registry-662874 Custom Resource test-model-registry-662874 is being deleted from the namespace rhoai-model-registries 55m Warning FailedMount pod/model-catalog-76db8fd49f-svbks MountVolume.SetUp failed for volume "kube-rbac-proxy-config" : configmap "model-catalog-kube-rbac-proxy-config" not found 55m Warning FailedMount pod/model-catalog-76db8fd49f-svbks MountVolume.SetUp failed for volume "kube-rbac-proxy-tls" : secret "model-catalog-kube-rbac-proxy" not found 55m Warning Unhealthy pod/model-catalog-76db8fd49f-svbks Liveness probe failed: dial tcp 10.133.0.48:8080: connect: connection refused 55m Warning Unhealthy pod/model-catalog-76db8fd49f-svbks Readiness probe failed: dial tcp 10.133.0.48:8080: connect: connection refused 28m Warning Unhealthy pod/mysql-db-registry-1784089476971-9d84456b8-ltrlc Readiness probe failed: mysql: [Warning] Using a password on the command line interface can be insecure.... 27m Warning Unhealthy pod/mysql-db-registry-1784089557616-7474cf5bb4-jx8fn Readiness probe failed: mysql: [Warning] Using a password on the command line interface can be insecure.... 25m Warning Unhealthy pod/model-registry-db-662874-864c6b9cc8-rvfwz Readiness probe failed: mysql: [Warning] Using a password on the command line interface can be insecure.... {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} {"level":"info","ts":"2026-07-15T03:57:33Z","msg":"Error creating object, retrying...","reason":"Internal error occurred: failed calling webhook \"dscinitialization-v2-validator.opendatahub.io\": failed to call webhook: Post \"https://rhods-operator-service.redhat-ods-operator.svc:443/validate-dscinitialization-v2?timeout=10s\": no endpoints available for service \"rhods-operator-service\""} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Error creating object, retrying...","reason":"Internal error occurred: failed calling webhook \"dscinitialization-v2-validator.opendatahub.io\": failed to call webhook: Post \"https://rhods-operator-service.redhat-ods-operator.svc:443/validate-dscinitialization-v2?timeout=10s\": no endpoints available for service \"rhods-operator-service\""} {"level":"info","ts":"2026-07-15T03:57:39Z","msg":"Error creating object, retrying...","reason":"Internal error occurred: failed calling webhook \"dscinitialization-v2-validator.opendatahub.io\": failed to call webhook: Post \"https://rhods-operator-service.redhat-ods-operator.svc:443/validate-dscinitialization-v2?timeout=10s\": no endpoints available for service \"rhods-operator-service\""} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fbf9e7c0-9310-4bbe-a56c-36e7afe20607","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5263223d-14f9-4f1d-956b-b606045e2a18","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f5adea62-43ff-4228-bbac-069ed4845fbb","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b5d0dfc-45b5-47ab-aaa3-ca8f9adce583","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"70aa8f7a-dffe-4fcd-9a48-021df25e720d","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"16bed4f4-32ce-441c-a69b-3edd60caa775","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e3262e4f-ff21-42b4-b40c-571297fa785f","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:49Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a9e626e3-62db-4cce-a1dd-fc760aa003a9","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:50Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"48dfe5ec-929b-484c-9b8a-1dbeb3b537af","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:50Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f6d1224c-64f0-424b-bd12-3d09d8282652","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:50Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c44824c1-8e0c-49a0-ab91-d8ad5d440aad","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:50Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2d23357c-c01b-4ea3-943a-57ec1b558db0","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:51Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d4324293-c8a3-4709-bc59-698525b9bb30","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:51Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"738df755-8d0f-4629-ae21-2717912b68be","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:51Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"cd4d4cfe-5d65-4a70-b3b7-d7588cc32073","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:51Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e80ee000-720f-49c7-a5f1-5041b03a33b5","error":"provisioning failed: failure deploying resource openshift-ingress/data-science-authn-filter: apply failed networking.istio.io/v1alpha3, Kind=EnvoyFilter: unable to patch networking.istio.io/v1alpha3, Kind=EnvoyFilter openshift-ingress/data-science-authn-filter: Internal error occurred: failed calling webhook \"rev.validation.istio.io\": failed to call webhook: Post \"https://istiod-openshift-gateway.openshift-ingress.svc:443/validate?timeout=10s\": no endpoints available for service \"istiod-openshift-gateway\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:51Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30ae6fd5-bafa-41dd-9c46-565919537b62","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:52Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a9152d41-90df-4626-bda3-436e4011d127","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:52Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df2733c8-5f18-4ede-b781-5d98817e0009","error":"provisioning failed: failure deploying resource openshift-ingress/data-science-authn-filter: apply failed networking.istio.io/v1alpha3, Kind=EnvoyFilter: unable to patch networking.istio.io/v1alpha3, Kind=EnvoyFilter openshift-ingress/data-science-authn-filter: Internal error occurred: failed calling webhook \"rev.validation.istio.io\": failed to call webhook: Post \"https://istiod-openshift-gateway.openshift-ingress.svc:443/validate?timeout=10s\": no endpoints available for service \"istiod-openshift-gateway\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:53Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ff8b9ef5-f13b-4a17-8b17-f9790ea56d7c","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:54Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e64108b-5014-46de-a0c2-ff106080dfe5","error":"provisioning failed: failure deploying resource openshift-ingress/data-science-authn-filter: apply failed networking.istio.io/v1alpha3, Kind=EnvoyFilter: unable to patch networking.istio.io/v1alpha3, Kind=EnvoyFilter openshift-ingress/data-science-authn-filter: Internal error occurred: failed calling webhook \"rev.validation.istio.io\": failed to call webhook: Post \"https://istiod-openshift-gateway.openshift-ingress.svc:443/validate?timeout=10s\": no endpoints available for service \"istiod-openshift-gateway\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:55Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"827ce758-c336-40a2-a6c7-905ec9972105","error":"provisioning failed: failure deploying resource openshift-ingress/data-science-tls-rule: apply failed networking.istio.io/v1, Kind=DestinationRule: unable to patch networking.istio.io/v1, Kind=DestinationRule openshift-ingress/data-science-tls-rule: Internal error occurred: failed calling webhook \"rev.validation.istio.io\": failed to call webhook: Post \"https://istiod-openshift-gateway.openshift-ingress.svc:443/validate?timeout=10s\": no endpoints available for service \"istiod-openshift-gateway\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:55Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"882db0f1-e586-4c63-8822-412ba4e3988b","error":"provisioning failed: failure deploying resource openshift-ingress/data-science-tls-rule: apply failed networking.istio.io/v1, Kind=DestinationRule: unable to patch networking.istio.io/v1, Kind=DestinationRule openshift-ingress/data-science-tls-rule: Internal error occurred: failed calling webhook \"rev.validation.istio.io\": failed to call webhook: Post \"https://istiod-openshift-gateway.openshift-ingress.svc:443/validate?timeout=10s\": no endpoints available for service \"istiod-openshift-gateway\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:56Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"285103af-7627-4387-adb0-949f784346a7","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:43Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcef741e-37e5-477a-9fce-ae32a4d80cb6","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:49Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8260c5cd-8dbe-444d-8881-2c20d0c5b63b","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:49Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"24357fb8-6198-4182-8974-3ee27d123c78","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:50Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"61eb7639-25ee-48e1-8298-c72521edc14c","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:50Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"82c01cf9-7025-489d-bdcf-8e67b033ca27","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:51Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"52b295c7-3946-44ab-8c4a-848049cbd92a","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:52Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a5ca40f3-b797-4641-bc2d-d25e64862133","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:53Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"fd6a5742-7b7b-4d43-a4c8-d67b535d84a1","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:54Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"efaca575-d0ed-4145-ba2f-22ec018344cb","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:56Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcf5d351-72f9-4c74-8ca8-945a83d0d70f","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:59Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ff72c9bd-f95e-409d-9c8d-7efaba3ec2c1","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:59:05Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6b1e3eac-e1f3-4a90-a200-b96feb81d2ba","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:59:15Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"719a9733-8b2b-4afc-98bf-d7e0a06e2272","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} --------------------------------------------------------------------------------------------------- ==================== STATUS REPORT ==================== ========== ODH/RHOAI STATUS REPORT (2026-07-15T04:53:56Z) ========== --- OpenShift / OCP version --- Client Version: 4.20.8 Kustomize Version: v5.6.0 Server Version: 4.21.24 Kubernetes Version: v1.34.9 --- Namespaces --- namespace/opendatahub namespace/redhat-ods-applications namespace/redhat-ods-monitoring namespace/redhat-ods-operator namespace/rhoai-model-registries namespace/rhods-notebooks --- Subscriptions (redhat-ods-operator) --- NAME PACKAGE SOURCE CHANNEL rhods-operator rhods-operator rhoai-catalog-dev beta Subscription conditions (unhealthy): CatalogSourcesUnhealthy: status=False reason=AllCatalogSourcesHealthy message=all available catalogsources are healthy --- ClusterServiceVersions (redhat-ods-operator) --- NAME DISPLAY VERSION REPLACES PHASE authorino-operator.v1.4.1 Authorino Operator 1.4.1 authorino-operator.v1.3.2 Succeeded cert-manager-operator.v1.20.0 cert-manager Operator for Red Hat OpenShift 1.20.0 cert-manager-operator.v1.19.0 Succeeded custom-metrics-autoscaler.v2.19.0-2 Custom Metrics Autoscaler 2.19.0-2 custom-metrics-autoscaler.v2.19.0-1 Succeeded dns-operator.v1.4.0 DNS Operator 1.4.0 dns-operator.v1.3.1 Succeeded kueue-operator.v1.3.1 Red Hat build of Kueue 1.3.1 Succeeded limitador-operator.v1.4.0 Limitador Operator 1.4.0 limitador-operator.v1.3.1 Succeeded rhcl-operator.v1.4.1 Red Hat Connectivity Link 1.4.1 rhcl-operator.v1.3.5 Succeeded rhods-operator.3.5.0-ea.1 Red Hat OpenShift AI 3.5.0-ea.1 Succeeded serverless-operator.v1.37.1 Red Hat OpenShift Serverless 1.37.1 serverless-operator.v1.37.0 Succeeded --- CSVs not in Succeeded phase --- (all CSVs report phase Succeeded) --- InstallPlans (redhat-ods-operator, not Complete) --- (no non-Complete InstallPlans) --- DataScienceCluster --- NAME READY REASON default-dsc True DSC Ready summary: True reason= DSC component states: aipipelines: managementState=Managed dashboard: managementState=Managed feastoperator: managementState=Managed kserve: managementState=Managed kueue: managementState=Removed llamastackoperator: managementState=n/a mlflowoperator: managementState=Removed modelregistry: managementState=Managed ogx: managementState=Removed ray: managementState=Managed sparkoperator: managementState=Managed trainer: managementState=Managed trainingoperator: managementState=Managed trustyai: managementState=Removed workbenches: managementState=Managed DSC conditions: Ready: status=True reason= message= ProvisioningSucceeded: status=True reason= message= ComponentsReady: status=True reason= message= AIPipelinesReady: status=True reason= message= DashboardReady: status=True reason= message= FeastOperatorReady: status=True reason= message= KserveLLMInferenceServiceDependencies: status=True reason= message= KserveLLMInferenceServiceWideEPDependencies: status=True reason= message= KserveReady: status=True reason= message= KueueReady: status=False reason=Removed message=Component ManagementState is set to Removed MLflowOperatorReady: status=False reason=Removed message=Component ManagementState is set to Removed ModelControllerReady: status=True reason= message= ModelRegistryReady: status=True reason= message= ModelsAsServiceReady: status=False reason=Removed message=Component ManagementState is set to Removed OGXReady: status=False reason=Removed message=Component ManagementState is set to Removed RayReady: status=True reason= message= SparkOperatorReady: status=True reason= message= TrainerReady: status=True reason= message= TrainingOperatorReady: status=True reason= message= TrustyAIReady: status=False reason=Removed message=Component ManagementState is set to Removed WorkbenchesReady: status=True reason= message= --- DSCInitialization --- NAME AGE PHASE CREATED AT default-dsci 56m Ready 2026-07-15T03:57:47Z DSCInitialization conditions: ReconcileComplete: status=True reason=ReconcileCompleted message=Reconcile completed successfully Available: status=True reason=ReconcileCompleted message=Reconcile completed successfully Progressing: status=False reason=ReconcileCompleted message=Reconcile completed successfully Degraded: status=False reason=ReconcileCompleted message=Reconcile completed successfully Upgradeable: status=True reason=ReconcileCompleted message=Reconcile completed successfully MonitoringReady: status=True reason=Ready message=Monitoring stack is initialized Ready: status=True reason= message= ProvisioningSucceeded: status=True reason= message= MonitoringStackAvailable: status=False reason=MetricsNotConfigured message=Metrics not configured in DSCI CR TempoAvailable: status=False reason=TracesNotConfigured message=Traces not configured in DSCI CR OpenTelemetryCollectorAvailable: status=False reason=MetricsNotConfiguredAndTracesNotConfigured message=Metrics not configured in DSCI CR Traces not configured in DSCI CR AlertingAvailable: status=False reason=AlertingNotConfigured message=Alerting not configured in DSCI CR ThanosQuerierAvailable: status=False reason=MetricsNotConfigured message=Metrics not configured in DSCI CR PersesAvailable: status=False reason=MetricsNotConfiguredAndTracesNotConfigured message=Perses requires at least Metrics or Traces to be configured NodeMetricsEndpointAvailable: status=False reason=MetricsNotConfigured message=Metrics not configured in DSCI CR --- Component CRs (Ready) --- NAME READY REASON URL dashboard.components.platform.opendatahub.io/default-dashboard True NAME READY REASON datasciencepipelines.components.platform.opendatahub.io/default-datasciencepipelines True NAME READY REASON feastoperator.components.platform.opendatahub.io/default-feastoperator True NAME READY REASON kserve.components.platform.opendatahub.io/default-kserve True NAME READY REASON URI modelcontroller.components.platform.opendatahub.io/default-modelcontroller True NAME READY REASON modelregistry.components.platform.opendatahub.io/default-modelregistry True NAME READY REASON ray.components.platform.opendatahub.io/default-ray True NAME READY REASON sparkoperator.components.platform.opendatahub.io/default-sparkoperator True NAME READY REASON trainer.components.platform.opendatahub.io/default-trainer True NAME READY REASON trainingoperator.components.platform.opendatahub.io/default-trainingoperator True NAME READY REASON workbenches.components.platform.opendatahub.io/default-workbenches True --- Deployments not fully ready (ODH/RHOAI namespaces) --- (all deployments report ready replicas == desired) --- Pods not Running/Succeeded (ODH/RHOAI namespaces) --- (all pods Running or Succeeded) --------------------------------------------------------------------------------------------------- ==================== EVENTS ==================== ========== ODH/RHOAI EVENTS (Warning / Error / Failed) ========== --- namespace/opendatahub --- (no events) --- namespace/redhat-ods-applications --- LAST SEEN TYPE REASON OBJECT MESSAGE 55m Warning FailedMount pod/model-registry-operator-controller-manager-5599bddbb9-zxxpj MountVolume.SetUp failed for volume "cert" : secret "model-registry-operator-webhook-service" not found 55m Warning FailedMount pod/odh-model-controller-bc67559db-hjqkl MountVolume.SetUp failed for volume "cert" : secret "odh-model-controller-webhook-cert" not found 55m Warning FailedMount pod/data-science-pipelines-operator-controller-manager-99b5876tr82d MountVolume.SetUp failed for volume "config" : configmap "data-science-pipelines-operator-dspo-config" not found 55m Warning FailedMount pod/odh-notebook-controller-manager-64ddcd494c-nkk99 MountVolume.SetUp failed for volume "webhook-cert" : secret "odh-notebook-controller-webhook-cert" not found 55m Warning FailedCreate replicaset/model-serving-api-67c44bccdf Error creating: pods "model-serving-api-67c44bccdf-" is forbidden: error looking up service account redhat-ods-applications/model-serving-api: serviceaccount "model-serving-api" not found 55m Warning FailedCreate replicaset/notebook-controller-deployment-6cb948c95d Error creating: pods "notebook-controller-deployment-6cb948c95d-" is forbidden: error looking up service account redhat-ods-applications/notebook-controller-service-account: serviceaccount "notebook-controller-service-account" not found 55m Warning FailedMount pod/kuberay-operator-796bfd97f7-2t85q MountVolume.SetUp failed for volume "cert" : secret "kuberay-webhook-server-cert" not found 55m Warning FailedCreate replicaset/rhods-dashboard-74d95cd57c Error creating: pods "rhods-dashboard-74d95cd57c-" is forbidden: error looking up service account redhat-ods-applications/rhods-dashboard: serviceaccount "rhods-dashboard" not found 55m Warning FailedMount pod/rhods-dashboard-74d95cd57c-j4s5q MountVolume.SetUp failed for volume "modules-sa-token" : secret "odh-dashboard-modules-token" not found 55m Warning FailedMount pod/rhods-dashboard-74d95cd57c-9nfm5 MountVolume.SetUp failed for volume "modules-sa-token" : secret "odh-dashboard-modules-token" not found 55m Warning FailedMount pod/kserve-controller-manager-7747874bf-62j4m MountVolume.SetUp failed for volume "cert" : secret "kserve-webhook-server-cert" not found 55m Warning FailedMount pod/llmisvc-controller-manager-78dcbbdc6c-ccb6f MountVolume.SetUp failed for volume "cert" : secret "llmisvc-webhook-server-cert" not found 41m Warning FailedCreate replicaset/spark-operator-controller-55c9b477df Error creating: pods "spark-operator-controller-55c9b477df-" is forbidden: error looking up service account redhat-ods-applications/spark-operator-controller: serviceaccount "spark-operator-controller" not found 9m12s Warning FailedCreate replicaset/spark-operator-controller-55c9b477df Error creating: pods "spark-operator-controller-55c9b477df-" is forbidden: error looking up service account redhat-ods-applications/spark-operator-controller: serviceaccount "spark-operator-controller" not found 8m3s Warning FailedMount pod/spark-pi-d9bh0ttd3scc7b3etva0-driver MountVolume.SetUp failed for volume "spark-conf-volume-driver" : configmap "spark-drv-bd089c9f64187d88-conf-map" not found 6m12s Warning FailedMount pod/scheduled-spark-pi-d9bh1htd3scc7b3etvag-1784090853000852083-driver MountVolume.SetUp failed for volume "spark-conf-volume-driver" : configmap "spark-drv-a76ed99f641a2e61-conf-map" not found 6m12s Warning FailedMount pod/scheduled-spark-pi-d9bh1htd3scc7b3etvag-1784090853000852083-driver MountVolume.SetUp failed for volume "pod-template-volume" : configmap "scheduled-spark-pi-d9bh1htd3scc7b3etvag-1784090853000852083-d9bdb49f641a1c67-driver-podspec-conf-map" not found --- namespace/redhat-ods-monitoring --- (no events) --- namespace/redhat-ods-operator --- LAST SEEN TYPE REASON OBJECT MESSAGE 56m Warning AppliedWithWarnings installplan/install-lhzc6 1 warning(s) generated during installation of operator "rhods-operator.3.5.0-ea.1" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1 --- namespace/rhoai-model-registries --- LAST SEEN TYPE REASON OBJECT MESSAGE 17m Warning Deleting modelregistry/test-model-registry-662874 Custom Resource test-model-registry-662874 is being deleted from the namespace rhoai-model-registries 17m Warning Deleting modelregistry/test-model-registry-662874 Custom Resource test-model-registry-662874 is being deleted from the namespace rhoai-model-registries 55m Warning FailedMount pod/model-catalog-76db8fd49f-svbks MountVolume.SetUp failed for volume "kube-rbac-proxy-config" : configmap "model-catalog-kube-rbac-proxy-config" not found 55m Warning FailedMount pod/model-catalog-76db8fd49f-svbks MountVolume.SetUp failed for volume "kube-rbac-proxy-tls" : secret "model-catalog-kube-rbac-proxy" not found 55m Warning Unhealthy pod/model-catalog-76db8fd49f-svbks Liveness probe failed: dial tcp 10.133.0.48:8080: connect: connection refused 55m Warning Unhealthy pod/model-catalog-76db8fd49f-svbks Readiness probe failed: dial tcp 10.133.0.48:8080: connect: connection refused 28m Warning Unhealthy pod/mysql-db-registry-1784089476971-9d84456b8-ltrlc Readiness probe failed: mysql: [Warning] Using a password on the command line interface can be insecure.... 27m Warning Unhealthy pod/mysql-db-registry-1784089557616-7474cf5bb4-jx8fn Readiness probe failed: mysql: [Warning] Using a password on the command line interface can be insecure.... 25m Warning Unhealthy pod/model-registry-db-662874-864c6b9cc8-rvfwz Readiness probe failed: mysql: [Warning] Using a password on the command line interface can be insecure.... --- namespace/rhods-notebooks --- (no events) --------------------------------------------------------------------------------------------------- ==================== OPERATOR LOG HIGHLIGHTS ==================== ========== ODH/RHOAI LOG HIGHLIGHTS (errors, webhooks, reconcile failures) ========== Source: rhods-operator pods in redhat-ods-operator (since-time=2026-07-15T03:34:35Z) --- redhat-ods-operator/rhods-operator-bc98955f6-g4dbc --- {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/convert"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"datasciencecluster.opendatahub.io/v1, Kind=DataScienceCluster"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"dscinitialization.opendatahub.io/v1, Kind=DSCInitialization"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v1"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v2"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-hardware-profile"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-prometheus-monitors"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-isvc"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-llmisvc"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-notebook"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-acceleratorprofile"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-hardwareprofile"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Starting webhook server"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Serving webhook server","host":"","port":9443} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} --- redhat-ods-operator/rhods-operator-bc98955f6-ml4kv --- {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/convert"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"datasciencecluster.opendatahub.io/v1, Kind=DataScienceCluster"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"dscinitialization.opendatahub.io/v1, Kind=DSCInitialization"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v1"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v2"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-hardware-profile"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-prometheus-monitors"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-isvc"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-llmisvc"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-notebook"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-acceleratorprofile"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-hardwareprofile"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Starting webhook server"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Serving webhook server","host":"","port":9443} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} {"level":"info","ts":"2026-07-15T03:57:33Z","msg":"Error creating object, retrying...","reason":"Internal error occurred: failed calling webhook \"dscinitialization-v2-validator.opendatahub.io\": failed to call webhook: Post \"https://rhods-operator-service.redhat-ods-operator.svc:443/validate-dscinitialization-v2?timeout=10s\": no endpoints available for service \"rhods-operator-service\""} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Error creating object, retrying...","reason":"Internal error occurred: failed calling webhook \"dscinitialization-v2-validator.opendatahub.io\": failed to call webhook: Post \"https://rhods-operator-service.redhat-ods-operator.svc:443/validate-dscinitialization-v2?timeout=10s\": no endpoints available for service \"rhods-operator-service\""} {"level":"info","ts":"2026-07-15T03:57:39Z","msg":"Error creating object, retrying...","reason":"Internal error occurred: failed calling webhook \"dscinitialization-v2-validator.opendatahub.io\": failed to call webhook: Post \"https://rhods-operator-service.redhat-ods-operator.svc:443/validate-dscinitialization-v2?timeout=10s\": no endpoints available for service \"rhods-operator-service\""} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fbf9e7c0-9310-4bbe-a56c-36e7afe20607","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5263223d-14f9-4f1d-956b-b606045e2a18","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f5adea62-43ff-4228-bbac-069ed4845fbb","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b5d0dfc-45b5-47ab-aaa3-ca8f9adce583","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"70aa8f7a-dffe-4fcd-9a48-021df25e720d","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"16bed4f4-32ce-441c-a69b-3edd60caa775","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e3262e4f-ff21-42b4-b40c-571297fa785f","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:49Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a9e626e3-62db-4cce-a1dd-fc760aa003a9","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:50Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"48dfe5ec-929b-484c-9b8a-1dbeb3b537af","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:50Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f6d1224c-64f0-424b-bd12-3d09d8282652","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:50Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c44824c1-8e0c-49a0-ab91-d8ad5d440aad","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:50Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2d23357c-c01b-4ea3-943a-57ec1b558db0","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:51Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d4324293-c8a3-4709-bc59-698525b9bb30","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:51Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"738df755-8d0f-4629-ae21-2717912b68be","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:51Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"cd4d4cfe-5d65-4a70-b3b7-d7588cc32073","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:51Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e80ee000-720f-49c7-a5f1-5041b03a33b5","error":"provisioning failed: failure deploying resource openshift-ingress/data-science-authn-filter: apply failed networking.istio.io/v1alpha3, Kind=EnvoyFilter: unable to patch networking.istio.io/v1alpha3, Kind=EnvoyFilter openshift-ingress/data-science-authn-filter: Internal error occurred: failed calling webhook \"rev.validation.istio.io\": failed to call webhook: Post \"https://istiod-openshift-gateway.openshift-ingress.svc:443/validate?timeout=10s\": no endpoints available for service \"istiod-openshift-gateway\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:51Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30ae6fd5-bafa-41dd-9c46-565919537b62","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:52Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a9152d41-90df-4626-bda3-436e4011d127","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:52Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df2733c8-5f18-4ede-b781-5d98817e0009","error":"provisioning failed: failure deploying resource openshift-ingress/data-science-authn-filter: apply failed networking.istio.io/v1alpha3, Kind=EnvoyFilter: unable to patch networking.istio.io/v1alpha3, Kind=EnvoyFilter openshift-ingress/data-science-authn-filter: Internal error occurred: failed calling webhook \"rev.validation.istio.io\": failed to call webhook: Post \"https://istiod-openshift-gateway.openshift-ingress.svc:443/validate?timeout=10s\": no endpoints available for service \"istiod-openshift-gateway\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:53Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ff8b9ef5-f13b-4a17-8b17-f9790ea56d7c","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:54Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e64108b-5014-46de-a0c2-ff106080dfe5","error":"provisioning failed: failure deploying resource openshift-ingress/data-science-authn-filter: apply failed networking.istio.io/v1alpha3, Kind=EnvoyFilter: unable to patch networking.istio.io/v1alpha3, Kind=EnvoyFilter openshift-ingress/data-science-authn-filter: Internal error occurred: failed calling webhook \"rev.validation.istio.io\": failed to call webhook: Post \"https://istiod-openshift-gateway.openshift-ingress.svc:443/validate?timeout=10s\": no endpoints available for service \"istiod-openshift-gateway\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:55Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"827ce758-c336-40a2-a6c7-905ec9972105","error":"provisioning failed: failure deploying resource openshift-ingress/data-science-tls-rule: apply failed networking.istio.io/v1, Kind=DestinationRule: unable to patch networking.istio.io/v1, Kind=DestinationRule openshift-ingress/data-science-tls-rule: Internal error occurred: failed calling webhook \"rev.validation.istio.io\": failed to call webhook: Post \"https://istiod-openshift-gateway.openshift-ingress.svc:443/validate?timeout=10s\": no endpoints available for service \"istiod-openshift-gateway\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:55Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"882db0f1-e586-4c63-8822-412ba4e3988b","error":"provisioning failed: failure deploying resource openshift-ingress/data-science-tls-rule: apply failed networking.istio.io/v1, Kind=DestinationRule: unable to patch networking.istio.io/v1, Kind=DestinationRule openshift-ingress/data-science-tls-rule: Internal error occurred: failed calling webhook \"rev.validation.istio.io\": failed to call webhook: Post \"https://istiod-openshift-gateway.openshift-ingress.svc:443/validate?timeout=10s\": no endpoints available for service \"istiod-openshift-gateway\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:56Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"285103af-7627-4387-adb0-949f784346a7","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:43Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcef741e-37e5-477a-9fce-ae32a4d80cb6","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:49Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8260c5cd-8dbe-444d-8881-2c20d0c5b63b","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:49Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"24357fb8-6198-4182-8974-3ee27d123c78","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:50Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"61eb7639-25ee-48e1-8298-c72521edc14c","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:50Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"82c01cf9-7025-489d-bdcf-8e67b033ca27","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:51Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"52b295c7-3946-44ab-8c4a-848049cbd92a","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:52Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a5ca40f3-b797-4641-bc2d-d25e64862133","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:53Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"fd6a5742-7b7b-4d43-a4c8-d67b535d84a1","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:54Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"efaca575-d0ed-4145-ba2f-22ec018344cb","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:56Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcf5d351-72f9-4c74-8ca8-945a83d0d70f","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:58:59Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ff72c9bd-f95e-409d-9c8d-7efaba3ec2c1","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:59:05Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6b1e3eac-e1f3-4a90-a200-b96feb81d2ba","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:59:15Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"719a9733-8b2b-4afc-98bf-d7e0a06e2272","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} --- redhat-ods-operator/rhods-operator-bc98955f6-mp7fj --- {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/convert"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"datasciencecluster.opendatahub.io/v1, Kind=DataScienceCluster"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"dscinitialization.opendatahub.io/v1, Kind=DSCInitialization"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v1"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v2"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-hardware-profile"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-prometheus-monitors"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-isvc"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-llmisvc"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-notebook"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-acceleratorprofile"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-hardwareprofile"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Starting webhook server"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Serving webhook server","host":"","port":9443} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} --------------------------------------------------------------------------------------------------- ==================== OPERATOR POD LOG: rhods-operator-bc98955f6-g4dbc.log ==================== {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"Cluster config","Operator Namespace":"redhat-ods-operator","Application Namespace":"redhat-ods-applications","Release":{"name":"OpenShift AI Self-Managed","version":"3.5.0-ea.1"},"Cluster":{"type":"OpenShift","version":"4.21.24"}} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/convert"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"datasciencecluster.opendatahub.io/v1, Kind=DataScienceCluster"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"dscinitialization.opendatahub.io/v1, Kind=DSCInitialization"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v1"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v2"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-hardware-profile"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-prometheus-monitors"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-isvc"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-llmisvc"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-notebook"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-acceleratorprofile"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-hardwareprofile"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"service","name":"certconfigmapgenerator"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"service","name":"gateway"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"service","name":"monitoring"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"service","name":"setupcontroller"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"service","name":"auth"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"component","name":"ray"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"component","name":"modelcontroller"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"component","name":"trainingoperator"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"component","name":"trustyai"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"component","name":"dashboard"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"component","name":"ogx"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"component","name":"trainer"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"component","name":"kueue"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"component","name":"workbenches"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"component","name":"kserve"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"component","name":"mlflowoperator"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"component","name":"datasciencepipelines"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"component","name":"modelsasservice"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"component","name":"feastoperator"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"component","name":"sparkoperator"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"creating reconciler","type":"component","name":"modelregistry"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"starting manager"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.metrics","msg":"Starting metrics server"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.metrics","msg":"Serving metrics server","bindAddress":"0.0.0.0:8080","secure":false} {"level":"info","ts":"2026-07-15T03:57:33Z","msg":"starting server","name":"health probe","addr":"[::]:8081"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Starting webhook server"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.webhook","msg":"Serving webhook server","host":"","port":9443} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} {"level":"info","ts":"2026-07-15T03:57:33Z","logger":"setup","msg":"Attempting to acquire leader lease...","lock":"redhat-ods-operator/07ed84f7.opendatahub.io"} ==================== OPERATOR POD LOG: rhods-operator-bc98955f6-ml4kv.log ==================== {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"Cluster config","Operator Namespace":"redhat-ods-operator","Application Namespace":"redhat-ods-applications","Release":{"name":"OpenShift AI Self-Managed","version":"3.5.0-ea.1"},"Cluster":{"type":"OpenShift","version":"4.21.24"}} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/convert"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"datasciencecluster.opendatahub.io/v1, Kind=DataScienceCluster"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"dscinitialization.opendatahub.io/v1, Kind=DSCInitialization"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v1"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v2"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-hardware-profile"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-prometheus-monitors"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-isvc"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-llmisvc"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-notebook"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-acceleratorprofile"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-hardwareprofile"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"service","name":"setupcontroller"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"service","name":"auth"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"service","name":"certconfigmapgenerator"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"service","name":"gateway"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"service","name":"monitoring"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"modelcontroller"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"trainingoperator"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"dashboard"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"mlflowoperator"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"trustyai"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"kueue"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"sparkoperator"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"ray"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"modelregistry"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"modelsasservice"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"trainer"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"workbenches"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"kserve"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"ogx"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"feastoperator"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"datasciencepipelines"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"starting manager"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.metrics","msg":"Starting metrics server"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"starting server","name":"health probe","addr":"[::]:8081"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.metrics","msg":"Serving metrics server","bindAddress":"0.0.0.0:8080","secure":false} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Starting webhook server"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"Attempting to acquire leader lease...","lock":"redhat-ods-operator/07ed84f7.opendatahub.io"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Serving webhook server","host":"","port":9443} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"Successfully acquired lease","lock":"redhat-ods-operator/07ed84f7.opendatahub.io"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"cert-configmap-generator-controller","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"cert-configmap-generator-controller","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"cert-configmap-generator-controller","source":"kind source: *v1.PartialObjectMetadata"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"trustyai","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrustyAI","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"Starting EventSource","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"run upgrade task"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"create default DSCI CR"} {"level":"info","ts":"2026-07-15T03:57:33Z","msg":"create default DSCI CR."} {"level":"info","ts":"2026-07-15T03:57:33Z","msg":"Error creating object, retrying...","reason":"Internal error occurred: failed calling webhook \"dscinitialization-v2-validator.opendatahub.io\": failed to call webhook: Post \"https://rhods-operator-service.redhat-ods-operator.svc:443/validate-dscinitialization-v2?timeout=10s\": no endpoints available for service \"rhods-operator-service\""} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Error creating object, retrying...","reason":"Internal error occurred: failed calling webhook \"dscinitialization-v2-validator.opendatahub.io\": failed to call webhook: Post \"https://rhods-operator-service.redhat-ods-operator.svc:443/validate-dscinitialization-v2?timeout=10s\": no endpoints available for service \"rhods-operator-service\""} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"reconcile","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"8e90c235-fa0a-4d40-95a8-3369a1ab4194"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"cert-configmap-generator-controller"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"cert-configmap-generator-controller","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"trustyai","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrustyAI"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"trustyai","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrustyAI","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d344918f-59b6-418e-a6cf-932214814dde"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"7757c6a5-1db6-49b4-85ad-6fdd78b60207"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"mlflowoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"MLflowOperator"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"mlflowoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"MLflowOperator","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","worker count":1} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f0199c56-eeea-4d2f-a84c-b965c5842265"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting Controller","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator"} {"level":"info","ts":"2026-07-15T03:57:35Z","msg":"Starting workers","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","worker count":1} {"level":"info","ts":"2026-07-15T03:57:39Z","msg":"Error creating object, retrying...","reason":"Internal error occurred: failed calling webhook \"dscinitialization-v2-validator.opendatahub.io\": failed to call webhook: Post \"https://rhods-operator-service.redhat-ods-operator.svc:443/validate-dscinitialization-v2?timeout=10s\": no endpoints available for service \"rhods-operator-service\""} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"reconcile","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"4b752544-0493-4479-bea0-6d1342f4c364"} {"level":"info","ts":"2026-07-15T03:57:47Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"bdb400ae-da4f-4ab7-8fb3-f5285aa87788","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:57:47Z","logger":"DSCInitialization","msg":"Adding finalizer for DSCInitialization","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"bdb400ae-da4f-4ab7-8fb3-f5285aa87788","name":"default-dsci","finalizer":"dscinitialization.opendatahub.io/finalizer"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cert-manager","reconcileID":"455085e4-55af-46f3-94a7-f8ee5d4b6b76"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"opendatahub","reconcileID":"7d9306a3-1fd2-4535-b619-7d1ec4d95f36"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"odh-model-registries","reconcileID":"356229ce-ceeb-41f4-8089-306115b2f10a"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"knative-eventing","reconcileID":"5405db82-708f-4c5f-a20e-86101513c5f9"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"redhat-ods-applications","reconcileID":"ec93f1b5-5ad7-4c45-b023-2682992d815f"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"bdb400ae-da4f-4ab7-8fb3-f5285aa87788","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d1f79244-7c43-4e99-a952-95e364e74f04"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"open-cluster-management-3c9a9014-bde8-4e38-b746-7a1dd8b61","reconcileID":"afa3cc40-542a-41bb-b975-42c301cec219"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"knative-serving","reconcileID":"779cab1f-fe7a-428e-afeb-d6d82bbaa627"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"redhat-ods-operator","reconcileID":"d6ceb71a-c584-4ca5-8613-bdb19dbd7a43"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ac364ed5-7a9d-4532-adfc-4a5f157e3c12"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"knative-serving-ingress","reconcileID":"78c78488-59ad-41c5-8693-5ca66c4da640"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cert-manager-operator","reconcileID":"bccd322a-cd7c-4062-a271-b7e53097bb9e"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"kuadrant-system","reconcileID":"5efc7219-5e2f-4da2-9efe-28083b2356de"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"redhat-ods-monitoring","reconcileID":"0990699b-b3ab-4e96-974e-e3eda4de65fe"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fab098af-59f2-4898-af26-f154a8769a8b"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"06f1488f-3499-4a2e-a57e-89b499b28214"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ad3c4cda-3421-48db-82bb-52dfeab7f7f9"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"rhoai-model-registries","reconcileID":"a305d9e6-6d14-4adf-8677-489f5ece290d"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"open-cluster-management-agent-addon","reconcileID":"7779f498-f957-4cd1-9e7a-426f0b93e023"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"kyverno","reconcileID":"1899f370-c346-439c-90c8-c6f7da6e2ad0"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ddb5c742-dc55-43d8-b156-e5b9e2041bd7"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ddb5c742-dc55-43d8-b156-e5b9e2041bd7"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ddb5c742-dc55-43d8-b156-e5b9e2041bd7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ddb5c742-dc55-43d8-b156-e5b9e2041bd7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ddb5c742-dc55-43d8-b156-e5b9e2041bd7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ddb5c742-dc55-43d8-b156-e5b9e2041bd7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ddb5c742-dc55-43d8-b156-e5b9e2041bd7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ddb5c742-dc55-43d8-b156-e5b9e2041bd7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ddb5c742-dc55-43d8-b156-e5b9e2041bd7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ddb5c742-dc55-43d8-b156-e5b9e2041bd7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ddb5c742-dc55-43d8-b156-e5b9e2041bd7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cert-manager","reconcileID":"0c2eb952-1b5b-456e-bbbc-1155d1315d38"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ddb5c742-dc55-43d8-b156-e5b9e2041bd7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ddb5c742-dc55-43d8-b156-e5b9e2041bd7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ddb5c742-dc55-43d8-b156-e5b9e2041bd7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ddb5c742-dc55-43d8-b156-e5b9e2041bd7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"opendatahub","reconcileID":"e14e19fb-2e31-49c7-adb9-b30869e45e0f"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"reconcile","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"f6daf796-8c59-4b62-85b2-733d9453553f"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"apply","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"f6daf796-8c59-4b62-85b2-733d9453553f"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"f6daf796-8c59-4b62-85b2-733d9453553f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.initialize"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"f6daf796-8c59-4b62-85b2-733d9453553f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"odh-model-registries","reconcileID":"6b5225b5-8054-42b4-a78a-9d9f7e29ec26"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"f6daf796-8c59-4b62-85b2-733d9453553f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.createDefaultGroup"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fbf9e7c0-9310-4bbe-a56c-36e7afe20607"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ddb5c742-dc55-43d8-b156-e5b9e2041bd7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ddb5c742-dc55-43d8-b156-e5b9e2041bd7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fbf9e7c0-9310-4bbe-a56c-36e7afe20607"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fbf9e7c0-9310-4bbe-a56c-36e7afe20607","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fbf9e7c0-9310-4bbe-a56c-36e7afe20607","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:47Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"d2a2adea-f06b-48f6-8d4e-767e68e46d4a","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"d2a2adea-f06b-48f6-8d4e-767e68e46d4a","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"knative-eventing","reconcileID":"ed79ac86-eef8-4f21-a5c5-c7e1243cacd9"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"redhat-ods-applications","reconcileID":"6a1c609d-04f4-4740-b7c5-336d814efba0"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fbf9e7c0-9310-4bbe-a56c-36e7afe20607","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fbf9e7c0-9310-4bbe-a56c-36e7afe20607","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fbf9e7c0-9310-4bbe-a56c-36e7afe20607","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fbf9e7c0-9310-4bbe-a56c-36e7afe20607","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fbf9e7c0-9310-4bbe-a56c-36e7afe20607","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fbf9e7c0-9310-4bbe-a56c-36e7afe20607","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"f6daf796-8c59-4b62-85b2-733d9453553f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions"} {"level":"info","ts":"2026-07-15T03:57:47Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions","msg":"namespace not found, skipping RoleBinding creation","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"f6daf796-8c59-4b62-85b2-733d9453553f","namespace":"models-as-a-service","roleBinding":"data-science-admingroup-maas-rolebinding"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"f6daf796-8c59-4b62-85b2-733d9453553f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"open-cluster-management-3c9a9014-bde8-4e38-b746-7a1dd8b61","reconcileID":"cfef3c72-0a45-486b-954f-0fbd5d8ce598"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"knative-serving","reconcileID":"f9ac8e19-be43-40cd-bf92-f8affb0890ea"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"redhat-ods-operator","reconcileID":"b787af29-9575-4727-afe5-bd5b6470de98"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"knative-serving-ingress","reconcileID":"3d1d0662-32ee-4097-83a8-8fe9cb4f1e93"} {"level":"info","ts":"2026-07-15T03:57:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cert-manager-operator","reconcileID":"0689046f-5713-4294-8807-f486e4544874"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"kuadrant-system","reconcileID":"0787d44a-ae64-4845-bcc7-3cd23d41fbf3"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"redhat-ods-monitoring","reconcileID":"0fd5e7dc-ebe3-4f11-a5db-806c55473193"} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fbf9e7c0-9310-4bbe-a56c-36e7afe20607","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5263223d-14f9-4f1d-956b-b606045e2a18"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5263223d-14f9-4f1d-956b-b606045e2a18"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5263223d-14f9-4f1d-956b-b606045e2a18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5263223d-14f9-4f1d-956b-b606045e2a18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"rhoai-model-registries","reconcileID":"cc58f3cd-bc92-4c5c-bd7b-bf993bd088b0"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"open-cluster-management-agent-addon","reconcileID":"ad7b7970-b5e5-467e-9d38-7be3687f3cf8"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"kyverno","reconcileID":"5220dd62-483f-4b46-a732-86125775d84b"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"f6daf796-8c59-4b62-85b2-733d9453553f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5263223d-14f9-4f1d-956b-b606045e2a18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5263223d-14f9-4f1d-956b-b606045e2a18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5263223d-14f9-4f1d-956b-b606045e2a18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5263223d-14f9-4f1d-956b-b606045e2a18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5263223d-14f9-4f1d-956b-b606045e2a18","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5263223d-14f9-4f1d-956b-b606045e2a18","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"knative-eventing","reconcileID":"cbd2d280-8660-4ec9-985f-8ed75803a55f"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"redhat-ods-monitoring","reconcileID":"4a42af16-159d-4a02-b24e-d338252a5740"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"rhoai-model-registries","reconcileID":"dfc80641-1c9a-48ff-8a96-a046f046fe68"} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5263223d-14f9-4f1d-956b-b606045e2a18","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f5adea62-43ff-4228-bbac-069ed4845fbb"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f5adea62-43ff-4228-bbac-069ed4845fbb"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f5adea62-43ff-4228-bbac-069ed4845fbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f5adea62-43ff-4228-bbac-069ed4845fbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f5adea62-43ff-4228-bbac-069ed4845fbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f5adea62-43ff-4228-bbac-069ed4845fbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f5adea62-43ff-4228-bbac-069ed4845fbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f5adea62-43ff-4228-bbac-069ed4845fbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f5adea62-43ff-4228-bbac-069ed4845fbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f5adea62-43ff-4228-bbac-069ed4845fbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f5adea62-43ff-4228-bbac-069ed4845fbb","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b5d0dfc-45b5-47ab-aaa3-ca8f9adce583"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b5d0dfc-45b5-47ab-aaa3-ca8f9adce583"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b5d0dfc-45b5-47ab-aaa3-ca8f9adce583","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b5d0dfc-45b5-47ab-aaa3-ca8f9adce583","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b5d0dfc-45b5-47ab-aaa3-ca8f9adce583","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b5d0dfc-45b5-47ab-aaa3-ca8f9adce583","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b5d0dfc-45b5-47ab-aaa3-ca8f9adce583","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b5d0dfc-45b5-47ab-aaa3-ca8f9adce583","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b5d0dfc-45b5-47ab-aaa3-ca8f9adce583","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b5d0dfc-45b5-47ab-aaa3-ca8f9adce583","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b5d0dfc-45b5-47ab-aaa3-ca8f9adce583","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"70aa8f7a-dffe-4fcd-9a48-021df25e720d"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"70aa8f7a-dffe-4fcd-9a48-021df25e720d"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"70aa8f7a-dffe-4fcd-9a48-021df25e720d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"70aa8f7a-dffe-4fcd-9a48-021df25e720d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"open-cluster-management-agent-addon","reconcileID":"522b7ced-dd14-4e56-a576-2c9016547f0c"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"70aa8f7a-dffe-4fcd-9a48-021df25e720d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"70aa8f7a-dffe-4fcd-9a48-021df25e720d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"70aa8f7a-dffe-4fcd-9a48-021df25e720d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"70aa8f7a-dffe-4fcd-9a48-021df25e720d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"70aa8f7a-dffe-4fcd-9a48-021df25e720d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"70aa8f7a-dffe-4fcd-9a48-021df25e720d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"70aa8f7a-dffe-4fcd-9a48-021df25e720d","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"16bed4f4-32ce-441c-a69b-3edd60caa775"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"16bed4f4-32ce-441c-a69b-3edd60caa775"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"16bed4f4-32ce-441c-a69b-3edd60caa775","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"16bed4f4-32ce-441c-a69b-3edd60caa775","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"16bed4f4-32ce-441c-a69b-3edd60caa775","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"16bed4f4-32ce-441c-a69b-3edd60caa775","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"16bed4f4-32ce-441c-a69b-3edd60caa775","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"16bed4f4-32ce-441c-a69b-3edd60caa775","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"16bed4f4-32ce-441c-a69b-3edd60caa775","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"16bed4f4-32ce-441c-a69b-3edd60caa775","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"16bed4f4-32ce-441c-a69b-3edd60caa775","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:48Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ddb5c742-dc55-43d8-b156-e5b9e2041bd7"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ddb5c742-dc55-43d8-b156-e5b9e2041bd7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"kyverno","reconcileID":"b6a382d7-6e2b-424d-91f7-cf417364aa84"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e3262e4f-ff21-42b4-b40c-571297fa785f"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e3262e4f-ff21-42b4-b40c-571297fa785f"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e3262e4f-ff21-42b4-b40c-571297fa785f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e3262e4f-ff21-42b4-b40c-571297fa785f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e3262e4f-ff21-42b4-b40c-571297fa785f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e3262e4f-ff21-42b4-b40c-571297fa785f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e3262e4f-ff21-42b4-b40c-571297fa785f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e3262e4f-ff21-42b4-b40c-571297fa785f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e3262e4f-ff21-42b4-b40c-571297fa785f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e3262e4f-ff21-42b4-b40c-571297fa785f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-15T03:57:48Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e3262e4f-ff21-42b4-b40c-571297fa785f","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6c4ed2d5-6a25-4a8b-b2bb-bb2a117b4560"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6c4ed2d5-6a25-4a8b-b2bb-bb2a117b4560"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6c4ed2d5-6a25-4a8b-b2bb-bb2a117b4560","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:48Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"36efa0ef-4e12-4762-9ec0-59e43e207810","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6c4ed2d5-6a25-4a8b-b2bb-bb2a117b4560","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6c4ed2d5-6a25-4a8b-b2bb-bb2a117b4560","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6c4ed2d5-6a25-4a8b-b2bb-bb2a117b4560","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6c4ed2d5-6a25-4a8b-b2bb-bb2a117b4560","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6c4ed2d5-6a25-4a8b-b2bb-bb2a117b4560","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6c4ed2d5-6a25-4a8b-b2bb-bb2a117b4560","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6c4ed2d5-6a25-4a8b-b2bb-bb2a117b4560","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6c4ed2d5-6a25-4a8b-b2bb-bb2a117b4560","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"36efa0ef-4e12-4762-9ec0-59e43e207810","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6c4ed2d5-6a25-4a8b-b2bb-bb2a117b4560","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6c4ed2d5-6a25-4a8b-b2bb-bb2a117b4560","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6c4ed2d5-6a25-4a8b-b2bb-bb2a117b4560","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6c4ed2d5-6a25-4a8b-b2bb-bb2a117b4560","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:48Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"f6daf796-8c59-4b62-85b2-733d9453553f"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6c4ed2d5-6a25-4a8b-b2bb-bb2a117b4560","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6c4ed2d5-6a25-4a8b-b2bb-bb2a117b4560","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6c4ed2d5-6a25-4a8b-b2bb-bb2a117b4560","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"f6daf796-8c59-4b62-85b2-733d9453553f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:57:49Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"fc1e1db9-6dd3-44ab-a4dc-85848958652f","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"fc1e1db9-6dd3-44ab-a4dc-85848958652f","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"24f71753-9f5c-4607-9c11-e145f51e66ce"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"apply","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"24f71753-9f5c-4607-9c11-e145f51e66ce"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"24f71753-9f5c-4607-9c11-e145f51e66ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.initialize"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"24f71753-9f5c-4607-9c11-e145f51e66ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"24f71753-9f5c-4607-9c11-e145f51e66ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.createDefaultGroup"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"24f71753-9f5c-4607-9c11-e145f51e66ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions"} {"level":"info","ts":"2026-07-15T03:57:49Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions","msg":"namespace not found, skipping RoleBinding creation","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"24f71753-9f5c-4607-9c11-e145f51e66ce","namespace":"models-as-a-service","roleBinding":"data-science-admingroup-maas-rolebinding"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"24f71753-9f5c-4607-9c11-e145f51e66ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"24f71753-9f5c-4607-9c11-e145f51e66ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"24f71753-9f5c-4607-9c11-e145f51e66ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"417e6d7c-8162-45bc-80e5-8b3fa17a3d25"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8bb8de54-67e7-45c4-a9a7-76200527c8f8"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"3c2d792a-6f59-43de-921d-af0ccde708e9"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5f4e84c0-6eee-45d5-aa3b-38d9338fb065"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"dcf12335-7746-437b-9f47-c5d7aa5ad122"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"c8bad213-89c7-4008-82bb-14ed08671fc1"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"c6d57c6d-328f-43ae-99c4-8c5fb9c9fa73"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"fd9e7d0d-c18a-4fb9-8eef-83396283c91a"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a9de69c9-1c1c-4168-9f4d-296b4f893ff7"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a9e626e3-62db-4cce-a1dd-fc760aa003a9"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a9e626e3-62db-4cce-a1dd-fc760aa003a9"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a9e626e3-62db-4cce-a1dd-fc760aa003a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"585ff458-e00b-4767-bb00-8898c987973b"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a9e626e3-62db-4cce-a1dd-fc760aa003a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9b3dec83-3860-4e0d-a39a-376df18f2f52"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"59f9c843-9d78-4b8b-b11e-f7518bb635dd"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a9e626e3-62db-4cce-a1dd-fc760aa003a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a9e626e3-62db-4cce-a1dd-fc760aa003a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a9e626e3-62db-4cce-a1dd-fc760aa003a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a9e626e3-62db-4cce-a1dd-fc760aa003a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a9e626e3-62db-4cce-a1dd-fc760aa003a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a9e626e3-62db-4cce-a1dd-fc760aa003a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"da9ae0f0-0676-40e7-9412-6310c23f6694"} {"level":"error","ts":"2026-07-15T03:57:49Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a9e626e3-62db-4cce-a1dd-fc760aa003a9","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"e9e96683-1fcd-4f06-9e7f-4aea290f0577"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"3864cecc-d5c3-4d20-aa86-0cce00280303"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"83a8d09b-8d7a-4eb1-a05b-9f94fa3e74a8"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9aff703d-beeb-4084-88d8-411597d0d63a"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6d1f5c50-7b13-4381-a7d8-84795fdba44a"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"45990162-1610-4153-b62a-2421007a6a58"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ed57e787-b741-4d59-a751-f5385960550a"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"e286cc6d-c69b-47c1-aea3-c373e2ebdf00"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"690631f5-4226-4dbb-bc2f-3d9907874cc6"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"4b539efa-9921-45c7-97f5-eb99821d3487"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f45fcd71-dbf4-4f68-bd7a-493d65be82e5"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f0abf5b9-7b5c-44db-8fda-0b0158d04e8b"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"12a39206-bb58-4baa-9480-5ab9b6c71956"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"231bbb64-5421-47ed-a539-956600fcfc54"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f04a5a6f-ddb9-4a28-b2c8-2c7b07ef8866"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7d0caf5b-f900-46cc-942c-09ce542e0157"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"02c6c448-231c-4822-a5d9-6a34dc8dc417"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"1f78824a-ac87-4658-ae2a-0a48ee472a99"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"3cbcdfce-1b3d-4f68-8f83-b513bb3160d3"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"86d28534-95f0-48b6-a8a4-e10336038b39"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a86eb634-7b8f-4d83-9c1a-d571ea8dcc5f"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8cd0ecf1-b2fe-4ee2-9871-940c624526ad"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"51c44e5c-8f9b-4d23-a53a-f36fa7a1629f"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5c7b5ba0-5daa-4949-9dad-dfc2ef4c17fc"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"e99f9a3d-aae4-4e19-93ba-caf21bbe4a2b"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2e0e506f-f92b-47d1-80bf-addc10c7488c"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7296d5f2-5533-4a32-8610-5822a739f168"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6d5774db-9076-48e7-a5b5-4af4fb739cc1"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"de7f6587-1712-4da2-b189-4ea1dfb839d0"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"741c9d46-7c17-4df4-beb9-3578bfe87368"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"741c9d46-7c17-4df4-beb9-3578bfe87368"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"741c9d46-7c17-4df4-beb9-3578bfe87368","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"741c9d46-7c17-4df4-beb9-3578bfe87368","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"741c9d46-7c17-4df4-beb9-3578bfe87368","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"741c9d46-7c17-4df4-beb9-3578bfe87368","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"741c9d46-7c17-4df4-beb9-3578bfe87368","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"741c9d46-7c17-4df4-beb9-3578bfe87368","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"741c9d46-7c17-4df4-beb9-3578bfe87368","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"741c9d46-7c17-4df4-beb9-3578bfe87368","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"741c9d46-7c17-4df4-beb9-3578bfe87368","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"741c9d46-7c17-4df4-beb9-3578bfe87368","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"741c9d46-7c17-4df4-beb9-3578bfe87368","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"741c9d46-7c17-4df4-beb9-3578bfe87368","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"741c9d46-7c17-4df4-beb9-3578bfe87368","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"741c9d46-7c17-4df4-beb9-3578bfe87368","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"741c9d46-7c17-4df4-beb9-3578bfe87368","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"741c9d46-7c17-4df4-beb9-3578bfe87368","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e80ee000-720f-49c7-a5f1-5041b03a33b5"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e80ee000-720f-49c7-a5f1-5041b03a33b5"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e80ee000-720f-49c7-a5f1-5041b03a33b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:49Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e80ee000-720f-49c7-a5f1-5041b03a33b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e80ee000-720f-49c7-a5f1-5041b03a33b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e80ee000-720f-49c7-a5f1-5041b03a33b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e80ee000-720f-49c7-a5f1-5041b03a33b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e80ee000-720f-49c7-a5f1-5041b03a33b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e80ee000-720f-49c7-a5f1-5041b03a33b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e80ee000-720f-49c7-a5f1-5041b03a33b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5b96ccd6-ecbb-4306-8b41-7796d3fe8603"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5b96ccd6-ecbb-4306-8b41-7796d3fe8603"} {"level":"info","ts":"2026-07-15T03:57:50Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c9c35d2f-3499-458b-a74d-ac0b2b5be063","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5b96ccd6-ecbb-4306-8b41-7796d3fe8603","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5b96ccd6-ecbb-4306-8b41-7796d3fe8603","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5b96ccd6-ecbb-4306-8b41-7796d3fe8603","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5b96ccd6-ecbb-4306-8b41-7796d3fe8603","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5b96ccd6-ecbb-4306-8b41-7796d3fe8603","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5b96ccd6-ecbb-4306-8b41-7796d3fe8603","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5b96ccd6-ecbb-4306-8b41-7796d3fe8603","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5b96ccd6-ecbb-4306-8b41-7796d3fe8603","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5b96ccd6-ecbb-4306-8b41-7796d3fe8603","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c9c35d2f-3499-458b-a74d-ac0b2b5be063","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5b96ccd6-ecbb-4306-8b41-7796d3fe8603","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5b96ccd6-ecbb-4306-8b41-7796d3fe8603","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5b96ccd6-ecbb-4306-8b41-7796d3fe8603","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5b96ccd6-ecbb-4306-8b41-7796d3fe8603","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5b96ccd6-ecbb-4306-8b41-7796d3fe8603","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5b96ccd6-ecbb-4306-8b41-7796d3fe8603","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5b96ccd6-ecbb-4306-8b41-7796d3fe8603","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:57:50Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e830f48b-5c16-496e-813f-a363d15cb9c6","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e830f48b-5c16-496e-813f-a363d15cb9c6","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"48dfe5ec-929b-484c-9b8a-1dbeb3b537af"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b7c2649c-6080-441b-8378-f94a42bb3d31"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b7c2649c-6080-441b-8378-f94a42bb3d31"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b7c2649c-6080-441b-8378-f94a42bb3d31","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b7c2649c-6080-441b-8378-f94a42bb3d31","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b7c2649c-6080-441b-8378-f94a42bb3d31","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b7c2649c-6080-441b-8378-f94a42bb3d31","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b7c2649c-6080-441b-8378-f94a42bb3d31","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b7c2649c-6080-441b-8378-f94a42bb3d31","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b7c2649c-6080-441b-8378-f94a42bb3d31","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b7c2649c-6080-441b-8378-f94a42bb3d31","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b7c2649c-6080-441b-8378-f94a42bb3d31","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"48dfe5ec-929b-484c-9b8a-1dbeb3b537af"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"48dfe5ec-929b-484c-9b8a-1dbeb3b537af","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"48dfe5ec-929b-484c-9b8a-1dbeb3b537af","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"48dfe5ec-929b-484c-9b8a-1dbeb3b537af","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"48dfe5ec-929b-484c-9b8a-1dbeb3b537af","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b7c2649c-6080-441b-8378-f94a42bb3d31","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b7c2649c-6080-441b-8378-f94a42bb3d31","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b7c2649c-6080-441b-8378-f94a42bb3d31","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b7c2649c-6080-441b-8378-f94a42bb3d31","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b7c2649c-6080-441b-8378-f94a42bb3d31","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b7c2649c-6080-441b-8378-f94a42bb3d31","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b7c2649c-6080-441b-8378-f94a42bb3d31","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-15T03:57:50Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"48dfe5ec-929b-484c-9b8a-1dbeb3b537af","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f6d1224c-64f0-424b-bd12-3d09d8282652"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f6d1224c-64f0-424b-bd12-3d09d8282652"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f6d1224c-64f0-424b-bd12-3d09d8282652","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f6d1224c-64f0-424b-bd12-3d09d8282652","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f6d1224c-64f0-424b-bd12-3d09d8282652","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f6d1224c-64f0-424b-bd12-3d09d8282652","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"error","ts":"2026-07-15T03:57:50Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f6d1224c-64f0-424b-bd12-3d09d8282652","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c44824c1-8e0c-49a0-ab91-d8ad5d440aad"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c44824c1-8e0c-49a0-ab91-d8ad5d440aad"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c44824c1-8e0c-49a0-ab91-d8ad5d440aad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c44824c1-8e0c-49a0-ab91-d8ad5d440aad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c44824c1-8e0c-49a0-ab91-d8ad5d440aad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c44824c1-8e0c-49a0-ab91-d8ad5d440aad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"error","ts":"2026-07-15T03:57:50Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c44824c1-8e0c-49a0-ab91-d8ad5d440aad","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2d23357c-c01b-4ea3-943a-57ec1b558db0"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2d23357c-c01b-4ea3-943a-57ec1b558db0"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2d23357c-c01b-4ea3-943a-57ec1b558db0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2d23357c-c01b-4ea3-943a-57ec1b558db0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2d23357c-c01b-4ea3-943a-57ec1b558db0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2d23357c-c01b-4ea3-943a-57ec1b558db0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"error","ts":"2026-07-15T03:57:50Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2d23357c-c01b-4ea3-943a-57ec1b558db0","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7728f746-9716-44c3-a219-2a73f8e75526"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7728f746-9716-44c3-a219-2a73f8e75526"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7728f746-9716-44c3-a219-2a73f8e75526","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7728f746-9716-44c3-a219-2a73f8e75526","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7728f746-9716-44c3-a219-2a73f8e75526","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7728f746-9716-44c3-a219-2a73f8e75526","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7728f746-9716-44c3-a219-2a73f8e75526","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7728f746-9716-44c3-a219-2a73f8e75526","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7728f746-9716-44c3-a219-2a73f8e75526","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7728f746-9716-44c3-a219-2a73f8e75526","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:57:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7728f746-9716-44c3-a219-2a73f8e75526","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d4324293-c8a3-4709-bc59-698525b9bb30"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d4324293-c8a3-4709-bc59-698525b9bb30"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d4324293-c8a3-4709-bc59-698525b9bb30","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d4324293-c8a3-4709-bc59-698525b9bb30","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d4324293-c8a3-4709-bc59-698525b9bb30","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d4324293-c8a3-4709-bc59-698525b9bb30","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7728f746-9716-44c3-a219-2a73f8e75526","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7728f746-9716-44c3-a219-2a73f8e75526","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7728f746-9716-44c3-a219-2a73f8e75526","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7728f746-9716-44c3-a219-2a73f8e75526","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7728f746-9716-44c3-a219-2a73f8e75526","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7728f746-9716-44c3-a219-2a73f8e75526","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7728f746-9716-44c3-a219-2a73f8e75526","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-15T03:57:51Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d4324293-c8a3-4709-bc59-698525b9bb30","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"738df755-8d0f-4629-ae21-2717912b68be"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"738df755-8d0f-4629-ae21-2717912b68be"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"738df755-8d0f-4629-ae21-2717912b68be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"738df755-8d0f-4629-ae21-2717912b68be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"738df755-8d0f-4629-ae21-2717912b68be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"738df755-8d0f-4629-ae21-2717912b68be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"error","ts":"2026-07-15T03:57:51Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"738df755-8d0f-4629-ae21-2717912b68be","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c42f8f0d-643a-49e5-aa44-84dfffdfa34d"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c42f8f0d-643a-49e5-aa44-84dfffdfa34d"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c42f8f0d-643a-49e5-aa44-84dfffdfa34d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c42f8f0d-643a-49e5-aa44-84dfffdfa34d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c42f8f0d-643a-49e5-aa44-84dfffdfa34d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c42f8f0d-643a-49e5-aa44-84dfffdfa34d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c42f8f0d-643a-49e5-aa44-84dfffdfa34d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c42f8f0d-643a-49e5-aa44-84dfffdfa34d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c42f8f0d-643a-49e5-aa44-84dfffdfa34d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c42f8f0d-643a-49e5-aa44-84dfffdfa34d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c42f8f0d-643a-49e5-aa44-84dfffdfa34d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:57:51Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c93a5e4c-a564-47f7-bb00-c69c2db248a6","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c93a5e4c-a564-47f7-bb00-c69c2db248a6","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c42f8f0d-643a-49e5-aa44-84dfffdfa34d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c42f8f0d-643a-49e5-aa44-84dfffdfa34d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c42f8f0d-643a-49e5-aa44-84dfffdfa34d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c42f8f0d-643a-49e5-aa44-84dfffdfa34d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c42f8f0d-643a-49e5-aa44-84dfffdfa34d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c42f8f0d-643a-49e5-aa44-84dfffdfa34d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c42f8f0d-643a-49e5-aa44-84dfffdfa34d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:57:51Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"b84044b6-25ca-443a-b501-0035bac5374d","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"b84044b6-25ca-443a-b501-0035bac5374d","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"cd4d4cfe-5d65-4a70-b3b7-d7588cc32073"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"cd4d4cfe-5d65-4a70-b3b7-d7588cc32073"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"cd4d4cfe-5d65-4a70-b3b7-d7588cc32073","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"cd4d4cfe-5d65-4a70-b3b7-d7588cc32073","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"cd4d4cfe-5d65-4a70-b3b7-d7588cc32073","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"cd4d4cfe-5d65-4a70-b3b7-d7588cc32073","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"error","ts":"2026-07-15T03:57:51Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"cd4d4cfe-5d65-4a70-b3b7-d7588cc32073","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-15T03:57:51Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e80ee000-720f-49c7-a5f1-5041b03a33b5","error":"provisioning failed: failure deploying resource openshift-ingress/data-science-authn-filter: apply failed networking.istio.io/v1alpha3, Kind=EnvoyFilter: unable to patch networking.istio.io/v1alpha3, Kind=EnvoyFilter openshift-ingress/data-science-authn-filter: Internal error occurred: failed calling webhook \"rev.validation.istio.io\": failed to call webhook: Post \"https://istiod-openshift-gateway.openshift-ingress.svc:443/validate?timeout=10s\": no endpoints available for service \"istiod-openshift-gateway\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30ae6fd5-bafa-41dd-9c46-565919537b62"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30ae6fd5-bafa-41dd-9c46-565919537b62"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30ae6fd5-bafa-41dd-9c46-565919537b62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30ae6fd5-bafa-41dd-9c46-565919537b62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30ae6fd5-bafa-41dd-9c46-565919537b62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:57:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30ae6fd5-bafa-41dd-9c46-565919537b62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"error","ts":"2026-07-15T03:57:51Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30ae6fd5-bafa-41dd-9c46-565919537b62","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:52Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a9152d41-90df-4626-bda3-436e4011d127"} {"level":"info","ts":"2026-07-15T03:57:52Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a9152d41-90df-4626-bda3-436e4011d127"} {"level":"info","ts":"2026-07-15T03:57:52Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a9152d41-90df-4626-bda3-436e4011d127","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:57:52Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a9152d41-90df-4626-bda3-436e4011d127","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:57:52Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a9152d41-90df-4626-bda3-436e4011d127","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:57:52Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a9152d41-90df-4626-bda3-436e4011d127","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"error","ts":"2026-07-15T03:57:52Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a9152d41-90df-4626-bda3-436e4011d127","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:52Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df2733c8-5f18-4ede-b781-5d98817e0009"} {"level":"info","ts":"2026-07-15T03:57:52Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df2733c8-5f18-4ede-b781-5d98817e0009"} {"level":"info","ts":"2026-07-15T03:57:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df2733c8-5f18-4ede-b781-5d98817e0009","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df2733c8-5f18-4ede-b781-5d98817e0009","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df2733c8-5f18-4ede-b781-5d98817e0009","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:57:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df2733c8-5f18-4ede-b781-5d98817e0009","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:57:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df2733c8-5f18-4ede-b781-5d98817e0009","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:57:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df2733c8-5f18-4ede-b781-5d98817e0009","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:57:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df2733c8-5f18-4ede-b781-5d98817e0009","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df2733c8-5f18-4ede-b781-5d98817e0009","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-15T03:57:52Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df2733c8-5f18-4ede-b781-5d98817e0009","error":"provisioning failed: failure deploying resource openshift-ingress/data-science-authn-filter: apply failed networking.istio.io/v1alpha3, Kind=EnvoyFilter: unable to patch networking.istio.io/v1alpha3, Kind=EnvoyFilter openshift-ingress/data-science-authn-filter: Internal error occurred: failed calling webhook \"rev.validation.istio.io\": failed to call webhook: Post \"https://istiod-openshift-gateway.openshift-ingress.svc:443/validate?timeout=10s\": no endpoints available for service \"istiod-openshift-gateway\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:53Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ff8b9ef5-f13b-4a17-8b17-f9790ea56d7c"} {"level":"info","ts":"2026-07-15T03:57:53Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ff8b9ef5-f13b-4a17-8b17-f9790ea56d7c"} {"level":"info","ts":"2026-07-15T03:57:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ff8b9ef5-f13b-4a17-8b17-f9790ea56d7c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:57:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ff8b9ef5-f13b-4a17-8b17-f9790ea56d7c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:57:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ff8b9ef5-f13b-4a17-8b17-f9790ea56d7c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:57:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ff8b9ef5-f13b-4a17-8b17-f9790ea56d7c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"error","ts":"2026-07-15T03:57:53Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ff8b9ef5-f13b-4a17-8b17-f9790ea56d7c","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"65777326-4002-4d20-9a8b-35d1e5907dae"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"65777326-4002-4d20-9a8b-35d1e5907dae"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"65777326-4002-4d20-9a8b-35d1e5907dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"65777326-4002-4d20-9a8b-35d1e5907dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"65777326-4002-4d20-9a8b-35d1e5907dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"65777326-4002-4d20-9a8b-35d1e5907dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"65777326-4002-4d20-9a8b-35d1e5907dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"65777326-4002-4d20-9a8b-35d1e5907dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"65777326-4002-4d20-9a8b-35d1e5907dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"65777326-4002-4d20-9a8b-35d1e5907dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"65777326-4002-4d20-9a8b-35d1e5907dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"65777326-4002-4d20-9a8b-35d1e5907dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"65777326-4002-4d20-9a8b-35d1e5907dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"65777326-4002-4d20-9a8b-35d1e5907dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"65777326-4002-4d20-9a8b-35d1e5907dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"65777326-4002-4d20-9a8b-35d1e5907dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"65777326-4002-4d20-9a8b-35d1e5907dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"65777326-4002-4d20-9a8b-35d1e5907dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3abeca2d-10b1-4f35-bf4b-9a52d329f721"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3abeca2d-10b1-4f35-bf4b-9a52d329f721"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3abeca2d-10b1-4f35-bf4b-9a52d329f721","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3abeca2d-10b1-4f35-bf4b-9a52d329f721","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3abeca2d-10b1-4f35-bf4b-9a52d329f721","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3abeca2d-10b1-4f35-bf4b-9a52d329f721","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3abeca2d-10b1-4f35-bf4b-9a52d329f721","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3abeca2d-10b1-4f35-bf4b-9a52d329f721","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3abeca2d-10b1-4f35-bf4b-9a52d329f721","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3abeca2d-10b1-4f35-bf4b-9a52d329f721","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3abeca2d-10b1-4f35-bf4b-9a52d329f721","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:57:54Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"64e71f93-649f-4c59-a7af-29580291a389","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"64e71f93-649f-4c59-a7af-29580291a389","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3abeca2d-10b1-4f35-bf4b-9a52d329f721","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3abeca2d-10b1-4f35-bf4b-9a52d329f721","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3abeca2d-10b1-4f35-bf4b-9a52d329f721","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3abeca2d-10b1-4f35-bf4b-9a52d329f721","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3abeca2d-10b1-4f35-bf4b-9a52d329f721","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3abeca2d-10b1-4f35-bf4b-9a52d329f721","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3abeca2d-10b1-4f35-bf4b-9a52d329f721","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e64108b-5014-46de-a0c2-ff106080dfe5"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e64108b-5014-46de-a0c2-ff106080dfe5"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e64108b-5014-46de-a0c2-ff106080dfe5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e64108b-5014-46de-a0c2-ff106080dfe5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e64108b-5014-46de-a0c2-ff106080dfe5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e64108b-5014-46de-a0c2-ff106080dfe5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e64108b-5014-46de-a0c2-ff106080dfe5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e64108b-5014-46de-a0c2-ff106080dfe5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e64108b-5014-46de-a0c2-ff106080dfe5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e64108b-5014-46de-a0c2-ff106080dfe5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1c5ba4d5-9c61-41b5-83b2-b2995c6a48d3"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1c5ba4d5-9c61-41b5-83b2-b2995c6a48d3"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1c5ba4d5-9c61-41b5-83b2-b2995c6a48d3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1c5ba4d5-9c61-41b5-83b2-b2995c6a48d3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1c5ba4d5-9c61-41b5-83b2-b2995c6a48d3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1c5ba4d5-9c61-41b5-83b2-b2995c6a48d3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1c5ba4d5-9c61-41b5-83b2-b2995c6a48d3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1c5ba4d5-9c61-41b5-83b2-b2995c6a48d3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1c5ba4d5-9c61-41b5-83b2-b2995c6a48d3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1c5ba4d5-9c61-41b5-83b2-b2995c6a48d3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1c5ba4d5-9c61-41b5-83b2-b2995c6a48d3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1c5ba4d5-9c61-41b5-83b2-b2995c6a48d3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1c5ba4d5-9c61-41b5-83b2-b2995c6a48d3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1c5ba4d5-9c61-41b5-83b2-b2995c6a48d3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1c5ba4d5-9c61-41b5-83b2-b2995c6a48d3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1c5ba4d5-9c61-41b5-83b2-b2995c6a48d3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1c5ba4d5-9c61-41b5-83b2-b2995c6a48d3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1c5ba4d5-9c61-41b5-83b2-b2995c6a48d3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-15T03:57:54Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e64108b-5014-46de-a0c2-ff106080dfe5","error":"provisioning failed: failure deploying resource openshift-ingress/data-science-authn-filter: apply failed networking.istio.io/v1alpha3, Kind=EnvoyFilter: unable to patch networking.istio.io/v1alpha3, Kind=EnvoyFilter openshift-ingress/data-science-authn-filter: Internal error occurred: failed calling webhook \"rev.validation.istio.io\": failed to call webhook: Post \"https://istiod-openshift-gateway.openshift-ingress.svc:443/validate?timeout=10s\": no endpoints available for service \"istiod-openshift-gateway\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"827ce758-c336-40a2-a6c7-905ec9972105"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"827ce758-c336-40a2-a6c7-905ec9972105"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"827ce758-c336-40a2-a6c7-905ec9972105","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:54Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure.detectAndSetIngressMode","msg":"Detected ingress mode from existing Gateway Service","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"827ce758-c336-40a2-a6c7-905ec9972105","mode":"OcpRoute"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"827ce758-c336-40a2-a6c7-905ec9972105","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"827ce758-c336-40a2-a6c7-905ec9972105","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"827ce758-c336-40a2-a6c7-905ec9972105","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"827ce758-c336-40a2-a6c7-905ec9972105","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"827ce758-c336-40a2-a6c7-905ec9972105","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"827ce758-c336-40a2-a6c7-905ec9972105","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"827ce758-c336-40a2-a6c7-905ec9972105","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a687636-94ee-4ef4-8a54-3992a5419fd0"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a687636-94ee-4ef4-8a54-3992a5419fd0"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a687636-94ee-4ef4-8a54-3992a5419fd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a687636-94ee-4ef4-8a54-3992a5419fd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a687636-94ee-4ef4-8a54-3992a5419fd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a687636-94ee-4ef4-8a54-3992a5419fd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a687636-94ee-4ef4-8a54-3992a5419fd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a687636-94ee-4ef4-8a54-3992a5419fd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a687636-94ee-4ef4-8a54-3992a5419fd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a687636-94ee-4ef4-8a54-3992a5419fd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a687636-94ee-4ef4-8a54-3992a5419fd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a687636-94ee-4ef4-8a54-3992a5419fd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a687636-94ee-4ef4-8a54-3992a5419fd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a687636-94ee-4ef4-8a54-3992a5419fd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a687636-94ee-4ef4-8a54-3992a5419fd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a687636-94ee-4ef4-8a54-3992a5419fd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a687636-94ee-4ef4-8a54-3992a5419fd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a687636-94ee-4ef4-8a54-3992a5419fd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:57:55Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e5ca0bd8-1a28-4156-8da7-de1dbaa95242","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e5ca0bd8-1a28-4156-8da7-de1dbaa95242","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"366b6c27-1e20-442e-a3ec-dd54df691ee5"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"366b6c27-1e20-442e-a3ec-dd54df691ee5"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"366b6c27-1e20-442e-a3ec-dd54df691ee5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"366b6c27-1e20-442e-a3ec-dd54df691ee5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"366b6c27-1e20-442e-a3ec-dd54df691ee5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"366b6c27-1e20-442e-a3ec-dd54df691ee5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"366b6c27-1e20-442e-a3ec-dd54df691ee5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"366b6c27-1e20-442e-a3ec-dd54df691ee5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"366b6c27-1e20-442e-a3ec-dd54df691ee5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"366b6c27-1e20-442e-a3ec-dd54df691ee5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"366b6c27-1e20-442e-a3ec-dd54df691ee5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"366b6c27-1e20-442e-a3ec-dd54df691ee5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"366b6c27-1e20-442e-a3ec-dd54df691ee5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"366b6c27-1e20-442e-a3ec-dd54df691ee5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"366b6c27-1e20-442e-a3ec-dd54df691ee5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"366b6c27-1e20-442e-a3ec-dd54df691ee5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"366b6c27-1e20-442e-a3ec-dd54df691ee5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"366b6c27-1e20-442e-a3ec-dd54df691ee5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-15T03:57:55Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"827ce758-c336-40a2-a6c7-905ec9972105","error":"provisioning failed: failure deploying resource openshift-ingress/data-science-tls-rule: apply failed networking.istio.io/v1, Kind=DestinationRule: unable to patch networking.istio.io/v1, Kind=DestinationRule openshift-ingress/data-science-tls-rule: Internal error occurred: failed calling webhook \"rev.validation.istio.io\": failed to call webhook: Post \"https://istiod-openshift-gateway.openshift-ingress.svc:443/validate?timeout=10s\": no endpoints available for service \"istiod-openshift-gateway\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"882db0f1-e586-4c63-8822-412ba4e3988b"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"882db0f1-e586-4c63-8822-412ba4e3988b"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"882db0f1-e586-4c63-8822-412ba4e3988b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"882db0f1-e586-4c63-8822-412ba4e3988b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"882db0f1-e586-4c63-8822-412ba4e3988b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"882db0f1-e586-4c63-8822-412ba4e3988b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"882db0f1-e586-4c63-8822-412ba4e3988b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"882db0f1-e586-4c63-8822-412ba4e3988b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"882db0f1-e586-4c63-8822-412ba4e3988b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"882db0f1-e586-4c63-8822-412ba4e3988b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-15T03:57:55Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"882db0f1-e586-4c63-8822-412ba4e3988b","error":"provisioning failed: failure deploying resource openshift-ingress/data-science-tls-rule: apply failed networking.istio.io/v1, Kind=DestinationRule: unable to patch networking.istio.io/v1, Kind=DestinationRule openshift-ingress/data-science-tls-rule: Internal error occurred: failed calling webhook \"rev.validation.istio.io\": failed to call webhook: Post \"https://istiod-openshift-gateway.openshift-ingress.svc:443/validate?timeout=10s\": no endpoints available for service \"istiod-openshift-gateway\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"aab32413-1c81-4bae-8ca9-792863d2168c"} {"level":"info","ts":"2026-07-15T03:57:55Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"7092bfa4-c8cf-4b70-a4fb-2688b42ef43b","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"aab32413-1c81-4bae-8ca9-792863d2168c"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"aab32413-1c81-4bae-8ca9-792863d2168c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"aab32413-1c81-4bae-8ca9-792863d2168c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"aab32413-1c81-4bae-8ca9-792863d2168c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"aab32413-1c81-4bae-8ca9-792863d2168c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"aab32413-1c81-4bae-8ca9-792863d2168c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"aab32413-1c81-4bae-8ca9-792863d2168c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"aab32413-1c81-4bae-8ca9-792863d2168c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"aab32413-1c81-4bae-8ca9-792863d2168c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"aab32413-1c81-4bae-8ca9-792863d2168c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"7092bfa4-c8cf-4b70-a4fb-2688b42ef43b","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"aab32413-1c81-4bae-8ca9-792863d2168c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"aab32413-1c81-4bae-8ca9-792863d2168c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"aab32413-1c81-4bae-8ca9-792863d2168c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"aab32413-1c81-4bae-8ca9-792863d2168c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"aab32413-1c81-4bae-8ca9-792863d2168c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"aab32413-1c81-4bae-8ca9-792863d2168c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"aab32413-1c81-4bae-8ca9-792863d2168c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:57:56Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"285103af-7627-4387-adb0-949f784346a7"} {"level":"info","ts":"2026-07-15T03:57:56Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"285103af-7627-4387-adb0-949f784346a7"} {"level":"info","ts":"2026-07-15T03:57:56Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"285103af-7627-4387-adb0-949f784346a7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:57:56Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"285103af-7627-4387-adb0-949f784346a7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:57:56Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"285103af-7627-4387-adb0-949f784346a7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:57:56Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"285103af-7627-4387-adb0-949f784346a7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"error","ts":"2026-07-15T03:57:56Z","msg":"Reconciler error","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"285103af-7627-4387-adb0-949f784346a7","error":"provisioning failed: 2 errors occurred:\n\t* gateway domain is missing for ModelRegistry; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\t* gateway domain is missing for Dashboard; the Data Science Gateway may not be ready yet—check that GatewayConfig exists and its status reports a domain: GatewayConfig.Status.Domain is empty\n\n","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b83f7ef-2dd6-44ab-b9a0-4e82cbcaf4fc"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b83f7ef-2dd6-44ab-b9a0-4e82cbcaf4fc"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b83f7ef-2dd6-44ab-b9a0-4e82cbcaf4fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b83f7ef-2dd6-44ab-b9a0-4e82cbcaf4fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b83f7ef-2dd6-44ab-b9a0-4e82cbcaf4fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b83f7ef-2dd6-44ab-b9a0-4e82cbcaf4fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b83f7ef-2dd6-44ab-b9a0-4e82cbcaf4fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b83f7ef-2dd6-44ab-b9a0-4e82cbcaf4fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b83f7ef-2dd6-44ab-b9a0-4e82cbcaf4fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b83f7ef-2dd6-44ab-b9a0-4e82cbcaf4fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm","msg":"EnvoyFilter exposes internal implementation details that may change at any time. Prefer other APIs if possible, and exercise extreme caution, especially around upgrades.","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b83f7ef-2dd6-44ab-b9a0-4e82cbcaf4fc"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3354e272-9126-4b3f-98a1-5e13be11e1ac"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3354e272-9126-4b3f-98a1-5e13be11e1ac"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3354e272-9126-4b3f-98a1-5e13be11e1ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3354e272-9126-4b3f-98a1-5e13be11e1ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3354e272-9126-4b3f-98a1-5e13be11e1ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3354e272-9126-4b3f-98a1-5e13be11e1ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3354e272-9126-4b3f-98a1-5e13be11e1ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3354e272-9126-4b3f-98a1-5e13be11e1ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3354e272-9126-4b3f-98a1-5e13be11e1ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3354e272-9126-4b3f-98a1-5e13be11e1ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3354e272-9126-4b3f-98a1-5e13be11e1ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3354e272-9126-4b3f-98a1-5e13be11e1ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3354e272-9126-4b3f-98a1-5e13be11e1ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3354e272-9126-4b3f-98a1-5e13be11e1ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3354e272-9126-4b3f-98a1-5e13be11e1ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3354e272-9126-4b3f-98a1-5e13be11e1ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3354e272-9126-4b3f-98a1-5e13be11e1ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3354e272-9126-4b3f-98a1-5e13be11e1ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b83f7ef-2dd6-44ab-b9a0-4e82cbcaf4fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b83f7ef-2dd6-44ab-b9a0-4e82cbcaf4fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b83f7ef-2dd6-44ab-b9a0-4e82cbcaf4fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"f0bb519d-e832-4a4d-bdd0-f5ffd475db35","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"f0bb519d-e832-4a4d-bdd0-f5ffd475db35","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4f36e5f7-066a-4194-b1be-cd373382bbbb"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4f36e5f7-066a-4194-b1be-cd373382bbbb"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4f36e5f7-066a-4194-b1be-cd373382bbbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4f36e5f7-066a-4194-b1be-cd373382bbbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4f36e5f7-066a-4194-b1be-cd373382bbbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4f36e5f7-066a-4194-b1be-cd373382bbbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4f36e5f7-066a-4194-b1be-cd373382bbbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4f36e5f7-066a-4194-b1be-cd373382bbbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4f36e5f7-066a-4194-b1be-cd373382bbbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4f36e5f7-066a-4194-b1be-cd373382bbbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4f36e5f7-066a-4194-b1be-cd373382bbbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4f36e5f7-066a-4194-b1be-cd373382bbbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4f36e5f7-066a-4194-b1be-cd373382bbbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4f36e5f7-066a-4194-b1be-cd373382bbbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4f36e5f7-066a-4194-b1be-cd373382bbbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4f36e5f7-066a-4194-b1be-cd373382bbbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4f36e5f7-066a-4194-b1be-cd373382bbbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4f36e5f7-066a-4194-b1be-cd373382bbbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"45db64bd-2e1c-49aa-9f41-c07dbc902210"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"45db64bd-2e1c-49aa-9f41-c07dbc902210"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"45db64bd-2e1c-49aa-9f41-c07dbc902210","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c7aa6ace-4122-483b-86c9-75582d6b77aa"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c7aa6ace-4122-483b-86c9-75582d6b77aa"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c7aa6ace-4122-483b-86c9-75582d6b77aa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c7aa6ace-4122-483b-86c9-75582d6b77aa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c7aa6ace-4122-483b-86c9-75582d6b77aa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c7aa6ace-4122-483b-86c9-75582d6b77aa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c7aa6ace-4122-483b-86c9-75582d6b77aa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"45db64bd-2e1c-49aa-9f41-c07dbc902210","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"reconcile","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"290fac0f-ba19-44c4-82e7-770b2b95958c"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"apply","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"290fac0f-ba19-44c4-82e7-770b2b95958c"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"290fac0f-ba19-44c4-82e7-770b2b95958c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/sanitycheck.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"45db64bd-2e1c-49aa-9f41-c07dbc902210","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"45db64bd-2e1c-49aa-9f41-c07dbc902210","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"45db64bd-2e1c-49aa-9f41-c07dbc902210","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"45db64bd-2e1c-49aa-9f41-c07dbc902210","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"45db64bd-2e1c-49aa-9f41-c07dbc902210","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"45db64bd-2e1c-49aa-9f41-c07dbc902210","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"reconcile","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"4dbeb34e-c4bf-4a74-97a0-1d2b1f441f4d"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"apply","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"4dbeb34e-c4bf-4a74-97a0-1d2b1f441f4d"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"4dbeb34e-c4bf-4a74-97a0-1d2b1f441f4d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.initialize"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"4dbeb34e-c4bf-4a74-97a0-1d2b1f441f4d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.customizeManifests"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"4dbeb34e-c4bf-4a74-97a0-1d2b1f441f4d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"4dbeb34e-c4bf-4a74-97a0-1d2b1f441f4d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.configureDependencies"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"4dbeb34e-c4bf-4a74-97a0-1d2b1f441f4d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"4dbeb34e-c4bf-4a74-97a0-1d2b1f441f4d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"reconcile","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"370465a7-fd35-47a8-a6f1-2050e68c57fd"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"apply","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"370465a7-fd35-47a8-a6f1-2050e68c57fd"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"370465a7-fd35-47a8-a6f1-2050e68c57fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"290fac0f-ba19-44c4-82e7-770b2b95958c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ray.initialize"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"290fac0f-ba19-44c4-82e7-770b2b95958c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:57:59Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"290fac0f-ba19-44c4-82e7-770b2b95958c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} # Warning: 'commonLabels' is deprecated. Please use 'labels' instead. Run 'kustomize edit fix' to update your Kustomization automatically. # Warning: 'vars' is deprecated. Please use 'replacements' instead. [EXPERIMENTAL] Run 'kustomize edit fix' to update your Kustomization automatically. {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"reconcile","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"510991ac-0579-4e92-97dc-4dbe422ea463"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"apply","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"510991ac-0579-4e92-97dc-4dbe422ea463"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"510991ac-0579-4e92-97dc-4dbe422ea463","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.initialize"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"510991ac-0579-4e92-97dc-4dbe422ea463","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"510991ac-0579-4e92-97dc-4dbe422ea463","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.configureDependencies"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"510991ac-0579-4e92-97dc-4dbe422ea463","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.setKustomizedParams"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"510991ac-0579-4e92-97dc-4dbe422ea463","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcef741e-37e5-477a-9fce-ae32a4d80cb6"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcef741e-37e5-477a-9fce-ae32a4d80cb6"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcef741e-37e5-477a-9fce-ae32a4d80cb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcef741e-37e5-477a-9fce-ae32a4d80cb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"370465a7-fd35-47a8-a6f1-2050e68c57fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.initialize"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"370465a7-fd35-47a8-a6f1-2050e68c57fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"370465a7-fd35-47a8-a6f1-2050e68c57fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkJobSetCRD"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"370465a7-fd35-47a8-a6f1-2050e68c57fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"370465a7-fd35-47a8-a6f1-2050e68c57fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"reconcile","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"31cef71e-0153-4407-967b-dff97f77e4bc"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"apply","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"31cef71e-0153-4407-967b-dff97f77e4bc"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"31cef71e-0153-4407-967b-dff97f77e4bc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.initialize"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"31cef71e-0153-4407-967b-dff97f77e4bc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.setKustomizedParams"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"31cef71e-0153-4407-967b-dff97f77e4bc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"31cef71e-0153-4407-967b-dff97f77e4bc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcef741e-37e5-477a-9fce-ae32a4d80cb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"reconcile","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b32bebd3-b3bf-4c39-b463-d910f71955ee"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"apply","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b32bebd3-b3bf-4c39-b463-d910f71955ee"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b32bebd3-b3bf-4c39-b463-d910f71955ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b32bebd3-b3bf-4c39-b463-d910f71955ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.initialize"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b32bebd3-b3bf-4c39-b463-d910f71955ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.argoWorkflowsControllersOptions"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b32bebd3-b3bf-4c39-b463-d910f71955ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b32bebd3-b3bf-4c39-b463-d910f71955ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"45db64bd-2e1c-49aa-9f41-c07dbc902210","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"45db64bd-2e1c-49aa-9f41-c07dbc902210","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"45db64bd-2e1c-49aa-9f41-c07dbc902210","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"01f545e7-23b8-443e-9f93-5b9121fdbdb6"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"01f545e7-23b8-443e-9f93-5b9121fdbdb6"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"01f545e7-23b8-443e-9f93-5b9121fdbdb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"01f545e7-23b8-443e-9f93-5b9121fdbdb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.(*componentHandler).NewComponentReconciler.checkSubscriptionDependencies.func26"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"01f545e7-23b8-443e-9f93-5b9121fdbdb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"75384bc8-1ff9-4d9b-8aca-5a74d725cf73"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"75384bc8-1ff9-4d9b-8aca-5a74d725cf73"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"75384bc8-1ff9-4d9b-8aca-5a74d725cf73","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c7aa6ace-4122-483b-86c9-75582d6b77aa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"d56c49c2-b9e3-4bd6-b27d-384c3cdf160a"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"d56c49c2-b9e3-4bd6-b27d-384c3cdf160a"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"d56c49c2-b9e3-4bd6-b27d-384c3cdf160a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"d56c49c2-b9e3-4bd6-b27d-384c3cdf160a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"75384bc8-1ff9-4d9b-8aca-5a74d725cf73","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} # Warning: 'vars' is deprecated. Please use 'replacements' instead. [EXPERIMENTAL] Run 'kustomize edit fix' to update your Kustomization automatically. {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d93466ae-e53e-4b67-8957-5ce847e21acf"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d93466ae-e53e-4b67-8957-5ce847e21acf"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d93466ae-e53e-4b67-8957-5ce847e21acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d93466ae-e53e-4b67-8957-5ce847e21acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d93466ae-e53e-4b67-8957-5ce847e21acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d93466ae-e53e-4b67-8957-5ce847e21acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d93466ae-e53e-4b67-8957-5ce847e21acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d93466ae-e53e-4b67-8957-5ce847e21acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d93466ae-e53e-4b67-8957-5ce847e21acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d93466ae-e53e-4b67-8957-5ce847e21acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d93466ae-e53e-4b67-8957-5ce847e21acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"d56c49c2-b9e3-4bd6-b27d-384c3cdf160a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"d56c49c2-b9e3-4bd6-b27d-384c3cdf160a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-15T03:58:00Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"d56c49c2-b9e3-4bd6-b27d-384c3cdf160a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} # Warning: 'commonLabels' is deprecated. Please use 'labels' instead. Run 'kustomize edit fix' to update your Kustomization automatically. # Warning: 'vars' is deprecated. Please use 'replacements' instead. [EXPERIMENTAL] Run 'kustomize edit fix' to update your Kustomization automatically. {"level":"info","ts":"2026-07-15T03:58:01Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcef741e-37e5-477a-9fce-ae32a4d80cb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:01Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcef741e-37e5-477a-9fce-ae32a4d80cb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T03:58:01Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcef741e-37e5-477a-9fce-ae32a4d80cb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T03:58:01Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcef741e-37e5-477a-9fce-ae32a4d80cb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} # Warning: 'commonLabels' is deprecated. Please use 'labels' instead. Run 'kustomize edit fix' to update your Kustomization automatically. {"level":"info","ts":"2026-07-15T03:58:01Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"4dbeb34e-c4bf-4a74-97a0-1d2b1f441f4d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d93466ae-e53e-4b67-8957-5ce847e21acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d93466ae-e53e-4b67-8957-5ce847e21acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d93466ae-e53e-4b67-8957-5ce847e21acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d93466ae-e53e-4b67-8957-5ce847e21acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d93466ae-e53e-4b67-8957-5ce847e21acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d93466ae-e53e-4b67-8957-5ce847e21acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d93466ae-e53e-4b67-8957-5ce847e21acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} # Warning: 'patchesJson6902' is deprecated. Please use 'patches' instead. Run 'kustomize edit fix' to update your Kustomization automatically. # Warning: 'patchesStrategicMerge' is deprecated. Please use 'patches' instead. Run 'kustomize edit fix' to update your Kustomization automatically. # Warning: 'patchesJson6902' is deprecated. Please use 'patches' instead. Run 'kustomize edit fix' to update your Kustomization automatically. # Warning: 'vars' is deprecated. Please use 'replacements' instead. [EXPERIMENTAL] Run 'kustomize edit fix' to update your Kustomization automatically. {"level":"info","ts":"2026-07-15T03:58:02Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"01f545e7-23b8-443e-9f93-5b9121fdbdb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"75384bc8-1ff9-4d9b-8aca-5a74d725cf73","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:58:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"75384bc8-1ff9-4d9b-8aca-5a74d725cf73","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:58:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"75384bc8-1ff9-4d9b-8aca-5a74d725cf73","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:58:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"75384bc8-1ff9-4d9b-8aca-5a74d725cf73","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:58:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"75384bc8-1ff9-4d9b-8aca-5a74d725cf73","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"75384bc8-1ff9-4d9b-8aca-5a74d725cf73","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:03Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b32bebd3-b3bf-4c39-b463-d910f71955ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} # Warning: 'commonLabels' is deprecated. Please use 'labels' instead. Run 'kustomize edit fix' to update your Kustomization automatically. # Warning: 'patchesJson6902' is deprecated. Please use 'patches' instead. Run 'kustomize edit fix' to update your Kustomization automatically. {"level":"info","ts":"2026-07-15T03:58:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"75384bc8-1ff9-4d9b-8aca-5a74d725cf73","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-15T03:58:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"75384bc8-1ff9-4d9b-8aca-5a74d725cf73","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"75384bc8-1ff9-4d9b-8aca-5a74d725cf73","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:04Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8563b790-c16f-4c0c-b333-ae7a698375aa"} {"level":"info","ts":"2026-07-15T03:58:04Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8563b790-c16f-4c0c-b333-ae7a698375aa"} {"level":"info","ts":"2026-07-15T03:58:04Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8563b790-c16f-4c0c-b333-ae7a698375aa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:58:04Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c7aa6ace-4122-483b-86c9-75582d6b77aa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:04Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8563b790-c16f-4c0c-b333-ae7a698375aa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:58:04Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8563b790-c16f-4c0c-b333-ae7a698375aa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:58:04Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8563b790-c16f-4c0c-b333-ae7a698375aa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:58:04Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8563b790-c16f-4c0c-b333-ae7a698375aa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:58:04Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8563b790-c16f-4c0c-b333-ae7a698375aa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:58:04Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8563b790-c16f-4c0c-b333-ae7a698375aa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:04Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8563b790-c16f-4c0c-b333-ae7a698375aa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:04Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"d56c49c2-b9e3-4bd6-b27d-384c3cdf160a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:05Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"31cef71e-0153-4407-967b-dff97f77e4bc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:06Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8563b790-c16f-4c0c-b333-ae7a698375aa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-15T03:58:06Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8563b790-c16f-4c0c-b333-ae7a698375aa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:06Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8563b790-c16f-4c0c-b333-ae7a698375aa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:07Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"6ed7669f-7b29-492d-b00a-72454aede01d","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:58:07Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"6ed7669f-7b29-492d-b00a-72454aede01d","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:58:07Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77772c7b-1674-4a4b-b50f-788f4d313ebf"} {"level":"info","ts":"2026-07-15T03:58:07Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77772c7b-1674-4a4b-b50f-788f4d313ebf"} {"level":"info","ts":"2026-07-15T03:58:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77772c7b-1674-4a4b-b50f-788f4d313ebf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77772c7b-1674-4a4b-b50f-788f4d313ebf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77772c7b-1674-4a4b-b50f-788f4d313ebf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77772c7b-1674-4a4b-b50f-788f4d313ebf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77772c7b-1674-4a4b-b50f-788f4d313ebf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77772c7b-1674-4a4b-b50f-788f4d313ebf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77772c7b-1674-4a4b-b50f-788f4d313ebf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77772c7b-1674-4a4b-b50f-788f4d313ebf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77772c7b-1674-4a4b-b50f-788f4d313ebf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:07Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"4dbeb34e-c4bf-4a74-97a0-1d2b1f441f4d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77772c7b-1674-4a4b-b50f-788f4d313ebf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77772c7b-1674-4a4b-b50f-788f4d313ebf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77772c7b-1674-4a4b-b50f-788f4d313ebf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77772c7b-1674-4a4b-b50f-788f4d313ebf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77772c7b-1674-4a4b-b50f-788f4d313ebf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77772c7b-1674-4a4b-b50f-788f4d313ebf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77772c7b-1674-4a4b-b50f-788f4d313ebf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:08Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"4dbeb34e-c4bf-4a74-97a0-1d2b1f441f4d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:08Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"4dbeb34e-c4bf-4a74-97a0-1d2b1f441f4d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} 2026/07/15 03:58:08 Warning: Sorting order is set both in 'kustomization.yaml' ('sortOptions') and in a CLI flag ('--reorder'). Using the kustomization file over the CLI flag. {"level":"info","ts":"2026-07-15T03:58:09Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"510991ac-0579-4e92-97dc-4dbe422ea463","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:09Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"370465a7-fd35-47a8-a6f1-2050e68c57fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:09Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"rhods-notebooks","reconcileID":"2f57967e-ca34-4e49-82f8-bf87c279f1be"} {"level":"info","ts":"2026-07-15T03:58:09Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"rhods-notebooks","reconcileID":"b07d8bbb-b9bc-4463-9ebd-4ffd919fdf2a"} {"level":"info","ts":"2026-07-15T03:58:09Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"rhods-notebooks","reconcileID":"5efb4c07-44ab-4dc4-a1f2-e7c5c0f86857"} {"level":"info","ts":"2026-07-15T03:58:10Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"31cef71e-0153-4407-967b-dff97f77e4bc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:11Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"31cef71e-0153-4407-967b-dff97f77e4bc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:11Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5fa96e7a-b874-43f0-8625-d34ff115fe3e"} {"level":"info","ts":"2026-07-15T03:58:11Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5fa96e7a-b874-43f0-8625-d34ff115fe3e"} {"level":"info","ts":"2026-07-15T03:58:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5fa96e7a-b874-43f0-8625-d34ff115fe3e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5fa96e7a-b874-43f0-8625-d34ff115fe3e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5fa96e7a-b874-43f0-8625-d34ff115fe3e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5fa96e7a-b874-43f0-8625-d34ff115fe3e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5fa96e7a-b874-43f0-8625-d34ff115fe3e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5fa96e7a-b874-43f0-8625-d34ff115fe3e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5fa96e7a-b874-43f0-8625-d34ff115fe3e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5fa96e7a-b874-43f0-8625-d34ff115fe3e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5fa96e7a-b874-43f0-8625-d34ff115fe3e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:11Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"ac851764-03dc-4af9-ac19-7ab5439766a3","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:58:11Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"ac851764-03dc-4af9-ac19-7ab5439766a3","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:58:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5fa96e7a-b874-43f0-8625-d34ff115fe3e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5fa96e7a-b874-43f0-8625-d34ff115fe3e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5fa96e7a-b874-43f0-8625-d34ff115fe3e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5fa96e7a-b874-43f0-8625-d34ff115fe3e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5fa96e7a-b874-43f0-8625-d34ff115fe3e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5fa96e7a-b874-43f0-8625-d34ff115fe3e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5fa96e7a-b874-43f0-8625-d34ff115fe3e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:12Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"01f545e7-23b8-443e-9f93-5b9121fdbdb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:12Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"01f545e7-23b8-443e-9f93-5b9121fdbdb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:13Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b32bebd3-b3bf-4c39-b463-d910f71955ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:13Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b32bebd3-b3bf-4c39-b463-d910f71955ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:14Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e9590f29-9156-4611-850a-410c7343d5cc","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:58:14Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e9590f29-9156-4611-850a-410c7343d5cc","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:58:14Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53c39bf2-b4e3-4340-aa2e-738b0d79ecc6"} {"level":"info","ts":"2026-07-15T03:58:14Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53c39bf2-b4e3-4340-aa2e-738b0d79ecc6"} {"level":"info","ts":"2026-07-15T03:58:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53c39bf2-b4e3-4340-aa2e-738b0d79ecc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53c39bf2-b4e3-4340-aa2e-738b0d79ecc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53c39bf2-b4e3-4340-aa2e-738b0d79ecc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53c39bf2-b4e3-4340-aa2e-738b0d79ecc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53c39bf2-b4e3-4340-aa2e-738b0d79ecc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53c39bf2-b4e3-4340-aa2e-738b0d79ecc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53c39bf2-b4e3-4340-aa2e-738b0d79ecc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53c39bf2-b4e3-4340-aa2e-738b0d79ecc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53c39bf2-b4e3-4340-aa2e-738b0d79ecc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53c39bf2-b4e3-4340-aa2e-738b0d79ecc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53c39bf2-b4e3-4340-aa2e-738b0d79ecc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53c39bf2-b4e3-4340-aa2e-738b0d79ecc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53c39bf2-b4e3-4340-aa2e-738b0d79ecc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53c39bf2-b4e3-4340-aa2e-738b0d79ecc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53c39bf2-b4e3-4340-aa2e-738b0d79ecc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53c39bf2-b4e3-4340-aa2e-738b0d79ecc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:16Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"290fac0f-ba19-44c4-82e7-770b2b95958c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:17Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"177725a1-1319-4af7-a398-08d153616387","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:58:17Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"177725a1-1319-4af7-a398-08d153616387","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:58:17Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8c4994b-d529-41b6-a615-a6fb0962ff60"} {"level":"info","ts":"2026-07-15T03:58:17Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8c4994b-d529-41b6-a615-a6fb0962ff60"} {"level":"info","ts":"2026-07-15T03:58:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8c4994b-d529-41b6-a615-a6fb0962ff60","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8c4994b-d529-41b6-a615-a6fb0962ff60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8c4994b-d529-41b6-a615-a6fb0962ff60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8c4994b-d529-41b6-a615-a6fb0962ff60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8c4994b-d529-41b6-a615-a6fb0962ff60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8c4994b-d529-41b6-a615-a6fb0962ff60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8c4994b-d529-41b6-a615-a6fb0962ff60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8c4994b-d529-41b6-a615-a6fb0962ff60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8c4994b-d529-41b6-a615-a6fb0962ff60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8c4994b-d529-41b6-a615-a6fb0962ff60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8c4994b-d529-41b6-a615-a6fb0962ff60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8c4994b-d529-41b6-a615-a6fb0962ff60","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8c4994b-d529-41b6-a615-a6fb0962ff60","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8c4994b-d529-41b6-a615-a6fb0962ff60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8c4994b-d529-41b6-a615-a6fb0962ff60","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8c4994b-d529-41b6-a615-a6fb0962ff60","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cf4104e2-4f19-4afa-a7ee-b44e306c8f9b"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cf4104e2-4f19-4afa-a7ee-b44e306c8f9b"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cf4104e2-4f19-4afa-a7ee-b44e306c8f9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cf4104e2-4f19-4afa-a7ee-b44e306c8f9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:58:18Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c21ffe72-591a-4ecb-b507-6b44973ceffb","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c21ffe72-591a-4ecb-b507-6b44973ceffb","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8e32b6f5-1afb-4f51-a6e5-bce1ded7f9fb"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8e32b6f5-1afb-4f51-a6e5-bce1ded7f9fb"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8e32b6f5-1afb-4f51-a6e5-bce1ded7f9fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8e32b6f5-1afb-4f51-a6e5-bce1ded7f9fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8e32b6f5-1afb-4f51-a6e5-bce1ded7f9fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8e32b6f5-1afb-4f51-a6e5-bce1ded7f9fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8e32b6f5-1afb-4f51-a6e5-bce1ded7f9fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8e32b6f5-1afb-4f51-a6e5-bce1ded7f9fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8e32b6f5-1afb-4f51-a6e5-bce1ded7f9fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8e32b6f5-1afb-4f51-a6e5-bce1ded7f9fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8e32b6f5-1afb-4f51-a6e5-bce1ded7f9fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"510991ac-0579-4e92-97dc-4dbe422ea463","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"510991ac-0579-4e92-97dc-4dbe422ea463","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/imagestreams.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"510991ac-0579-4e92-97dc-4dbe422ea463","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"510991ac-0579-4e92-97dc-4dbe422ea463","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cf4104e2-4f19-4afa-a7ee-b44e306c8f9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cf4104e2-4f19-4afa-a7ee-b44e306c8f9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cf4104e2-4f19-4afa-a7ee-b44e306c8f9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cf4104e2-4f19-4afa-a7ee-b44e306c8f9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cf4104e2-4f19-4afa-a7ee-b44e306c8f9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cf4104e2-4f19-4afa-a7ee-b44e306c8f9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8e32b6f5-1afb-4f51-a6e5-bce1ded7f9fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8e32b6f5-1afb-4f51-a6e5-bce1ded7f9fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8e32b6f5-1afb-4f51-a6e5-bce1ded7f9fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8e32b6f5-1afb-4f51-a6e5-bce1ded7f9fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8e32b6f5-1afb-4f51-a6e5-bce1ded7f9fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8e32b6f5-1afb-4f51-a6e5-bce1ded7f9fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8e32b6f5-1afb-4f51-a6e5-bce1ded7f9fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cf4104e2-4f19-4afa-a7ee-b44e306c8f9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-15T03:58:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cf4104e2-4f19-4afa-a7ee-b44e306c8f9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cf4104e2-4f19-4afa-a7ee-b44e306c8f9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"370465a7-fd35-47a8-a6f1-2050e68c57fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"370465a7-fd35-47a8-a6f1-2050e68c57fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:20Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"944572ff-381a-4417-a3dc-0908e2371df7","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"944572ff-381a-4417-a3dc-0908e2371df7","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2028d312-5b98-47cc-aaca-942c0177e583"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2028d312-5b98-47cc-aaca-942c0177e583"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2028d312-5b98-47cc-aaca-942c0177e583","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2028d312-5b98-47cc-aaca-942c0177e583","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2028d312-5b98-47cc-aaca-942c0177e583","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2028d312-5b98-47cc-aaca-942c0177e583","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2028d312-5b98-47cc-aaca-942c0177e583","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2028d312-5b98-47cc-aaca-942c0177e583","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2028d312-5b98-47cc-aaca-942c0177e583","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2028d312-5b98-47cc-aaca-942c0177e583","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2028d312-5b98-47cc-aaca-942c0177e583","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2028d312-5b98-47cc-aaca-942c0177e583","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2028d312-5b98-47cc-aaca-942c0177e583","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2028d312-5b98-47cc-aaca-942c0177e583","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2028d312-5b98-47cc-aaca-942c0177e583","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2028d312-5b98-47cc-aaca-942c0177e583","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2028d312-5b98-47cc-aaca-942c0177e583","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2028d312-5b98-47cc-aaca-942c0177e583","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:20Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"4dbeb34e-c4bf-4a74-97a0-1d2b1f441f4d"} {"level":"info","ts":"2026-07-15T03:58:20Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"31cef71e-0153-4407-967b-dff97f77e4bc"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"4dbeb34e-c4bf-4a74-97a0-1d2b1f441f4d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"reconcile","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"84171d9a-5935-41a2-afd6-bd1f313d12b5"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"apply","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"84171d9a-5935-41a2-afd6-bd1f313d12b5"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"84171d9a-5935-41a2-afd6-bd1f313d12b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.initialize"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"84171d9a-5935-41a2-afd6-bd1f313d12b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.customizeManifests"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"84171d9a-5935-41a2-afd6-bd1f313d12b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"84171d9a-5935-41a2-afd6-bd1f313d12b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.configureDependencies"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"84171d9a-5935-41a2-afd6-bd1f313d12b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"84171d9a-5935-41a2-afd6-bd1f313d12b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"84171d9a-5935-41a2-afd6-bd1f313d12b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"290fac0f-ba19-44c4-82e7-770b2b95958c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9efb58b1-a0fc-41d4-807b-d18f0b75b63a"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9efb58b1-a0fc-41d4-807b-d18f0b75b63a"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9efb58b1-a0fc-41d4-807b-d18f0b75b63a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9efb58b1-a0fc-41d4-807b-d18f0b75b63a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9efb58b1-a0fc-41d4-807b-d18f0b75b63a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9efb58b1-a0fc-41d4-807b-d18f0b75b63a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9efb58b1-a0fc-41d4-807b-d18f0b75b63a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"290fac0f-ba19-44c4-82e7-770b2b95958c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"31cef71e-0153-4407-967b-dff97f77e4bc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9efb58b1-a0fc-41d4-807b-d18f0b75b63a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"01f545e7-23b8-443e-9f93-5b9121fdbdb6"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"reconcile","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"5cf20b89-fdc4-4d60-b7a2-91fb9402051b"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"apply","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"5cf20b89-fdc4-4d60-b7a2-91fb9402051b"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"5cf20b89-fdc4-4d60-b7a2-91fb9402051b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.initialize"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"5cf20b89-fdc4-4d60-b7a2-91fb9402051b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.setKustomizedParams"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"5cf20b89-fdc4-4d60-b7a2-91fb9402051b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"5cf20b89-fdc4-4d60-b7a2-91fb9402051b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"5cf20b89-fdc4-4d60-b7a2-91fb9402051b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c8cf498c-0a13-489b-8522-fb8fa2b8a07f","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c8cf498c-0a13-489b-8522-fb8fa2b8a07f","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4721a6de-96a1-47c4-8294-78e0d28778e6"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4721a6de-96a1-47c4-8294-78e0d28778e6"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4721a6de-96a1-47c4-8294-78e0d28778e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4721a6de-96a1-47c4-8294-78e0d28778e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4721a6de-96a1-47c4-8294-78e0d28778e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4721a6de-96a1-47c4-8294-78e0d28778e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4721a6de-96a1-47c4-8294-78e0d28778e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4721a6de-96a1-47c4-8294-78e0d28778e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4721a6de-96a1-47c4-8294-78e0d28778e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4721a6de-96a1-47c4-8294-78e0d28778e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4721a6de-96a1-47c4-8294-78e0d28778e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4721a6de-96a1-47c4-8294-78e0d28778e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4721a6de-96a1-47c4-8294-78e0d28778e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4721a6de-96a1-47c4-8294-78e0d28778e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4721a6de-96a1-47c4-8294-78e0d28778e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4721a6de-96a1-47c4-8294-78e0d28778e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4721a6de-96a1-47c4-8294-78e0d28778e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4721a6de-96a1-47c4-8294-78e0d28778e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"01f545e7-23b8-443e-9f93-5b9121fdbdb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"84171d9a-5935-41a2-afd6-bd1f313d12b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"84171d9a-5935-41a2-afd6-bd1f313d12b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"84171d9a-5935-41a2-afd6-bd1f313d12b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"84171d9a-5935-41a2-afd6-bd1f313d12b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Starting EventSource","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"298d31f9-1e14-4862-a64e-038467a40bf4"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"298d31f9-1e14-4862-a64e-038467a40bf4"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"298d31f9-1e14-4862-a64e-038467a40bf4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"298d31f9-1e14-4862-a64e-038467a40bf4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.(*componentHandler).NewComponentReconciler.checkSubscriptionDependencies.func26"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"298d31f9-1e14-4862-a64e-038467a40bf4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:21Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"298d31f9-1e14-4862-a64e-038467a40bf4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:22Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b32bebd3-b3bf-4c39-b463-d910f71955ee"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b16d5804-8443-4af1-940b-3aa40e486645"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b16d5804-8443-4af1-940b-3aa40e486645"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b16d5804-8443-4af1-940b-3aa40e486645","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b16d5804-8443-4af1-940b-3aa40e486645","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9efb58b1-a0fc-41d4-807b-d18f0b75b63a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b16d5804-8443-4af1-940b-3aa40e486645","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b16d5804-8443-4af1-940b-3aa40e486645","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b16d5804-8443-4af1-940b-3aa40e486645","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b16d5804-8443-4af1-940b-3aa40e486645","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b16d5804-8443-4af1-940b-3aa40e486645","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b16d5804-8443-4af1-940b-3aa40e486645","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:22Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8dbe4e8c-398d-4b47-8a5b-422011d254d4","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8dbe4e8c-398d-4b47-8a5b-422011d254d4","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dbe7de37-3b83-4337-82c0-55397f26a43a"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dbe7de37-3b83-4337-82c0-55397f26a43a"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dbe7de37-3b83-4337-82c0-55397f26a43a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dbe7de37-3b83-4337-82c0-55397f26a43a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dbe7de37-3b83-4337-82c0-55397f26a43a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dbe7de37-3b83-4337-82c0-55397f26a43a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dbe7de37-3b83-4337-82c0-55397f26a43a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dbe7de37-3b83-4337-82c0-55397f26a43a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dbe7de37-3b83-4337-82c0-55397f26a43a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dbe7de37-3b83-4337-82c0-55397f26a43a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dbe7de37-3b83-4337-82c0-55397f26a43a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0aa9bba8-cc1e-424a-877d-a854ec6f250b"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0aa9bba8-cc1e-424a-877d-a854ec6f250b"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0aa9bba8-cc1e-424a-877d-a854ec6f250b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0aa9bba8-cc1e-424a-877d-a854ec6f250b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0aa9bba8-cc1e-424a-877d-a854ec6f250b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0aa9bba8-cc1e-424a-877d-a854ec6f250b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0aa9bba8-cc1e-424a-877d-a854ec6f250b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b32bebd3-b3bf-4c39-b463-d910f71955ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"reconcile","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"506f50c1-96fb-44c1-a2e9-70211cbf7e7f"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"apply","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"506f50c1-96fb-44c1-a2e9-70211cbf7e7f"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"506f50c1-96fb-44c1-a2e9-70211cbf7e7f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"506f50c1-96fb-44c1-a2e9-70211cbf7e7f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.initialize"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"506f50c1-96fb-44c1-a2e9-70211cbf7e7f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.argoWorkflowsControllersOptions"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"506f50c1-96fb-44c1-a2e9-70211cbf7e7f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"506f50c1-96fb-44c1-a2e9-70211cbf7e7f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"506f50c1-96fb-44c1-a2e9-70211cbf7e7f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dbe7de37-3b83-4337-82c0-55397f26a43a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dbe7de37-3b83-4337-82c0-55397f26a43a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dbe7de37-3b83-4337-82c0-55397f26a43a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dbe7de37-3b83-4337-82c0-55397f26a43a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dbe7de37-3b83-4337-82c0-55397f26a43a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dbe7de37-3b83-4337-82c0-55397f26a43a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dbe7de37-3b83-4337-82c0-55397f26a43a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0aa9bba8-cc1e-424a-877d-a854ec6f250b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"reconcile","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a42f3165-3e01-44c3-afe7-d4cdfa7f17fc"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"apply","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a42f3165-3e01-44c3-afe7-d4cdfa7f17fc"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a42f3165-3e01-44c3-afe7-d4cdfa7f17fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.initialize"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a42f3165-3e01-44c3-afe7-d4cdfa7f17fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.customizeManifests"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a42f3165-3e01-44c3-afe7-d4cdfa7f17fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a42f3165-3e01-44c3-afe7-d4cdfa7f17fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.configureDependencies"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a42f3165-3e01-44c3-afe7-d4cdfa7f17fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a42f3165-3e01-44c3-afe7-d4cdfa7f17fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a42f3165-3e01-44c3-afe7-d4cdfa7f17fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b16d5804-8443-4af1-940b-3aa40e486645","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b16d5804-8443-4af1-940b-3aa40e486645","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b16d5804-8443-4af1-940b-3aa40e486645","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2779ab9a-e1aa-4ff4-836a-fd7df93577b9"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2779ab9a-e1aa-4ff4-836a-fd7df93577b9"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2779ab9a-e1aa-4ff4-836a-fd7df93577b9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2779ab9a-e1aa-4ff4-836a-fd7df93577b9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"5cf20b89-fdc4-4d60-b7a2-91fb9402051b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"5cf20b89-fdc4-4d60-b7a2-91fb9402051b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"5cf20b89-fdc4-4d60-b7a2-91fb9402051b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a42f3165-3e01-44c3-afe7-d4cdfa7f17fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a42f3165-3e01-44c3-afe7-d4cdfa7f17fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a42f3165-3e01-44c3-afe7-d4cdfa7f17fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a42f3165-3e01-44c3-afe7-d4cdfa7f17fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2779ab9a-e1aa-4ff4-836a-fd7df93577b9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2779ab9a-e1aa-4ff4-836a-fd7df93577b9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2779ab9a-e1aa-4ff4-836a-fd7df93577b9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2779ab9a-e1aa-4ff4-836a-fd7df93577b9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2779ab9a-e1aa-4ff4-836a-fd7df93577b9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2779ab9a-e1aa-4ff4-836a-fd7df93577b9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"298d31f9-1e14-4862-a64e-038467a40bf4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"298d31f9-1e14-4862-a64e-038467a40bf4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"298d31f9-1e14-4862-a64e-038467a40bf4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"3df7f900-fe68-45c6-874d-8f1b8dc95de2"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"3df7f900-fe68-45c6-874d-8f1b8dc95de2"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"3df7f900-fe68-45c6-874d-8f1b8dc95de2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"3df7f900-fe68-45c6-874d-8f1b8dc95de2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.(*componentHandler).NewComponentReconciler.checkSubscriptionDependencies.func26"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"3df7f900-fe68-45c6-874d-8f1b8dc95de2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"3df7f900-fe68-45c6-874d-8f1b8dc95de2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2779ab9a-e1aa-4ff4-836a-fd7df93577b9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2779ab9a-e1aa-4ff4-836a-fd7df93577b9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2779ab9a-e1aa-4ff4-836a-fd7df93577b9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0aa9bba8-cc1e-424a-877d-a854ec6f250b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"3df7f900-fe68-45c6-874d-8f1b8dc95de2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"3df7f900-fe68-45c6-874d-8f1b8dc95de2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"3df7f900-fe68-45c6-874d-8f1b8dc95de2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7345c212-3d7b-47f5-99f9-d5c21046529e"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7345c212-3d7b-47f5-99f9-d5c21046529e"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7345c212-3d7b-47f5-99f9-d5c21046529e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7345c212-3d7b-47f5-99f9-d5c21046529e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7345c212-3d7b-47f5-99f9-d5c21046529e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7345c212-3d7b-47f5-99f9-d5c21046529e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7345c212-3d7b-47f5-99f9-d5c21046529e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7345c212-3d7b-47f5-99f9-d5c21046529e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7345c212-3d7b-47f5-99f9-d5c21046529e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7345c212-3d7b-47f5-99f9-d5c21046529e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7345c212-3d7b-47f5-99f9-d5c21046529e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:23Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e523f60f-586b-42d2-9346-11019ab93e3a","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e523f60f-586b-42d2-9346-11019ab93e3a","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4c0e5946-7613-41f1-aaf3-4c77fb5c4069"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4c0e5946-7613-41f1-aaf3-4c77fb5c4069"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4c0e5946-7613-41f1-aaf3-4c77fb5c4069","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4c0e5946-7613-41f1-aaf3-4c77fb5c4069","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4c0e5946-7613-41f1-aaf3-4c77fb5c4069","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4c0e5946-7613-41f1-aaf3-4c77fb5c4069","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4c0e5946-7613-41f1-aaf3-4c77fb5c4069","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7345c212-3d7b-47f5-99f9-d5c21046529e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7345c212-3d7b-47f5-99f9-d5c21046529e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7345c212-3d7b-47f5-99f9-d5c21046529e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7345c212-3d7b-47f5-99f9-d5c21046529e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7345c212-3d7b-47f5-99f9-d5c21046529e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7345c212-3d7b-47f5-99f9-d5c21046529e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7345c212-3d7b-47f5-99f9-d5c21046529e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4c0e5946-7613-41f1-aaf3-4c77fb5c4069","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"d56c49c2-b9e3-4bd6-b27d-384c3cdf160a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"510991ac-0579-4e92-97dc-4dbe422ea463"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"d56c49c2-b9e3-4bd6-b27d-384c3cdf160a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"506f50c1-96fb-44c1-a2e9-70211cbf7e7f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"d56c49c2-b9e3-4bd6-b27d-384c3cdf160a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"d56c49c2-b9e3-4bd6-b27d-384c3cdf160a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"2c0da88f-7c4a-4a62-be8e-98254074356d"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"2c0da88f-7c4a-4a62-be8e-98254074356d"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"2c0da88f-7c4a-4a62-be8e-98254074356d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"2c0da88f-7c4a-4a62-be8e-98254074356d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.(*componentHandler).NewComponentReconciler.checkSubscriptionDependencies.func26"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"2c0da88f-7c4a-4a62-be8e-98254074356d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"2c0da88f-7c4a-4a62-be8e-98254074356d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"506f50c1-96fb-44c1-a2e9-70211cbf7e7f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"506f50c1-96fb-44c1-a2e9-70211cbf7e7f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"ad01c733-ebaf-4dab-8770-12ac64fd46e6","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"ad01c733-ebaf-4dab-8770-12ac64fd46e6","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"55f0b2b3-2428-4300-8a4b-d30157617ca1"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"55f0b2b3-2428-4300-8a4b-d30157617ca1"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"55f0b2b3-2428-4300-8a4b-d30157617ca1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"55f0b2b3-2428-4300-8a4b-d30157617ca1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"55f0b2b3-2428-4300-8a4b-d30157617ca1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"55f0b2b3-2428-4300-8a4b-d30157617ca1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"55f0b2b3-2428-4300-8a4b-d30157617ca1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"55f0b2b3-2428-4300-8a4b-d30157617ca1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"55f0b2b3-2428-4300-8a4b-d30157617ca1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"55f0b2b3-2428-4300-8a4b-d30157617ca1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"55f0b2b3-2428-4300-8a4b-d30157617ca1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"2c0da88f-7c4a-4a62-be8e-98254074356d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"510991ac-0579-4e92-97dc-4dbe422ea463","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"55f0b2b3-2428-4300-8a4b-d30157617ca1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"55f0b2b3-2428-4300-8a4b-d30157617ca1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"55f0b2b3-2428-4300-8a4b-d30157617ca1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"55f0b2b3-2428-4300-8a4b-d30157617ca1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"55f0b2b3-2428-4300-8a4b-d30157617ca1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"55f0b2b3-2428-4300-8a4b-d30157617ca1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"55f0b2b3-2428-4300-8a4b-d30157617ca1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"2c0da88f-7c4a-4a62-be8e-98254074356d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"2c0da88f-7c4a-4a62-be8e-98254074356d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"reconcile","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"4ad026ae-005e-404b-9003-f130258ea03f"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"apply","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"4ad026ae-005e-404b-9003-f130258ea03f"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"4ad026ae-005e-404b-9003-f130258ea03f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"4ad026ae-005e-404b-9003-f130258ea03f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.initialize"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"4ad026ae-005e-404b-9003-f130258ea03f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.argoWorkflowsControllersOptions"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"4ad026ae-005e-404b-9003-f130258ea03f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"4ad026ae-005e-404b-9003-f130258ea03f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"4ad026ae-005e-404b-9003-f130258ea03f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"reconcile","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"140be716-d784-48d0-8cc9-938b6d7a60c9"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"apply","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"140be716-d784-48d0-8cc9-938b6d7a60c9"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"140be716-d784-48d0-8cc9-938b6d7a60c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.initialize"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"140be716-d784-48d0-8cc9-938b6d7a60c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"140be716-d784-48d0-8cc9-938b6d7a60c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.configureDependencies"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"140be716-d784-48d0-8cc9-938b6d7a60c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.setKustomizedParams"} {"level":"info","ts":"2026-07-15T03:58:24Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"140be716-d784-48d0-8cc9-938b6d7a60c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:25Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4c0e5946-7613-41f1-aaf3-4c77fb5c4069","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:25Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"4ad026ae-005e-404b-9003-f130258ea03f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:25Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"4ad026ae-005e-404b-9003-f130258ea03f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:25Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"4ad026ae-005e-404b-9003-f130258ea03f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:25Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"370465a7-fd35-47a8-a6f1-2050e68c57fd"} {"level":"info","ts":"2026-07-15T03:58:25Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a3eb2e98-9a4e-4747-b250-61694c5d8071"} {"level":"info","ts":"2026-07-15T03:58:25Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a3eb2e98-9a4e-4747-b250-61694c5d8071"} {"level":"info","ts":"2026-07-15T03:58:25Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a3eb2e98-9a4e-4747-b250-61694c5d8071","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:25Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a3eb2e98-9a4e-4747-b250-61694c5d8071","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:25Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a3eb2e98-9a4e-4747-b250-61694c5d8071","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:25Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a3eb2e98-9a4e-4747-b250-61694c5d8071","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:25Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a3eb2e98-9a4e-4747-b250-61694c5d8071","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:25Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"5ca91f59-a0f8-4e25-bbeb-2f0f79d3f2b7"} {"level":"info","ts":"2026-07-15T03:58:25Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"5ca91f59-a0f8-4e25-bbeb-2f0f79d3f2b7"} {"level":"info","ts":"2026-07-15T03:58:25Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"5ca91f59-a0f8-4e25-bbeb-2f0f79d3f2b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-15T03:58:25Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"5ca91f59-a0f8-4e25-bbeb-2f0f79d3f2b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.(*componentHandler).NewComponentReconciler.checkSubscriptionDependencies.func26"} {"level":"info","ts":"2026-07-15T03:58:25Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"5ca91f59-a0f8-4e25-bbeb-2f0f79d3f2b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:25Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"5ca91f59-a0f8-4e25-bbeb-2f0f79d3f2b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a3eb2e98-9a4e-4747-b250-61694c5d8071","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"370465a7-fd35-47a8-a6f1-2050e68c57fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Starting EventSource","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Starting EventSource","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"reconcile","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6480e5c2-f914-4ce7-a3a3-aa0fb6f0b204"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"apply","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6480e5c2-f914-4ce7-a3a3-aa0fb6f0b204"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6480e5c2-f914-4ce7-a3a3-aa0fb6f0b204","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6480e5c2-f914-4ce7-a3a3-aa0fb6f0b204","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.initialize"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6480e5c2-f914-4ce7-a3a3-aa0fb6f0b204","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6480e5c2-f914-4ce7-a3a3-aa0fb6f0b204","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkJobSetCRD"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"5ca91f59-a0f8-4e25-bbeb-2f0f79d3f2b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"5ca91f59-a0f8-4e25-bbeb-2f0f79d3f2b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"5ca91f59-a0f8-4e25-bbeb-2f0f79d3f2b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:26Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"bf78b989-489b-472e-88ca-a0242858a001","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"bf78b989-489b-472e-88ca-a0242858a001","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b239c291-4d73-4279-a356-b00fc762f64c"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b239c291-4d73-4279-a356-b00fc762f64c"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b239c291-4d73-4279-a356-b00fc762f64c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b239c291-4d73-4279-a356-b00fc762f64c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b239c291-4d73-4279-a356-b00fc762f64c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b239c291-4d73-4279-a356-b00fc762f64c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b239c291-4d73-4279-a356-b00fc762f64c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b239c291-4d73-4279-a356-b00fc762f64c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b239c291-4d73-4279-a356-b00fc762f64c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b239c291-4d73-4279-a356-b00fc762f64c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b239c291-4d73-4279-a356-b00fc762f64c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6480e5c2-f914-4ce7-a3a3-aa0fb6f0b204","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6480e5c2-f914-4ce7-a3a3-aa0fb6f0b204","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6480e5c2-f914-4ce7-a3a3-aa0fb6f0b204","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b239c291-4d73-4279-a356-b00fc762f64c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b239c291-4d73-4279-a356-b00fc762f64c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b239c291-4d73-4279-a356-b00fc762f64c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b239c291-4d73-4279-a356-b00fc762f64c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b239c291-4d73-4279-a356-b00fc762f64c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b239c291-4d73-4279-a356-b00fc762f64c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b239c291-4d73-4279-a356-b00fc762f64c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:26Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"290fac0f-ba19-44c4-82e7-770b2b95958c"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a3eb2e98-9a4e-4747-b250-61694c5d8071","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"290fac0f-ba19-44c4-82e7-770b2b95958c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Starting EventSource","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"reconcile","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"0e37058c-983a-4cdc-aa18-bf2ff6c9d60c"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"apply","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"0e37058c-983a-4cdc-aa18-bf2ff6c9d60c"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"0e37058c-983a-4cdc-aa18-bf2ff6c9d60c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/sanitycheck.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"0e37058c-983a-4cdc-aa18-bf2ff6c9d60c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ray.initialize"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"0e37058c-983a-4cdc-aa18-bf2ff6c9d60c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"0e37058c-983a-4cdc-aa18-bf2ff6c9d60c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a88e8f51-21e8-42cb-bc8d-03c9482607c9"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a88e8f51-21e8-42cb-bc8d-03c9482607c9"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a88e8f51-21e8-42cb-bc8d-03c9482607c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a88e8f51-21e8-42cb-bc8d-03c9482607c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a88e8f51-21e8-42cb-bc8d-03c9482607c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a88e8f51-21e8-42cb-bc8d-03c9482607c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a88e8f51-21e8-42cb-bc8d-03c9482607c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"0e37058c-983a-4cdc-aa18-bf2ff6c9d60c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a88e8f51-21e8-42cb-bc8d-03c9482607c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"140be716-d784-48d0-8cc9-938b6d7a60c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:28Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"df7e0eb7-dfb8-4e58-8ccd-23bc6ea2f989","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"df7e0eb7-dfb8-4e58-8ccd-23bc6ea2f989","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bc177fa-1889-4fec-805e-6a02097ce4ab"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bc177fa-1889-4fec-805e-6a02097ce4ab"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bc177fa-1889-4fec-805e-6a02097ce4ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bc177fa-1889-4fec-805e-6a02097ce4ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bc177fa-1889-4fec-805e-6a02097ce4ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bc177fa-1889-4fec-805e-6a02097ce4ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bc177fa-1889-4fec-805e-6a02097ce4ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bc177fa-1889-4fec-805e-6a02097ce4ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bc177fa-1889-4fec-805e-6a02097ce4ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bc177fa-1889-4fec-805e-6a02097ce4ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bc177fa-1889-4fec-805e-6a02097ce4ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:29Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bc177fa-1889-4fec-805e-6a02097ce4ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:29Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bc177fa-1889-4fec-805e-6a02097ce4ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:29Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bc177fa-1889-4fec-805e-6a02097ce4ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:29Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bc177fa-1889-4fec-805e-6a02097ce4ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:29Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bc177fa-1889-4fec-805e-6a02097ce4ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:29Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bc177fa-1889-4fec-805e-6a02097ce4ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:29Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bc177fa-1889-4fec-805e-6a02097ce4ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:29Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6480e5c2-f914-4ce7-a3a3-aa0fb6f0b204","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:29Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6480e5c2-f914-4ce7-a3a3-aa0fb6f0b204","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:29Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6480e5c2-f914-4ce7-a3a3-aa0fb6f0b204","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:29Z","msg":"reconcile","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"5c25d5a3-7dd5-4d01-adc8-a4b61866298c"} {"level":"info","ts":"2026-07-15T03:58:29Z","msg":"apply","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"5c25d5a3-7dd5-4d01-adc8-a4b61866298c"} {"level":"info","ts":"2026-07-15T03:58:29Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"5c25d5a3-7dd5-4d01-adc8-a4b61866298c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:29Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"5c25d5a3-7dd5-4d01-adc8-a4b61866298c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.initialize"} {"level":"info","ts":"2026-07-15T03:58:29Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"5c25d5a3-7dd5-4d01-adc8-a4b61866298c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:29Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"5c25d5a3-7dd5-4d01-adc8-a4b61866298c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkJobSetCRD"} {"level":"info","ts":"2026-07-15T03:58:29Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"5c25d5a3-7dd5-4d01-adc8-a4b61866298c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:29Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"5c25d5a3-7dd5-4d01-adc8-a4b61866298c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:29Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"5c25d5a3-7dd5-4d01-adc8-a4b61866298c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"5c25d5a3-7dd5-4d01-adc8-a4b61866298c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a88e8f51-21e8-42cb-bc8d-03c9482607c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"5c25d5a3-7dd5-4d01-adc8-a4b61866298c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"5c25d5a3-7dd5-4d01-adc8-a4b61866298c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:30Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"0d09e5ee-fe6f-4a6c-bc41-b14b6dd9f404","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"0d09e5ee-fe6f-4a6c-bc41-b14b6dd9f404","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"70b22d98-5b1d-41d6-a88a-6d9f4d21b912"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"70b22d98-5b1d-41d6-a88a-6d9f4d21b912"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"70b22d98-5b1d-41d6-a88a-6d9f4d21b912","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"70b22d98-5b1d-41d6-a88a-6d9f4d21b912","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"70b22d98-5b1d-41d6-a88a-6d9f4d21b912","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"70b22d98-5b1d-41d6-a88a-6d9f4d21b912","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"70b22d98-5b1d-41d6-a88a-6d9f4d21b912","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a484e497-e1d5-4183-8446-c4f69f3ad6c4"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a484e497-e1d5-4183-8446-c4f69f3ad6c4"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a484e497-e1d5-4183-8446-c4f69f3ad6c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a484e497-e1d5-4183-8446-c4f69f3ad6c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a484e497-e1d5-4183-8446-c4f69f3ad6c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a484e497-e1d5-4183-8446-c4f69f3ad6c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a484e497-e1d5-4183-8446-c4f69f3ad6c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a484e497-e1d5-4183-8446-c4f69f3ad6c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a484e497-e1d5-4183-8446-c4f69f3ad6c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a484e497-e1d5-4183-8446-c4f69f3ad6c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a484e497-e1d5-4183-8446-c4f69f3ad6c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"70b22d98-5b1d-41d6-a88a-6d9f4d21b912","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a484e497-e1d5-4183-8446-c4f69f3ad6c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a484e497-e1d5-4183-8446-c4f69f3ad6c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a484e497-e1d5-4183-8446-c4f69f3ad6c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a484e497-e1d5-4183-8446-c4f69f3ad6c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a484e497-e1d5-4183-8446-c4f69f3ad6c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a484e497-e1d5-4183-8446-c4f69f3ad6c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a484e497-e1d5-4183-8446-c4f69f3ad6c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"70b22d98-5b1d-41d6-a88a-6d9f4d21b912","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:30Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e9b74275-5b00-418b-bed2-d90415dae56b","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:58:30Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e9b74275-5b00-418b-bed2-d90415dae56b","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:58:31Z","msg":"reconcile","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"10ea42ad-5124-4aa3-a043-ff8f6b3b43fe"} {"level":"info","ts":"2026-07-15T03:58:31Z","msg":"apply","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"10ea42ad-5124-4aa3-a043-ff8f6b3b43fe"} {"level":"info","ts":"2026-07-15T03:58:31Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"10ea42ad-5124-4aa3-a043-ff8f6b3b43fe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.initialize"} {"level":"info","ts":"2026-07-15T03:58:31Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"10ea42ad-5124-4aa3-a043-ff8f6b3b43fe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.setKustomizedParams"} {"level":"info","ts":"2026-07-15T03:58:31Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"10ea42ad-5124-4aa3-a043-ff8f6b3b43fe","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:31Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"10ea42ad-5124-4aa3-a043-ff8f6b3b43fe","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:31Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"10ea42ad-5124-4aa3-a043-ff8f6b3b43fe","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:31Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"d56c49c2-b9e3-4bd6-b27d-384c3cdf160a"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"10ea42ad-5124-4aa3-a043-ff8f6b3b43fe","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"10ea42ad-5124-4aa3-a043-ff8f6b3b43fe","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"10ea42ad-5124-4aa3-a043-ff8f6b3b43fe","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d47bc5c7-c33c-4860-b4f1-261a8b23d4ff"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d47bc5c7-c33c-4860-b4f1-261a8b23d4ff"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d47bc5c7-c33c-4860-b4f1-261a8b23d4ff","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d47bc5c7-c33c-4860-b4f1-261a8b23d4ff","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d47bc5c7-c33c-4860-b4f1-261a8b23d4ff","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d47bc5c7-c33c-4860-b4f1-261a8b23d4ff","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d47bc5c7-c33c-4860-b4f1-261a8b23d4ff","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d47bc5c7-c33c-4860-b4f1-261a8b23d4ff","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"d56c49c2-b9e3-4bd6-b27d-384c3cdf160a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Starting EventSource","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Starting EventSource","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Starting EventSource","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Starting EventSource","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"140be716-d784-48d0-8cc9-938b6d7a60c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"140be716-d784-48d0-8cc9-938b6d7a60c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/imagestreams.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"140be716-d784-48d0-8cc9-938b6d7a60c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"140be716-d784-48d0-8cc9-938b6d7a60c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0e8973db-fb7b-43c2-91b0-c7232a6f5afa"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0e8973db-fb7b-43c2-91b0-c7232a6f5afa"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0e8973db-fb7b-43c2-91b0-c7232a6f5afa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0e8973db-fb7b-43c2-91b0-c7232a6f5afa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0e8973db-fb7b-43c2-91b0-c7232a6f5afa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0e8973db-fb7b-43c2-91b0-c7232a6f5afa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0e8973db-fb7b-43c2-91b0-c7232a6f5afa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0e8973db-fb7b-43c2-91b0-c7232a6f5afa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d47bc5c7-c33c-4860-b4f1-261a8b23d4ff","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c43e0e5b-aea7-4cb6-b1c5-2876fe27da08"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c43e0e5b-aea7-4cb6-b1c5-2876fe27da08"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c43e0e5b-aea7-4cb6-b1c5-2876fe27da08","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c43e0e5b-aea7-4cb6-b1c5-2876fe27da08","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c43e0e5b-aea7-4cb6-b1c5-2876fe27da08","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c43e0e5b-aea7-4cb6-b1c5-2876fe27da08","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c43e0e5b-aea7-4cb6-b1c5-2876fe27da08","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bfa83d8d-677c-4431-b47e-2a26f64b95d8"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bfa83d8d-677c-4431-b47e-2a26f64b95d8"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bfa83d8d-677c-4431-b47e-2a26f64b95d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bfa83d8d-677c-4431-b47e-2a26f64b95d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bfa83d8d-677c-4431-b47e-2a26f64b95d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bfa83d8d-677c-4431-b47e-2a26f64b95d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bfa83d8d-677c-4431-b47e-2a26f64b95d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bfa83d8d-677c-4431-b47e-2a26f64b95d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bfa83d8d-677c-4431-b47e-2a26f64b95d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bfa83d8d-677c-4431-b47e-2a26f64b95d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bfa83d8d-677c-4431-b47e-2a26f64b95d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c43e0e5b-aea7-4cb6-b1c5-2876fe27da08","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bfa83d8d-677c-4431-b47e-2a26f64b95d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bfa83d8d-677c-4431-b47e-2a26f64b95d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bfa83d8d-677c-4431-b47e-2a26f64b95d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bfa83d8d-677c-4431-b47e-2a26f64b95d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bfa83d8d-677c-4431-b47e-2a26f64b95d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bfa83d8d-677c-4431-b47e-2a26f64b95d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bfa83d8d-677c-4431-b47e-2a26f64b95d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:33Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"33460a00-5615-4d44-a6fa-3ff6972ec003","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"33460a00-5615-4d44-a6fa-3ff6972ec003","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"befcfa95-afc6-4020-9d3f-8f0f7911adec"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"befcfa95-afc6-4020-9d3f-8f0f7911adec"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"befcfa95-afc6-4020-9d3f-8f0f7911adec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"befcfa95-afc6-4020-9d3f-8f0f7911adec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"befcfa95-afc6-4020-9d3f-8f0f7911adec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"befcfa95-afc6-4020-9d3f-8f0f7911adec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"befcfa95-afc6-4020-9d3f-8f0f7911adec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"befcfa95-afc6-4020-9d3f-8f0f7911adec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"befcfa95-afc6-4020-9d3f-8f0f7911adec","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"befcfa95-afc6-4020-9d3f-8f0f7911adec","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c43e0e5b-aea7-4cb6-b1c5-2876fe27da08","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"befcfa95-afc6-4020-9d3f-8f0f7911adec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"befcfa95-afc6-4020-9d3f-8f0f7911adec","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"befcfa95-afc6-4020-9d3f-8f0f7911adec","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"0e37058c-983a-4cdc-aa18-bf2ff6c9d60c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"0e37058c-983a-4cdc-aa18-bf2ff6c9d60c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"0e37058c-983a-4cdc-aa18-bf2ff6c9d60c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"32ff2169-2c1b-4cb6-973c-bad8b2b07494"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"32ff2169-2c1b-4cb6-973c-bad8b2b07494"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"32ff2169-2c1b-4cb6-973c-bad8b2b07494","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"32ff2169-2c1b-4cb6-973c-bad8b2b07494","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"32ff2169-2c1b-4cb6-973c-bad8b2b07494","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"32ff2169-2c1b-4cb6-973c-bad8b2b07494","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"32ff2169-2c1b-4cb6-973c-bad8b2b07494","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"32ff2169-2c1b-4cb6-973c-bad8b2b07494","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcef741e-37e5-477a-9fce-ae32a4d80cb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcef741e-37e5-477a-9fce-ae32a4d80cb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcef741e-37e5-477a-9fce-ae32a4d80cb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"32ff2169-2c1b-4cb6-973c-bad8b2b07494","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"reconcile","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"07344c36-c74c-478f-bbdd-14fccc310277"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"apply","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"07344c36-c74c-478f-bbdd-14fccc310277"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"07344c36-c74c-478f-bbdd-14fccc310277","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"07344c36-c74c-478f-bbdd-14fccc310277","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.initialize"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"07344c36-c74c-478f-bbdd-14fccc310277","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"07344c36-c74c-478f-bbdd-14fccc310277","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkJobSetCRD"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"07344c36-c74c-478f-bbdd-14fccc310277","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"07344c36-c74c-478f-bbdd-14fccc310277","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"07344c36-c74c-478f-bbdd-14fccc310277","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:34Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"140be716-d784-48d0-8cc9-938b6d7a60c9"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"07344c36-c74c-478f-bbdd-14fccc310277","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"07344c36-c74c-478f-bbdd-14fccc310277","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"07344c36-c74c-478f-bbdd-14fccc310277","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fbba7d28-401b-4a7d-8ac7-a2c45dfbad56"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fbba7d28-401b-4a7d-8ac7-a2c45dfbad56"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fbba7d28-401b-4a7d-8ac7-a2c45dfbad56","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fbba7d28-401b-4a7d-8ac7-a2c45dfbad56","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fbba7d28-401b-4a7d-8ac7-a2c45dfbad56","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fbba7d28-401b-4a7d-8ac7-a2c45dfbad56","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fbba7d28-401b-4a7d-8ac7-a2c45dfbad56","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fbba7d28-401b-4a7d-8ac7-a2c45dfbad56","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"140be716-d784-48d0-8cc9-938b6d7a60c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"reconcile","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"90796635-018e-4e0f-883d-9927cfb22509"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"apply","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"90796635-018e-4e0f-883d-9927cfb22509"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"90796635-018e-4e0f-883d-9927cfb22509","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.initialize"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"90796635-018e-4e0f-883d-9927cfb22509","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"90796635-018e-4e0f-883d-9927cfb22509","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.configureDependencies"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"90796635-018e-4e0f-883d-9927cfb22509","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.setKustomizedParams"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"90796635-018e-4e0f-883d-9927cfb22509","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fbba7d28-401b-4a7d-8ac7-a2c45dfbad56","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2eabdabc-5fd2-4e27-ae1d-10bc3aecc7e9"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2eabdabc-5fd2-4e27-ae1d-10bc3aecc7e9"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2eabdabc-5fd2-4e27-ae1d-10bc3aecc7e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2eabdabc-5fd2-4e27-ae1d-10bc3aecc7e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2eabdabc-5fd2-4e27-ae1d-10bc3aecc7e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2eabdabc-5fd2-4e27-ae1d-10bc3aecc7e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2eabdabc-5fd2-4e27-ae1d-10bc3aecc7e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c78a210d-5618-4815-9d6f-e9c5e7ac05e0"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c78a210d-5618-4815-9d6f-e9c5e7ac05e0"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c78a210d-5618-4815-9d6f-e9c5e7ac05e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c78a210d-5618-4815-9d6f-e9c5e7ac05e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c78a210d-5618-4815-9d6f-e9c5e7ac05e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c78a210d-5618-4815-9d6f-e9c5e7ac05e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c78a210d-5618-4815-9d6f-e9c5e7ac05e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c78a210d-5618-4815-9d6f-e9c5e7ac05e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c78a210d-5618-4815-9d6f-e9c5e7ac05e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c78a210d-5618-4815-9d6f-e9c5e7ac05e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c78a210d-5618-4815-9d6f-e9c5e7ac05e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:35Z","msg":"reconcile","controller":"trustyai","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrustyAI","TrustyAI":{"name":"default-trustyai"},"namespace":"","name":"default-trustyai","reconcileID":"fc8c7fb9-120d-457b-949c-ee524bb14b23"} {"level":"info","ts":"2026-07-15T03:58:35Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2eabdabc-5fd2-4e27-ae1d-10bc3aecc7e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:35Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b46a33ea-d012-41dd-8bfa-96f985447b01"} {"level":"info","ts":"2026-07-15T03:58:35Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b46a33ea-d012-41dd-8bfa-96f985447b01"} {"level":"info","ts":"2026-07-15T03:58:35Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b46a33ea-d012-41dd-8bfa-96f985447b01","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:58:35Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b46a33ea-d012-41dd-8bfa-96f985447b01","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:58:35Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c78a210d-5618-4815-9d6f-e9c5e7ac05e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:35Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c78a210d-5618-4815-9d6f-e9c5e7ac05e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:35Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c78a210d-5618-4815-9d6f-e9c5e7ac05e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:35Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c78a210d-5618-4815-9d6f-e9c5e7ac05e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:35Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c78a210d-5618-4815-9d6f-e9c5e7ac05e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:35Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c78a210d-5618-4815-9d6f-e9c5e7ac05e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:35Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c78a210d-5618-4815-9d6f-e9c5e7ac05e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:35Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b46a33ea-d012-41dd-8bfa-96f985447b01","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:58:35Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b46a33ea-d012-41dd-8bfa-96f985447b01","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:58:35Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b46a33ea-d012-41dd-8bfa-96f985447b01","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:58:35Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b46a33ea-d012-41dd-8bfa-96f985447b01","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:58:35Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b46a33ea-d012-41dd-8bfa-96f985447b01","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:35Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b46a33ea-d012-41dd-8bfa-96f985447b01","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"reconcile","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"9bd1d106-7505-4990-b234-99655dc31b66"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"apply","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"9bd1d106-7505-4990-b234-99655dc31b66"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"9bd1d106-7505-4990-b234-99655dc31b66","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/sanitycheck.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"9bd1d106-7505-4990-b234-99655dc31b66","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ray.initialize"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"9bd1d106-7505-4990-b234-99655dc31b66","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"9bd1d106-7505-4990-b234-99655dc31b66","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"9bd1d106-7505-4990-b234-99655dc31b66","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b46a33ea-d012-41dd-8bfa-96f985447b01","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b46a33ea-d012-41dd-8bfa-96f985447b01","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b46a33ea-d012-41dd-8bfa-96f985447b01","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4e14e788-5b33-4daf-927c-e48b65ae0118"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4e14e788-5b33-4daf-927c-e48b65ae0118"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4e14e788-5b33-4daf-927c-e48b65ae0118","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4e14e788-5b33-4daf-927c-e48b65ae0118","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"9bd1d106-7505-4990-b234-99655dc31b66","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"9bd1d106-7505-4990-b234-99655dc31b66","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"9bd1d106-7505-4990-b234-99655dc31b66","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2eabdabc-5fd2-4e27-ae1d-10bc3aecc7e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0e8973db-fb7b-43c2-91b0-c7232a6f5afa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"ea2f3f12-d29c-4ab9-a2ae-f4c47727b46d","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"ea2f3f12-d29c-4ab9-a2ae-f4c47727b46d","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cdee396d-293e-40d7-bd68-a8a8b6ed19ba"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cdee396d-293e-40d7-bd68-a8a8b6ed19ba"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cdee396d-293e-40d7-bd68-a8a8b6ed19ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cdee396d-293e-40d7-bd68-a8a8b6ed19ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cdee396d-293e-40d7-bd68-a8a8b6ed19ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cdee396d-293e-40d7-bd68-a8a8b6ed19ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cdee396d-293e-40d7-bd68-a8a8b6ed19ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cdee396d-293e-40d7-bd68-a8a8b6ed19ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cdee396d-293e-40d7-bd68-a8a8b6ed19ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cdee396d-293e-40d7-bd68-a8a8b6ed19ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cdee396d-293e-40d7-bd68-a8a8b6ed19ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4e14e788-5b33-4daf-927c-e48b65ae0118","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4e14e788-5b33-4daf-927c-e48b65ae0118","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4e14e788-5b33-4daf-927c-e48b65ae0118","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4e14e788-5b33-4daf-927c-e48b65ae0118","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4e14e788-5b33-4daf-927c-e48b65ae0118","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4e14e788-5b33-4daf-927c-e48b65ae0118","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cdee396d-293e-40d7-bd68-a8a8b6ed19ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cdee396d-293e-40d7-bd68-a8a8b6ed19ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cdee396d-293e-40d7-bd68-a8a8b6ed19ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cdee396d-293e-40d7-bd68-a8a8b6ed19ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cdee396d-293e-40d7-bd68-a8a8b6ed19ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cdee396d-293e-40d7-bd68-a8a8b6ed19ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cdee396d-293e-40d7-bd68-a8a8b6ed19ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0e8973db-fb7b-43c2-91b0-c7232a6f5afa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"894ea16e-9eba-49c2-b2fb-813dcf3b9cdc"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"894ea16e-9eba-49c2-b2fb-813dcf3b9cdc"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"894ea16e-9eba-49c2-b2fb-813dcf3b9cdc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"894ea16e-9eba-49c2-b2fb-813dcf3b9cdc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"894ea16e-9eba-49c2-b2fb-813dcf3b9cdc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"894ea16e-9eba-49c2-b2fb-813dcf3b9cdc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"894ea16e-9eba-49c2-b2fb-813dcf3b9cdc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"894ea16e-9eba-49c2-b2fb-813dcf3b9cdc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0e8973db-fb7b-43c2-91b0-c7232a6f5afa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0e8973db-fb7b-43c2-91b0-c7232a6f5afa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:36Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0e8973db-fb7b-43c2-91b0-c7232a6f5afa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4e14e788-5b33-4daf-927c-e48b65ae0118","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-15T03:58:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4e14e788-5b33-4daf-927c-e48b65ae0118","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4e14e788-5b33-4daf-927c-e48b65ae0118","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0ee10bf0-50ab-4da5-adf0-7c8e129300d4"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0ee10bf0-50ab-4da5-adf0-7c8e129300d4"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0ee10bf0-50ab-4da5-adf0-7c8e129300d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0ee10bf0-50ab-4da5-adf0-7c8e129300d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0ee10bf0-50ab-4da5-adf0-7c8e129300d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0ee10bf0-50ab-4da5-adf0-7c8e129300d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0ee10bf0-50ab-4da5-adf0-7c8e129300d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0ee10bf0-50ab-4da5-adf0-7c8e129300d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"894ea16e-9eba-49c2-b2fb-813dcf3b9cdc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"90796635-018e-4e0f-883d-9927cfb22509","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53acfbc1-f36c-4c2b-9486-589ca0267b18"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53acfbc1-f36c-4c2b-9486-589ca0267b18"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53acfbc1-f36c-4c2b-9486-589ca0267b18","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53acfbc1-f36c-4c2b-9486-589ca0267b18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53acfbc1-f36c-4c2b-9486-589ca0267b18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53acfbc1-f36c-4c2b-9486-589ca0267b18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53acfbc1-f36c-4c2b-9486-589ca0267b18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53acfbc1-f36c-4c2b-9486-589ca0267b18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53acfbc1-f36c-4c2b-9486-589ca0267b18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53acfbc1-f36c-4c2b-9486-589ca0267b18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53acfbc1-f36c-4c2b-9486-589ca0267b18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:38Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"dfebfa64-44c0-4b9c-a6b9-b60182776e53","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"dfebfa64-44c0-4b9c-a6b9-b60182776e53","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"df2188ee-08c6-4515-a087-414a0df236e8"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"df2188ee-08c6-4515-a087-414a0df236e8"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"df2188ee-08c6-4515-a087-414a0df236e8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"df2188ee-08c6-4515-a087-414a0df236e8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"df2188ee-08c6-4515-a087-414a0df236e8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"df2188ee-08c6-4515-a087-414a0df236e8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"df2188ee-08c6-4515-a087-414a0df236e8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53acfbc1-f36c-4c2b-9486-589ca0267b18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53acfbc1-f36c-4c2b-9486-589ca0267b18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53acfbc1-f36c-4c2b-9486-589ca0267b18","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53acfbc1-f36c-4c2b-9486-589ca0267b18","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53acfbc1-f36c-4c2b-9486-589ca0267b18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53acfbc1-f36c-4c2b-9486-589ca0267b18","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"53acfbc1-f36c-4c2b-9486-589ca0267b18","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"df2188ee-08c6-4515-a087-414a0df236e8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"90796635-018e-4e0f-883d-9927cfb22509","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"90796635-018e-4e0f-883d-9927cfb22509","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/imagestreams.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"90796635-018e-4e0f-883d-9927cfb22509","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"90796635-018e-4e0f-883d-9927cfb22509","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ae373797-d756-4518-9f6e-f80f807c3507"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ae373797-d756-4518-9f6e-f80f807c3507"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ae373797-d756-4518-9f6e-f80f807c3507","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ae373797-d756-4518-9f6e-f80f807c3507","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ae373797-d756-4518-9f6e-f80f807c3507","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ae373797-d756-4518-9f6e-f80f807c3507","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ae373797-d756-4518-9f6e-f80f807c3507","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ae373797-d756-4518-9f6e-f80f807c3507","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ae373797-d756-4518-9f6e-f80f807c3507","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ae373797-d756-4518-9f6e-f80f807c3507","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ae373797-d756-4518-9f6e-f80f807c3507","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:38Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"ecd87270-26d1-4c4d-9812-de7f503ea067","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"df2188ee-08c6-4515-a087-414a0df236e8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"ecd87270-26d1-4c4d-9812-de7f503ea067","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ae373797-d756-4518-9f6e-f80f807c3507","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ae373797-d756-4518-9f6e-f80f807c3507","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ae373797-d756-4518-9f6e-f80f807c3507","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ae373797-d756-4518-9f6e-f80f807c3507","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ae373797-d756-4518-9f6e-f80f807c3507","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ae373797-d756-4518-9f6e-f80f807c3507","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ae373797-d756-4518-9f6e-f80f807c3507","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0ee10bf0-50ab-4da5-adf0-7c8e129300d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0ee10bf0-50ab-4da5-adf0-7c8e129300d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0ee10bf0-50ab-4da5-adf0-7c8e129300d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0ee10bf0-50ab-4da5-adf0-7c8e129300d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"0ee10bf0-50ab-4da5-adf0-7c8e129300d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"45835fc7-4124-4e02-8fbe-40749760b72f"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"45835fc7-4124-4e02-8fbe-40749760b72f"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"45835fc7-4124-4e02-8fbe-40749760b72f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"45835fc7-4124-4e02-8fbe-40749760b72f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"45835fc7-4124-4e02-8fbe-40749760b72f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"45835fc7-4124-4e02-8fbe-40749760b72f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"45835fc7-4124-4e02-8fbe-40749760b72f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"45835fc7-4124-4e02-8fbe-40749760b72f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"45835fc7-4124-4e02-8fbe-40749760b72f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a6969260-9e48-44c0-8209-035e0bda126b"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a6969260-9e48-44c0-8209-035e0bda126b"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a6969260-9e48-44c0-8209-035e0bda126b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a6969260-9e48-44c0-8209-035e0bda126b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a6969260-9e48-44c0-8209-035e0bda126b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a6969260-9e48-44c0-8209-035e0bda126b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a6969260-9e48-44c0-8209-035e0bda126b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a6969260-9e48-44c0-8209-035e0bda126b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a6969260-9e48-44c0-8209-035e0bda126b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a6969260-9e48-44c0-8209-035e0bda126b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a6969260-9e48-44c0-8209-035e0bda126b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a6969260-9e48-44c0-8209-035e0bda126b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a6969260-9e48-44c0-8209-035e0bda126b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a6969260-9e48-44c0-8209-035e0bda126b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a6969260-9e48-44c0-8209-035e0bda126b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a6969260-9e48-44c0-8209-035e0bda126b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a6969260-9e48-44c0-8209-035e0bda126b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a6969260-9e48-44c0-8209-035e0bda126b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"86529cfd-7ef8-4568-b215-146065d84b87"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"86529cfd-7ef8-4568-b215-146065d84b87"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"86529cfd-7ef8-4568-b215-146065d84b87","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"86529cfd-7ef8-4568-b215-146065d84b87","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"86529cfd-7ef8-4568-b215-146065d84b87","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"86529cfd-7ef8-4568-b215-146065d84b87","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"86529cfd-7ef8-4568-b215-146065d84b87","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"86529cfd-7ef8-4568-b215-146065d84b87","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"86529cfd-7ef8-4568-b215-146065d84b87","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"86529cfd-7ef8-4568-b215-146065d84b87","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"86529cfd-7ef8-4568-b215-146065d84b87","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:40Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"aaf42c23-7bbe-4364-b24e-ddcdce5c3c1c","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"aaf42c23-7bbe-4364-b24e-ddcdce5c3c1c","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"86529cfd-7ef8-4568-b215-146065d84b87","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"86529cfd-7ef8-4568-b215-146065d84b87","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"86529cfd-7ef8-4568-b215-146065d84b87","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"86529cfd-7ef8-4568-b215-146065d84b87","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"86529cfd-7ef8-4568-b215-146065d84b87","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"86529cfd-7ef8-4568-b215-146065d84b87","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"86529cfd-7ef8-4568-b215-146065d84b87","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-15T03:58:43Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcef741e-37e5-477a-9fce-ae32a4d80cb6","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8260c5cd-8dbe-444d-8881-2c20d0c5b63b"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8260c5cd-8dbe-444d-8881-2c20d0c5b63b"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8260c5cd-8dbe-444d-8881-2c20d0c5b63b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8260c5cd-8dbe-444d-8881-2c20d0c5b63b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8260c5cd-8dbe-444d-8881-2c20d0c5b63b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"230a53b4-c2d2-41e0-bffc-30984ebd8cbf"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"230a53b4-c2d2-41e0-bffc-30984ebd8cbf"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"230a53b4-c2d2-41e0-bffc-30984ebd8cbf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"230a53b4-c2d2-41e0-bffc-30984ebd8cbf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"230a53b4-c2d2-41e0-bffc-30984ebd8cbf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"230a53b4-c2d2-41e0-bffc-30984ebd8cbf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"230a53b4-c2d2-41e0-bffc-30984ebd8cbf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"230a53b4-c2d2-41e0-bffc-30984ebd8cbf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"230a53b4-c2d2-41e0-bffc-30984ebd8cbf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"282d9180-ae0f-41d6-8b41-d5e43a675a03"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"282d9180-ae0f-41d6-8b41-d5e43a675a03"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"282d9180-ae0f-41d6-8b41-d5e43a675a03","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"282d9180-ae0f-41d6-8b41-d5e43a675a03","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"282d9180-ae0f-41d6-8b41-d5e43a675a03","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"282d9180-ae0f-41d6-8b41-d5e43a675a03","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"282d9180-ae0f-41d6-8b41-d5e43a675a03","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"282d9180-ae0f-41d6-8b41-d5e43a675a03","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"282d9180-ae0f-41d6-8b41-d5e43a675a03","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"282d9180-ae0f-41d6-8b41-d5e43a675a03","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"282d9180-ae0f-41d6-8b41-d5e43a675a03","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"282d9180-ae0f-41d6-8b41-d5e43a675a03","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"282d9180-ae0f-41d6-8b41-d5e43a675a03","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"282d9180-ae0f-41d6-8b41-d5e43a675a03","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"282d9180-ae0f-41d6-8b41-d5e43a675a03","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"282d9180-ae0f-41d6-8b41-d5e43a675a03","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"282d9180-ae0f-41d6-8b41-d5e43a675a03","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"282d9180-ae0f-41d6-8b41-d5e43a675a03","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:43Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"44c800c3-dcbd-452f-9783-a5e0521f961e","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"44c800c3-dcbd-452f-9783-a5e0521f961e","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8260c5cd-8dbe-444d-8881-2c20d0c5b63b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8260c5cd-8dbe-444d-8881-2c20d0c5b63b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8260c5cd-8dbe-444d-8881-2c20d0c5b63b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8260c5cd-8dbe-444d-8881-2c20d0c5b63b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8260c5cd-8dbe-444d-8881-2c20d0c5b63b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8260c5cd-8dbe-444d-8881-2c20d0c5b63b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T03:58:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8260c5cd-8dbe-444d-8881-2c20d0c5b63b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:44Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"90796635-018e-4e0f-883d-9927cfb22509"} {"level":"info","ts":"2026-07-15T03:58:44Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"90796635-018e-4e0f-883d-9927cfb22509","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:44Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f9370420-5175-4173-9c7f-03d681560d21"} {"level":"info","ts":"2026-07-15T03:58:44Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f9370420-5175-4173-9c7f-03d681560d21"} {"level":"info","ts":"2026-07-15T03:58:44Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f9370420-5175-4173-9c7f-03d681560d21","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:44Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f9370420-5175-4173-9c7f-03d681560d21","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:44Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f9370420-5175-4173-9c7f-03d681560d21","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:44Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f9370420-5175-4173-9c7f-03d681560d21","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:44Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f9370420-5175-4173-9c7f-03d681560d21","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:44Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f9370420-5175-4173-9c7f-03d681560d21","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:44Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f9370420-5175-4173-9c7f-03d681560d21","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-15T03:58:49Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8260c5cd-8dbe-444d-8881-2c20d0c5b63b","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"24357fb8-6198-4182-8974-3ee27d123c78"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"24357fb8-6198-4182-8974-3ee27d123c78"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"24357fb8-6198-4182-8974-3ee27d123c78","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"24357fb8-6198-4182-8974-3ee27d123c78","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"24357fb8-6198-4182-8974-3ee27d123c78","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e3461f37-caa7-41e7-8657-f960e7cc267b"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e3461f37-caa7-41e7-8657-f960e7cc267b"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e3461f37-caa7-41e7-8657-f960e7cc267b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e3461f37-caa7-41e7-8657-f960e7cc267b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e3461f37-caa7-41e7-8657-f960e7cc267b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e3461f37-caa7-41e7-8657-f960e7cc267b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e3461f37-caa7-41e7-8657-f960e7cc267b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e3461f37-caa7-41e7-8657-f960e7cc267b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e3461f37-caa7-41e7-8657-f960e7cc267b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"24357fb8-6198-4182-8974-3ee27d123c78","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"24357fb8-6198-4182-8974-3ee27d123c78","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"24357fb8-6198-4182-8974-3ee27d123c78","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"24357fb8-6198-4182-8974-3ee27d123c78","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"24357fb8-6198-4182-8974-3ee27d123c78","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"24357fb8-6198-4182-8974-3ee27d123c78","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"24357fb8-6198-4182-8974-3ee27d123c78","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-15T03:58:49Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"24357fb8-6198-4182-8974-3ee27d123c78","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"949765e9-f9fd-454f-a09f-749e9b8a52c4"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"949765e9-f9fd-454f-a09f-749e9b8a52c4"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"949765e9-f9fd-454f-a09f-749e9b8a52c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"949765e9-f9fd-454f-a09f-749e9b8a52c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"949765e9-f9fd-454f-a09f-749e9b8a52c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"949765e9-f9fd-454f-a09f-749e9b8a52c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"949765e9-f9fd-454f-a09f-749e9b8a52c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"949765e9-f9fd-454f-a09f-749e9b8a52c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"61eb7639-25ee-48e1-8298-c72521edc14c"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"61eb7639-25ee-48e1-8298-c72521edc14c"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"61eb7639-25ee-48e1-8298-c72521edc14c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"61eb7639-25ee-48e1-8298-c72521edc14c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"61eb7639-25ee-48e1-8298-c72521edc14c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"949765e9-f9fd-454f-a09f-749e9b8a52c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"61eb7639-25ee-48e1-8298-c72521edc14c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"61eb7639-25ee-48e1-8298-c72521edc14c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"61eb7639-25ee-48e1-8298-c72521edc14c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"61eb7639-25ee-48e1-8298-c72521edc14c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"61eb7639-25ee-48e1-8298-c72521edc14c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"61eb7639-25ee-48e1-8298-c72521edc14c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T03:58:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"61eb7639-25ee-48e1-8298-c72521edc14c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-15T03:58:50Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"61eb7639-25ee-48e1-8298-c72521edc14c","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"bfd4f8e1-183d-44ee-94a4-f9a06c2eba1d"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"bfd4f8e1-183d-44ee-94a4-f9a06c2eba1d"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"bfd4f8e1-183d-44ee-94a4-f9a06c2eba1d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"bfd4f8e1-183d-44ee-94a4-f9a06c2eba1d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"bfd4f8e1-183d-44ee-94a4-f9a06c2eba1d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"bfd4f8e1-183d-44ee-94a4-f9a06c2eba1d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"bfd4f8e1-183d-44ee-94a4-f9a06c2eba1d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"bfd4f8e1-183d-44ee-94a4-f9a06c2eba1d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"82c01cf9-7025-489d-bdcf-8e67b033ca27"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"82c01cf9-7025-489d-bdcf-8e67b033ca27"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"82c01cf9-7025-489d-bdcf-8e67b033ca27","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"82c01cf9-7025-489d-bdcf-8e67b033ca27","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"82c01cf9-7025-489d-bdcf-8e67b033ca27","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"bfd4f8e1-183d-44ee-94a4-f9a06c2eba1d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"82c01cf9-7025-489d-bdcf-8e67b033ca27","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"82c01cf9-7025-489d-bdcf-8e67b033ca27","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"82c01cf9-7025-489d-bdcf-8e67b033ca27","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"82c01cf9-7025-489d-bdcf-8e67b033ca27","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"82c01cf9-7025-489d-bdcf-8e67b033ca27","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"82c01cf9-7025-489d-bdcf-8e67b033ca27","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"82c01cf9-7025-489d-bdcf-8e67b033ca27","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-15T03:58:50Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"82c01cf9-7025-489d-bdcf-8e67b033ca27","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30cbe244-301b-4695-b105-44655da487c2"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30cbe244-301b-4695-b105-44655da487c2"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30cbe244-301b-4695-b105-44655da487c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30cbe244-301b-4695-b105-44655da487c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30cbe244-301b-4695-b105-44655da487c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30cbe244-301b-4695-b105-44655da487c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30cbe244-301b-4695-b105-44655da487c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30cbe244-301b-4695-b105-44655da487c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30cbe244-301b-4695-b105-44655da487c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"52b295c7-3946-44ab-8c4a-848049cbd92a"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"52b295c7-3946-44ab-8c4a-848049cbd92a"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"52b295c7-3946-44ab-8c4a-848049cbd92a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"52b295c7-3946-44ab-8c4a-848049cbd92a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"52b295c7-3946-44ab-8c4a-848049cbd92a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"52b295c7-3946-44ab-8c4a-848049cbd92a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"52b295c7-3946-44ab-8c4a-848049cbd92a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"52b295c7-3946-44ab-8c4a-848049cbd92a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"52b295c7-3946-44ab-8c4a-848049cbd92a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"52b295c7-3946-44ab-8c4a-848049cbd92a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"52b295c7-3946-44ab-8c4a-848049cbd92a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"52b295c7-3946-44ab-8c4a-848049cbd92a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-15T03:58:51Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"52b295c7-3946-44ab-8c4a-848049cbd92a","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30b87f8e-b19e-4a0f-abf7-ce865176873b"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30b87f8e-b19e-4a0f-abf7-ce865176873b"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30b87f8e-b19e-4a0f-abf7-ce865176873b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30b87f8e-b19e-4a0f-abf7-ce865176873b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30b87f8e-b19e-4a0f-abf7-ce865176873b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30b87f8e-b19e-4a0f-abf7-ce865176873b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30b87f8e-b19e-4a0f-abf7-ce865176873b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30b87f8e-b19e-4a0f-abf7-ce865176873b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30b87f8e-b19e-4a0f-abf7-ce865176873b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a5ca40f3-b797-4641-bc2d-d25e64862133"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a5ca40f3-b797-4641-bc2d-d25e64862133"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a5ca40f3-b797-4641-bc2d-d25e64862133","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a5ca40f3-b797-4641-bc2d-d25e64862133","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a5ca40f3-b797-4641-bc2d-d25e64862133","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a5ca40f3-b797-4641-bc2d-d25e64862133","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a5ca40f3-b797-4641-bc2d-d25e64862133","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a5ca40f3-b797-4641-bc2d-d25e64862133","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a5ca40f3-b797-4641-bc2d-d25e64862133","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a5ca40f3-b797-4641-bc2d-d25e64862133","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a5ca40f3-b797-4641-bc2d-d25e64862133","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a5ca40f3-b797-4641-bc2d-d25e64862133","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-15T03:58:52Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a5ca40f3-b797-4641-bc2d-d25e64862133","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"36d15dad-f2cc-4581-920c-4393d6a3df09"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"36d15dad-f2cc-4581-920c-4393d6a3df09"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"36d15dad-f2cc-4581-920c-4393d6a3df09","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"36d15dad-f2cc-4581-920c-4393d6a3df09","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"36d15dad-f2cc-4581-920c-4393d6a3df09","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"36d15dad-f2cc-4581-920c-4393d6a3df09","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"36d15dad-f2cc-4581-920c-4393d6a3df09","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"36d15dad-f2cc-4581-920c-4393d6a3df09","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"36d15dad-f2cc-4581-920c-4393d6a3df09","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"fd6a5742-7b7b-4d43-a4c8-d67b535d84a1"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"fd6a5742-7b7b-4d43-a4c8-d67b535d84a1"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"fd6a5742-7b7b-4d43-a4c8-d67b535d84a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"fd6a5742-7b7b-4d43-a4c8-d67b535d84a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"fd6a5742-7b7b-4d43-a4c8-d67b535d84a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"fd6a5742-7b7b-4d43-a4c8-d67b535d84a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"fd6a5742-7b7b-4d43-a4c8-d67b535d84a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"fd6a5742-7b7b-4d43-a4c8-d67b535d84a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"fd6a5742-7b7b-4d43-a4c8-d67b535d84a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"fd6a5742-7b7b-4d43-a4c8-d67b535d84a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"fd6a5742-7b7b-4d43-a4c8-d67b535d84a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T03:58:52Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"fd6a5742-7b7b-4d43-a4c8-d67b535d84a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-15T03:58:53Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"fd6a5742-7b7b-4d43-a4c8-d67b535d84a1","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:58:53Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"42a061c3-7ab5-4aef-8df0-b28167cd7207"} {"level":"info","ts":"2026-07-15T03:58:53Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"42a061c3-7ab5-4aef-8df0-b28167cd7207"} {"level":"info","ts":"2026-07-15T03:58:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"42a061c3-7ab5-4aef-8df0-b28167cd7207","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"42a061c3-7ab5-4aef-8df0-b28167cd7207","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"42a061c3-7ab5-4aef-8df0-b28167cd7207","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"42a061c3-7ab5-4aef-8df0-b28167cd7207","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"42a061c3-7ab5-4aef-8df0-b28167cd7207","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"42a061c3-7ab5-4aef-8df0-b28167cd7207","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"42a061c3-7ab5-4aef-8df0-b28167cd7207","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:53Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"efaca575-d0ed-4145-ba2f-22ec018344cb"} {"level":"info","ts":"2026-07-15T03:58:53Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"efaca575-d0ed-4145-ba2f-22ec018344cb"} {"level":"info","ts":"2026-07-15T03:58:53Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"efaca575-d0ed-4145-ba2f-22ec018344cb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T03:58:53Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"efaca575-d0ed-4145-ba2f-22ec018344cb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:53Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"efaca575-d0ed-4145-ba2f-22ec018344cb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:54Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"efaca575-d0ed-4145-ba2f-22ec018344cb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:54Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"efaca575-d0ed-4145-ba2f-22ec018344cb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T03:58:54Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"efaca575-d0ed-4145-ba2f-22ec018344cb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T03:58:54Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"efaca575-d0ed-4145-ba2f-22ec018344cb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:54Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"efaca575-d0ed-4145-ba2f-22ec018344cb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T03:58:54Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"efaca575-d0ed-4145-ba2f-22ec018344cb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T03:58:54Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"efaca575-d0ed-4145-ba2f-22ec018344cb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-15T03:58:54Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"efaca575-d0ed-4145-ba2f-22ec018344cb","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:58:54Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"77b24c32-b155-4399-a216-f0f888e92462"} {"level":"info","ts":"2026-07-15T03:58:54Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"77b24c32-b155-4399-a216-f0f888e92462"} {"level":"info","ts":"2026-07-15T03:58:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"77b24c32-b155-4399-a216-f0f888e92462","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"77b24c32-b155-4399-a216-f0f888e92462","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"77b24c32-b155-4399-a216-f0f888e92462","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"77b24c32-b155-4399-a216-f0f888e92462","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"77b24c32-b155-4399-a216-f0f888e92462","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"77b24c32-b155-4399-a216-f0f888e92462","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"77b24c32-b155-4399-a216-f0f888e92462","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:55Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcf5d351-72f9-4c74-8ca8-945a83d0d70f"} {"level":"info","ts":"2026-07-15T03:58:55Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcf5d351-72f9-4c74-8ca8-945a83d0d70f"} {"level":"info","ts":"2026-07-15T03:58:55Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcf5d351-72f9-4c74-8ca8-945a83d0d70f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T03:58:55Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcf5d351-72f9-4c74-8ca8-945a83d0d70f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:55Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcf5d351-72f9-4c74-8ca8-945a83d0d70f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:55Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcf5d351-72f9-4c74-8ca8-945a83d0d70f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:55Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcf5d351-72f9-4c74-8ca8-945a83d0d70f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T03:58:55Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcf5d351-72f9-4c74-8ca8-945a83d0d70f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T03:58:55Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcf5d351-72f9-4c74-8ca8-945a83d0d70f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:55Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcf5d351-72f9-4c74-8ca8-945a83d0d70f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T03:58:55Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcf5d351-72f9-4c74-8ca8-945a83d0d70f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T03:58:55Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcf5d351-72f9-4c74-8ca8-945a83d0d70f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-15T03:58:56Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bcf5d351-72f9-4c74-8ca8-945a83d0d70f","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:58:56Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"45d6b882-8ed5-42fb-b867-c9bb89c58a09"} {"level":"info","ts":"2026-07-15T03:58:56Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"45d6b882-8ed5-42fb-b867-c9bb89c58a09"} {"level":"info","ts":"2026-07-15T03:58:56Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"45d6b882-8ed5-42fb-b867-c9bb89c58a09","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:56Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"45d6b882-8ed5-42fb-b867-c9bb89c58a09","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:56Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"45d6b882-8ed5-42fb-b867-c9bb89c58a09","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:56Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"45d6b882-8ed5-42fb-b867-c9bb89c58a09","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:56Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"45d6b882-8ed5-42fb-b867-c9bb89c58a09","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:56Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"45d6b882-8ed5-42fb-b867-c9bb89c58a09","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:56Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"45d6b882-8ed5-42fb-b867-c9bb89c58a09","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:58Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ff72c9bd-f95e-409d-9c8d-7efaba3ec2c1"} {"level":"info","ts":"2026-07-15T03:58:58Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ff72c9bd-f95e-409d-9c8d-7efaba3ec2c1"} {"level":"info","ts":"2026-07-15T03:58:58Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ff72c9bd-f95e-409d-9c8d-7efaba3ec2c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T03:58:58Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ff72c9bd-f95e-409d-9c8d-7efaba3ec2c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:58Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ff72c9bd-f95e-409d-9c8d-7efaba3ec2c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T03:58:58Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ff72c9bd-f95e-409d-9c8d-7efaba3ec2c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:58Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ff72c9bd-f95e-409d-9c8d-7efaba3ec2c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T03:58:58Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ff72c9bd-f95e-409d-9c8d-7efaba3ec2c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T03:58:58Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ff72c9bd-f95e-409d-9c8d-7efaba3ec2c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:58Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ff72c9bd-f95e-409d-9c8d-7efaba3ec2c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T03:58:58Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ff72c9bd-f95e-409d-9c8d-7efaba3ec2c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T03:58:58Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ff72c9bd-f95e-409d-9c8d-7efaba3ec2c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-15T03:58:59Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ff72c9bd-f95e-409d-9c8d-7efaba3ec2c1","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:58:59Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c950d42a-9cd9-43f8-bde1-c0f1ed361c77"} {"level":"info","ts":"2026-07-15T03:58:59Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c950d42a-9cd9-43f8-bde1-c0f1ed361c77"} {"level":"info","ts":"2026-07-15T03:58:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c950d42a-9cd9-43f8-bde1-c0f1ed361c77","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:58:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c950d42a-9cd9-43f8-bde1-c0f1ed361c77","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:58:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c950d42a-9cd9-43f8-bde1-c0f1ed361c77","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:58:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c950d42a-9cd9-43f8-bde1-c0f1ed361c77","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:58:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c950d42a-9cd9-43f8-bde1-c0f1ed361c77","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c950d42a-9cd9-43f8-bde1-c0f1ed361c77","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:58:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c950d42a-9cd9-43f8-bde1-c0f1ed361c77","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:59:04Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6b1e3eac-e1f3-4a90-a200-b96feb81d2ba"} {"level":"info","ts":"2026-07-15T03:59:04Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6b1e3eac-e1f3-4a90-a200-b96feb81d2ba"} {"level":"info","ts":"2026-07-15T03:59:04Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6b1e3eac-e1f3-4a90-a200-b96feb81d2ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T03:59:04Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6b1e3eac-e1f3-4a90-a200-b96feb81d2ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:04Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6b1e3eac-e1f3-4a90-a200-b96feb81d2ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T03:59:04Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6b1e3eac-e1f3-4a90-a200-b96feb81d2ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:04Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6b1e3eac-e1f3-4a90-a200-b96feb81d2ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T03:59:04Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6b1e3eac-e1f3-4a90-a200-b96feb81d2ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T03:59:04Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6b1e3eac-e1f3-4a90-a200-b96feb81d2ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:04Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6b1e3eac-e1f3-4a90-a200-b96feb81d2ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T03:59:04Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6b1e3eac-e1f3-4a90-a200-b96feb81d2ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T03:59:04Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6b1e3eac-e1f3-4a90-a200-b96feb81d2ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-15T03:59:05Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6b1e3eac-e1f3-4a90-a200-b96feb81d2ba","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:59:05Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f3e66590-411d-4ae0-9927-678a6f004589"} {"level":"info","ts":"2026-07-15T03:59:05Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f3e66590-411d-4ae0-9927-678a6f004589"} {"level":"info","ts":"2026-07-15T03:59:05Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f3e66590-411d-4ae0-9927-678a6f004589","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:59:05Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f3e66590-411d-4ae0-9927-678a6f004589","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:59:05Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f3e66590-411d-4ae0-9927-678a6f004589","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:59:05Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f3e66590-411d-4ae0-9927-678a6f004589","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:59:05Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f3e66590-411d-4ae0-9927-678a6f004589","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:05Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f3e66590-411d-4ae0-9927-678a6f004589","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:05Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f3e66590-411d-4ae0-9927-678a6f004589","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"719a9733-8b2b-4afc-98bf-d7e0a06e2272"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"719a9733-8b2b-4afc-98bf-d7e0a06e2272"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"719a9733-8b2b-4afc-98bf-d7e0a06e2272","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"719a9733-8b2b-4afc-98bf-d7e0a06e2272","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"719a9733-8b2b-4afc-98bf-d7e0a06e2272","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"719a9733-8b2b-4afc-98bf-d7e0a06e2272","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"719a9733-8b2b-4afc-98bf-d7e0a06e2272","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"719a9733-8b2b-4afc-98bf-d7e0a06e2272","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"719a9733-8b2b-4afc-98bf-d7e0a06e2272","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"719a9733-8b2b-4afc-98bf-d7e0a06e2272","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"719a9733-8b2b-4afc-98bf-d7e0a06e2272","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"719a9733-8b2b-4afc-98bf-d7e0a06e2272","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-15T03:59:15Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"719a9733-8b2b-4afc-98bf-d7e0a06e2272","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-1-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e1294059-70ae-45d7-86d1-3b93b66e781a"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e1294059-70ae-45d7-86d1-3b93b66e781a"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e1294059-70ae-45d7-86d1-3b93b66e781a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e1294059-70ae-45d7-86d1-3b93b66e781a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e1294059-70ae-45d7-86d1-3b93b66e781a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e1294059-70ae-45d7-86d1-3b93b66e781a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e1294059-70ae-45d7-86d1-3b93b66e781a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e1294059-70ae-45d7-86d1-3b93b66e781a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e1294059-70ae-45d7-86d1-3b93b66e781a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:59:16Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7f80a137-b919-43b7-850d-78e2f6eb4aa3"} {"level":"info","ts":"2026-07-15T03:59:16Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7f80a137-b919-43b7-850d-78e2f6eb4aa3"} {"level":"info","ts":"2026-07-15T03:59:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7f80a137-b919-43b7-850d-78e2f6eb4aa3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T03:59:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7f80a137-b919-43b7-850d-78e2f6eb4aa3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7f80a137-b919-43b7-850d-78e2f6eb4aa3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T03:59:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7f80a137-b919-43b7-850d-78e2f6eb4aa3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7f80a137-b919-43b7-850d-78e2f6eb4aa3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T03:59:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7f80a137-b919-43b7-850d-78e2f6eb4aa3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T03:59:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7f80a137-b919-43b7-850d-78e2f6eb4aa3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7f80a137-b919-43b7-850d-78e2f6eb4aa3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T03:59:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7f80a137-b919-43b7-850d-78e2f6eb4aa3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T03:59:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7f80a137-b919-43b7-850d-78e2f6eb4aa3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:17Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7f80a137-b919-43b7-850d-78e2f6eb4aa3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7f80a137-b919-43b7-850d-78e2f6eb4aa3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7f80a137-b919-43b7-850d-78e2f6eb4aa3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7f80a137-b919-43b7-850d-78e2f6eb4aa3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"88737341-de1d-4a8b-842b-75c90dc04e47"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"88737341-de1d-4a8b-842b-75c90dc04e47"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"88737341-de1d-4a8b-842b-75c90dc04e47","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"88737341-de1d-4a8b-842b-75c90dc04e47","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"88737341-de1d-4a8b-842b-75c90dc04e47","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"efbbb8e4-2e08-4f27-a636-3a53e1388507"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"efbbb8e4-2e08-4f27-a636-3a53e1388507"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"efbbb8e4-2e08-4f27-a636-3a53e1388507","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"efbbb8e4-2e08-4f27-a636-3a53e1388507","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"efbbb8e4-2e08-4f27-a636-3a53e1388507","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"efbbb8e4-2e08-4f27-a636-3a53e1388507","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"efbbb8e4-2e08-4f27-a636-3a53e1388507","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"efbbb8e4-2e08-4f27-a636-3a53e1388507","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"88737341-de1d-4a8b-842b-75c90dc04e47","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"88737341-de1d-4a8b-842b-75c90dc04e47","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"88737341-de1d-4a8b-842b-75c90dc04e47","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"88737341-de1d-4a8b-842b-75c90dc04e47","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"88737341-de1d-4a8b-842b-75c90dc04e47","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"88737341-de1d-4a8b-842b-75c90dc04e47","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"88737341-de1d-4a8b-842b-75c90dc04e47","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"efbbb8e4-2e08-4f27-a636-3a53e1388507","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d9e04d3f-cdc0-4912-89f9-008b6b2f4340"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d9e04d3f-cdc0-4912-89f9-008b6b2f4340"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d9e04d3f-cdc0-4912-89f9-008b6b2f4340","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d9e04d3f-cdc0-4912-89f9-008b6b2f4340","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d9e04d3f-cdc0-4912-89f9-008b6b2f4340","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d9e04d3f-cdc0-4912-89f9-008b6b2f4340","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d9e04d3f-cdc0-4912-89f9-008b6b2f4340","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d9e04d3f-cdc0-4912-89f9-008b6b2f4340","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d9e04d3f-cdc0-4912-89f9-008b6b2f4340","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d9e04d3f-cdc0-4912-89f9-008b6b2f4340","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d9e04d3f-cdc0-4912-89f9-008b6b2f4340","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d9e04d3f-cdc0-4912-89f9-008b6b2f4340","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d9e04d3f-cdc0-4912-89f9-008b6b2f4340","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d9e04d3f-cdc0-4912-89f9-008b6b2f4340","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d9e04d3f-cdc0-4912-89f9-008b6b2f4340","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d9e04d3f-cdc0-4912-89f9-008b6b2f4340","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d9e04d3f-cdc0-4912-89f9-008b6b2f4340","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d9e04d3f-cdc0-4912-89f9-008b6b2f4340","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"88737341-de1d-4a8b-842b-75c90dc04e47","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"88737341-de1d-4a8b-842b-75c90dc04e47","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"88737341-de1d-4a8b-842b-75c90dc04e47","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"88737341-de1d-4a8b-842b-75c90dc04e47","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:59:19Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"95ed36cb-5c78-4681-8342-630375d3f688","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"95ed36cb-5c78-4681-8342-630375d3f688","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ef229b83-891c-4665-84ac-673649af4bcd"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ef229b83-891c-4665-84ac-673649af4bcd"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ef229b83-891c-4665-84ac-673649af4bcd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ef229b83-891c-4665-84ac-673649af4bcd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ef229b83-891c-4665-84ac-673649af4bcd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ef229b83-891c-4665-84ac-673649af4bcd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ef229b83-891c-4665-84ac-673649af4bcd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ef229b83-891c-4665-84ac-673649af4bcd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ef229b83-891c-4665-84ac-673649af4bcd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"299e71a4-bbfd-4321-818f-daed585b4c6f"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"299e71a4-bbfd-4321-818f-daed585b4c6f"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"299e71a4-bbfd-4321-818f-daed585b4c6f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"299e71a4-bbfd-4321-818f-daed585b4c6f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"299e71a4-bbfd-4321-818f-daed585b4c6f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"299e71a4-bbfd-4321-818f-daed585b4c6f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"299e71a4-bbfd-4321-818f-daed585b4c6f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:19Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"299e71a4-bbfd-4321-818f-daed585b4c6f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:20Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"299e71a4-bbfd-4321-818f-daed585b4c6f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:20Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"299e71a4-bbfd-4321-818f-daed585b4c6f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-15T03:59:20Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"299e71a4-bbfd-4321-818f-daed585b4c6f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-15T03:59:20Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"299e71a4-bbfd-4321-818f-daed585b4c6f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:20Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"299e71a4-bbfd-4321-818f-daed585b4c6f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:59:20Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"375f8678-74ac-4fa8-a76c-3050b09183d5"} {"level":"info","ts":"2026-07-15T03:59:20Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"375f8678-74ac-4fa8-a76c-3050b09183d5"} {"level":"info","ts":"2026-07-15T03:59:20Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"375f8678-74ac-4fa8-a76c-3050b09183d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:59:20Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"375f8678-74ac-4fa8-a76c-3050b09183d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:59:20Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"375f8678-74ac-4fa8-a76c-3050b09183d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:59:20Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"375f8678-74ac-4fa8-a76c-3050b09183d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:59:20Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"375f8678-74ac-4fa8-a76c-3050b09183d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:20Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"375f8678-74ac-4fa8-a76c-3050b09183d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:20Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"375f8678-74ac-4fa8-a76c-3050b09183d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:59:21Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fdb5ef32-644a-48f5-a821-b2d044ab5e75"} {"level":"info","ts":"2026-07-15T03:59:21Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fdb5ef32-644a-48f5-a821-b2d044ab5e75"} {"level":"info","ts":"2026-07-15T03:59:21Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fdb5ef32-644a-48f5-a821-b2d044ab5e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-15T03:59:21Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fdb5ef32-644a-48f5-a821-b2d044ab5e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-15T03:59:21Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fdb5ef32-644a-48f5-a821-b2d044ab5e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-15T03:59:21Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fdb5ef32-644a-48f5-a821-b2d044ab5e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-15T03:59:21Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fdb5ef32-644a-48f5-a821-b2d044ab5e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:21Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fdb5ef32-644a-48f5-a821-b2d044ab5e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fdb5ef32-644a-48f5-a821-b2d044ab5e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fdb5ef32-644a-48f5-a821-b2d044ab5e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fdb5ef32-644a-48f5-a821-b2d044ab5e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fdb5ef32-644a-48f5-a821-b2d044ab5e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fdb5ef32-644a-48f5-a821-b2d044ab5e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c41b34f6-c3dc-4025-adb0-17cc009082f0"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c41b34f6-c3dc-4025-adb0-17cc009082f0"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c41b34f6-c3dc-4025-adb0-17cc009082f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c41b34f6-c3dc-4025-adb0-17cc009082f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c41b34f6-c3dc-4025-adb0-17cc009082f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c41b34f6-c3dc-4025-adb0-17cc009082f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c41b34f6-c3dc-4025-adb0-17cc009082f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c41b34f6-c3dc-4025-adb0-17cc009082f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c41b34f6-c3dc-4025-adb0-17cc009082f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6a84f57e-4ca9-469a-8e1e-f9e775991d52"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6a84f57e-4ca9-469a-8e1e-f9e775991d52"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6a84f57e-4ca9-469a-8e1e-f9e775991d52","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6a84f57e-4ca9-469a-8e1e-f9e775991d52","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6a84f57e-4ca9-469a-8e1e-f9e775991d52","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6a84f57e-4ca9-469a-8e1e-f9e775991d52","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6a84f57e-4ca9-469a-8e1e-f9e775991d52","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6a84f57e-4ca9-469a-8e1e-f9e775991d52","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6a84f57e-4ca9-469a-8e1e-f9e775991d52","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6a84f57e-4ca9-469a-8e1e-f9e775991d52","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6a84f57e-4ca9-469a-8e1e-f9e775991d52","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6a84f57e-4ca9-469a-8e1e-f9e775991d52","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6a84f57e-4ca9-469a-8e1e-f9e775991d52","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6a84f57e-4ca9-469a-8e1e-f9e775991d52","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6a84f57e-4ca9-469a-8e1e-f9e775991d52","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6a84f57e-4ca9-469a-8e1e-f9e775991d52","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6a84f57e-4ca9-469a-8e1e-f9e775991d52","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6a84f57e-4ca9-469a-8e1e-f9e775991d52","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T03:59:22Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8fb4597e-785f-4bc3-8f6c-def3da3cead3","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T03:59:22Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8fb4597e-785f-4bc3-8f6c-def3da3cead3","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:03:03Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5779d1aa-7ab6-48e3-9d78-8beeb01a766d"} {"level":"info","ts":"2026-07-15T04:03:03Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5779d1aa-7ab6-48e3-9d78-8beeb01a766d"} {"level":"info","ts":"2026-07-15T04:03:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5779d1aa-7ab6-48e3-9d78-8beeb01a766d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T04:03:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5779d1aa-7ab6-48e3-9d78-8beeb01a766d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T04:03:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5779d1aa-7ab6-48e3-9d78-8beeb01a766d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T04:03:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5779d1aa-7ab6-48e3-9d78-8beeb01a766d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T04:03:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5779d1aa-7ab6-48e3-9d78-8beeb01a766d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T04:03:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5779d1aa-7ab6-48e3-9d78-8beeb01a766d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T04:03:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5779d1aa-7ab6-48e3-9d78-8beeb01a766d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:03:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5779d1aa-7ab6-48e3-9d78-8beeb01a766d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:03:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5779d1aa-7ab6-48e3-9d78-8beeb01a766d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-15T04:03:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5779d1aa-7ab6-48e3-9d78-8beeb01a766d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:03:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5779d1aa-7ab6-48e3-9d78-8beeb01a766d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8e5d8fd9-16fc-4d44-a467-bd00b322f713"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8e5d8fd9-16fc-4d44-a467-bd00b322f713"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8e5d8fd9-16fc-4d44-a467-bd00b322f713","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8e5d8fd9-16fc-4d44-a467-bd00b322f713","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8e5d8fd9-16fc-4d44-a467-bd00b322f713","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8e5d8fd9-16fc-4d44-a467-bd00b322f713","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8e5d8fd9-16fc-4d44-a467-bd00b322f713","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8e5d8fd9-16fc-4d44-a467-bd00b322f713","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8e5d8fd9-16fc-4d44-a467-bd00b322f713","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8e5d8fd9-16fc-4d44-a467-bd00b322f713","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8e5d8fd9-16fc-4d44-a467-bd00b322f713","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8e5d8fd9-16fc-4d44-a467-bd00b322f713","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8e5d8fd9-16fc-4d44-a467-bd00b322f713","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8e5d8fd9-16fc-4d44-a467-bd00b322f713","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8e5d8fd9-16fc-4d44-a467-bd00b322f713","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8e5d8fd9-16fc-4d44-a467-bd00b322f713","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6bc7629c-f71c-4206-bcbc-49e807304a0e"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6bc7629c-f71c-4206-bcbc-49e807304a0e"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6bc7629c-f71c-4206-bcbc-49e807304a0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6bc7629c-f71c-4206-bcbc-49e807304a0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6bc7629c-f71c-4206-bcbc-49e807304a0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6bc7629c-f71c-4206-bcbc-49e807304a0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6bc7629c-f71c-4206-bcbc-49e807304a0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:07:03Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6bc7629c-f71c-4206-bcbc-49e807304a0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:07:04Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6bc7629c-f71c-4206-bcbc-49e807304a0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:10:02Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"756986f2-fa2b-448f-b906-371406c69796"} {"level":"info","ts":"2026-07-15T04:10:02Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"756986f2-fa2b-448f-b906-371406c69796"} {"level":"info","ts":"2026-07-15T04:10:02Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"756986f2-fa2b-448f-b906-371406c69796","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T04:10:02Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"756986f2-fa2b-448f-b906-371406c69796","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:02Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"756986f2-fa2b-448f-b906-371406c69796","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T04:10:02Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"756986f2-fa2b-448f-b906-371406c69796","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:02Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"756986f2-fa2b-448f-b906-371406c69796","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T04:10:02Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"756986f2-fa2b-448f-b906-371406c69796","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T04:10:02Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"756986f2-fa2b-448f-b906-371406c69796","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:02Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"756986f2-fa2b-448f-b906-371406c69796","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T04:10:02Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"756986f2-fa2b-448f-b906-371406c69796","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T04:10:02Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"756986f2-fa2b-448f-b906-371406c69796","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"756986f2-fa2b-448f-b906-371406c69796","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"756986f2-fa2b-448f-b906-371406c69796","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"756986f2-fa2b-448f-b906-371406c69796","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"756986f2-fa2b-448f-b906-371406c69796","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f196189e-ce28-495a-b2f6-031201c485ad"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f196189e-ce28-495a-b2f6-031201c485ad"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f196189e-ce28-495a-b2f6-031201c485ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f196189e-ce28-495a-b2f6-031201c485ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f196189e-ce28-495a-b2f6-031201c485ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3c166f31-00fc-4cb0-91ff-7945d980ae5c"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3c166f31-00fc-4cb0-91ff-7945d980ae5c"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3c166f31-00fc-4cb0-91ff-7945d980ae5c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3c166f31-00fc-4cb0-91ff-7945d980ae5c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3c166f31-00fc-4cb0-91ff-7945d980ae5c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3c166f31-00fc-4cb0-91ff-7945d980ae5c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3c166f31-00fc-4cb0-91ff-7945d980ae5c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f196189e-ce28-495a-b2f6-031201c485ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f196189e-ce28-495a-b2f6-031201c485ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f196189e-ce28-495a-b2f6-031201c485ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f196189e-ce28-495a-b2f6-031201c485ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3c166f31-00fc-4cb0-91ff-7945d980ae5c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f196189e-ce28-495a-b2f6-031201c485ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f196189e-ce28-495a-b2f6-031201c485ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T04:10:07Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f196189e-ce28-495a-b2f6-031201c485ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3c166f31-00fc-4cb0-91ff-7945d980ae5c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f196189e-ce28-495a-b2f6-031201c485ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f196189e-ce28-495a-b2f6-031201c485ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f196189e-ce28-495a-b2f6-031201c485ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f196189e-ce28-495a-b2f6-031201c485ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b9b7dab3-fcbb-44c4-9d0e-f5077089dadb"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b9b7dab3-fcbb-44c4-9d0e-f5077089dadb"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b9b7dab3-fcbb-44c4-9d0e-f5077089dadb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b9b7dab3-fcbb-44c4-9d0e-f5077089dadb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b9b7dab3-fcbb-44c4-9d0e-f5077089dadb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b9b7dab3-fcbb-44c4-9d0e-f5077089dadb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b9b7dab3-fcbb-44c4-9d0e-f5077089dadb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8d1b16fd-ba9f-4ecd-a2ef-4706f1734ee1"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8d1b16fd-ba9f-4ecd-a2ef-4706f1734ee1"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8d1b16fd-ba9f-4ecd-a2ef-4706f1734ee1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8d1b16fd-ba9f-4ecd-a2ef-4706f1734ee1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8d1b16fd-ba9f-4ecd-a2ef-4706f1734ee1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b9b7dab3-fcbb-44c4-9d0e-f5077089dadb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8d1b16fd-ba9f-4ecd-a2ef-4706f1734ee1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8d1b16fd-ba9f-4ecd-a2ef-4706f1734ee1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8d1b16fd-ba9f-4ecd-a2ef-4706f1734ee1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8d1b16fd-ba9f-4ecd-a2ef-4706f1734ee1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8d1b16fd-ba9f-4ecd-a2ef-4706f1734ee1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8d1b16fd-ba9f-4ecd-a2ef-4706f1734ee1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8d1b16fd-ba9f-4ecd-a2ef-4706f1734ee1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:08Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b9b7dab3-fcbb-44c4-9d0e-f5077089dadb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:10:09Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8d1b16fd-ba9f-4ecd-a2ef-4706f1734ee1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-15T04:10:09Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8d1b16fd-ba9f-4ecd-a2ef-4706f1734ee1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:09Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8d1b16fd-ba9f-4ecd-a2ef-4706f1734ee1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:09Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"8d1b16fd-ba9f-4ecd-a2ef-4706f1734ee1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:10:09Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e6682e3b-366a-42b2-9e91-2d7ef2795182"} {"level":"info","ts":"2026-07-15T04:10:09Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e6682e3b-366a-42b2-9e91-2d7ef2795182"} {"level":"info","ts":"2026-07-15T04:10:09Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e6682e3b-366a-42b2-9e91-2d7ef2795182","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:10:09Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e6682e3b-366a-42b2-9e91-2d7ef2795182","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:10:09Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e6682e3b-366a-42b2-9e91-2d7ef2795182","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:10:09Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e6682e3b-366a-42b2-9e91-2d7ef2795182","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:10:09Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e6682e3b-366a-42b2-9e91-2d7ef2795182","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:09Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e6682e3b-366a-42b2-9e91-2d7ef2795182","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:10:09Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e6682e3b-366a-42b2-9e91-2d7ef2795182","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:18Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"99601d73-39f9-4ce2-a21a-a2db2ddb3ca9"} {"level":"info","ts":"2026-07-15T04:12:18Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"99601d73-39f9-4ce2-a21a-a2db2ddb3ca9"} {"level":"info","ts":"2026-07-15T04:12:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"99601d73-39f9-4ce2-a21a-a2db2ddb3ca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T04:12:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"99601d73-39f9-4ce2-a21a-a2db2ddb3ca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T04:12:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"99601d73-39f9-4ce2-a21a-a2db2ddb3ca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T04:12:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"99601d73-39f9-4ce2-a21a-a2db2ddb3ca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T04:12:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"99601d73-39f9-4ce2-a21a-a2db2ddb3ca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T04:12:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"99601d73-39f9-4ce2-a21a-a2db2ddb3ca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T04:12:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"99601d73-39f9-4ce2-a21a-a2db2ddb3ca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"99601d73-39f9-4ce2-a21a-a2db2ddb3ca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:19Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm","msg":"EnvoyFilter exposes internal implementation details that may change at any time. Prefer other APIs if possible, and exercise extreme caution, especially around upgrades.","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"99601d73-39f9-4ce2-a21a-a2db2ddb3ca9"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"392feb40-c821-4d25-ac2c-2a2c3e6c7552"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"392feb40-c821-4d25-ac2c-2a2c3e6c7552"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"392feb40-c821-4d25-ac2c-2a2c3e6c7552","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"392feb40-c821-4d25-ac2c-2a2c3e6c7552","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"392feb40-c821-4d25-ac2c-2a2c3e6c7552","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"392feb40-c821-4d25-ac2c-2a2c3e6c7552","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"392feb40-c821-4d25-ac2c-2a2c3e6c7552","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"392feb40-c821-4d25-ac2c-2a2c3e6c7552","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"392feb40-c821-4d25-ac2c-2a2c3e6c7552","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"392feb40-c821-4d25-ac2c-2a2c3e6c7552","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"392feb40-c821-4d25-ac2c-2a2c3e6c7552","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"392feb40-c821-4d25-ac2c-2a2c3e6c7552","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"392feb40-c821-4d25-ac2c-2a2c3e6c7552","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"392feb40-c821-4d25-ac2c-2a2c3e6c7552","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"392feb40-c821-4d25-ac2c-2a2c3e6c7552","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"392feb40-c821-4d25-ac2c-2a2c3e6c7552","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"392feb40-c821-4d25-ac2c-2a2c3e6c7552","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"392feb40-c821-4d25-ac2c-2a2c3e6c7552","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"99601d73-39f9-4ce2-a21a-a2db2ddb3ca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"99601d73-39f9-4ce2-a21a-a2db2ddb3ca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"99601d73-39f9-4ce2-a21a-a2db2ddb3ca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"24c97c24-113c-48f0-86ca-161f3bf07362"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"24c97c24-113c-48f0-86ca-161f3bf07362"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"24c97c24-113c-48f0-86ca-161f3bf07362","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"24c97c24-113c-48f0-86ca-161f3bf07362","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"24c97c24-113c-48f0-86ca-161f3bf07362","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"24c97c24-113c-48f0-86ca-161f3bf07362","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"24c97c24-113c-48f0-86ca-161f3bf07362","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"24c97c24-113c-48f0-86ca-161f3bf07362","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"24c97c24-113c-48f0-86ca-161f3bf07362","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"24c97c24-113c-48f0-86ca-161f3bf07362","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"24c97c24-113c-48f0-86ca-161f3bf07362","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"24c97c24-113c-48f0-86ca-161f3bf07362","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"24c97c24-113c-48f0-86ca-161f3bf07362","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:19Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"cf15f48c-35f1-4725-a417-3fa43ff951db","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:12:19Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"cf15f48c-35f1-4725-a417-3fa43ff951db","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a469f333-d06a-4599-b102-855a0fc391be"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a469f333-d06a-4599-b102-855a0fc391be"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a469f333-d06a-4599-b102-855a0fc391be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a469f333-d06a-4599-b102-855a0fc391be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef2075de-ad55-4cf7-a946-f6f25b88f817"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef2075de-ad55-4cf7-a946-f6f25b88f817"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef2075de-ad55-4cf7-a946-f6f25b88f817","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a469f333-d06a-4599-b102-855a0fc391be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef2075de-ad55-4cf7-a946-f6f25b88f817","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef2075de-ad55-4cf7-a946-f6f25b88f817","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef2075de-ad55-4cf7-a946-f6f25b88f817","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef2075de-ad55-4cf7-a946-f6f25b88f817","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef2075de-ad55-4cf7-a946-f6f25b88f817","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef2075de-ad55-4cf7-a946-f6f25b88f817","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef2075de-ad55-4cf7-a946-f6f25b88f817","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef2075de-ad55-4cf7-a946-f6f25b88f817","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a469f333-d06a-4599-b102-855a0fc391be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a469f333-d06a-4599-b102-855a0fc391be","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef2075de-ad55-4cf7-a946-f6f25b88f817","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef2075de-ad55-4cf7-a946-f6f25b88f817","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef2075de-ad55-4cf7-a946-f6f25b88f817","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef2075de-ad55-4cf7-a946-f6f25b88f817","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef2075de-ad55-4cf7-a946-f6f25b88f817","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef2075de-ad55-4cf7-a946-f6f25b88f817","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef2075de-ad55-4cf7-a946-f6f25b88f817","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"541c5341-9e17-4c49-abda-89dc10013b9b"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"541c5341-9e17-4c49-abda-89dc10013b9b"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"541c5341-9e17-4c49-abda-89dc10013b9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"541c5341-9e17-4c49-abda-89dc10013b9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"541c5341-9e17-4c49-abda-89dc10013b9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"reconcile","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"8d45b6dd-7207-428a-9219-0c159cd1eefc"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"apply","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"8d45b6dd-7207-428a-9219-0c159cd1eefc"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"8d45b6dd-7207-428a-9219-0c159cd1eefc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/sanitycheck.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"8d45b6dd-7207-428a-9219-0c159cd1eefc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ray.initialize"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"8d45b6dd-7207-428a-9219-0c159cd1eefc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"8d45b6dd-7207-428a-9219-0c159cd1eefc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"8d45b6dd-7207-428a-9219-0c159cd1eefc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"reconcile","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"baa99405-6b05-4efd-af41-46dcbfab966c"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"apply","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"baa99405-6b05-4efd-af41-46dcbfab966c"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"baa99405-6b05-4efd-af41-46dcbfab966c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.initialize"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"baa99405-6b05-4efd-af41-46dcbfab966c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.customizeManifests"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"baa99405-6b05-4efd-af41-46dcbfab966c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"baa99405-6b05-4efd-af41-46dcbfab966c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.configureDependencies"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"baa99405-6b05-4efd-af41-46dcbfab966c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"baa99405-6b05-4efd-af41-46dcbfab966c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"baa99405-6b05-4efd-af41-46dcbfab966c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"reconcile","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"1c854a58-f5dc-4093-a232-4d7df43c5be5"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"apply","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"1c854a58-f5dc-4093-a232-4d7df43c5be5"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"1c854a58-f5dc-4093-a232-4d7df43c5be5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"1c854a58-f5dc-4093-a232-4d7df43c5be5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.initialize"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"1c854a58-f5dc-4093-a232-4d7df43c5be5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"1c854a58-f5dc-4093-a232-4d7df43c5be5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkJobSetCRD"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"reconcile","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d383230a-f031-4c5f-bfab-133197e3899d"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"apply","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d383230a-f031-4c5f-bfab-133197e3899d"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d383230a-f031-4c5f-bfab-133197e3899d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.initialize"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d383230a-f031-4c5f-bfab-133197e3899d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d383230a-f031-4c5f-bfab-133197e3899d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.configureDependencies"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d383230a-f031-4c5f-bfab-133197e3899d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d383230a-f031-4c5f-bfab-133197e3899d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"15b6e301-60d0-471a-901a-1efba6acc4fb"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"15b6e301-60d0-471a-901a-1efba6acc4fb"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"15b6e301-60d0-471a-901a-1efba6acc4fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"15b6e301-60d0-471a-901a-1efba6acc4fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"15b6e301-60d0-471a-901a-1efba6acc4fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"1c854a58-f5dc-4093-a232-4d7df43c5be5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"1c854a58-f5dc-4093-a232-4d7df43c5be5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"reconcile","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"0dcc735f-c82d-466b-a216-4bde56828e13"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"apply","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"0dcc735f-c82d-466b-a216-4bde56828e13"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"0dcc735f-c82d-466b-a216-4bde56828e13","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.initialize"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"0dcc735f-c82d-466b-a216-4bde56828e13","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"0dcc735f-c82d-466b-a216-4bde56828e13","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"0dcc735f-c82d-466b-a216-4bde56828e13","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"1c854a58-f5dc-4093-a232-4d7df43c5be5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:22Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"0dcc735f-c82d-466b-a216-4bde56828e13","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"reconcile","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"35ab1edb-ff7d-4735-a259-b43e67250f2a"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"apply","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"35ab1edb-ff7d-4735-a259-b43e67250f2a"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"35ab1edb-ff7d-4735-a259-b43e67250f2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"35ab1edb-ff7d-4735-a259-b43e67250f2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.initialize"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"35ab1edb-ff7d-4735-a259-b43e67250f2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.argoWorkflowsControllersOptions"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"35ab1edb-ff7d-4735-a259-b43e67250f2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"35ab1edb-ff7d-4735-a259-b43e67250f2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"35ab1edb-ff7d-4735-a259-b43e67250f2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"d416aed2-91b7-4bc5-bcde-2045af634608"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"d416aed2-91b7-4bc5-bcde-2045af634608"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"d416aed2-91b7-4bc5-bcde-2045af634608","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"d416aed2-91b7-4bc5-bcde-2045af634608","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.(*componentHandler).NewComponentReconciler.checkSubscriptionDependencies.func26"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"d416aed2-91b7-4bc5-bcde-2045af634608","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"d416aed2-91b7-4bc5-bcde-2045af634608","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a469f333-d06a-4599-b102-855a0fc391be","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56e59405-721f-4d17-95db-ac686f859095"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56e59405-721f-4d17-95db-ac686f859095"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56e59405-721f-4d17-95db-ac686f859095","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56e59405-721f-4d17-95db-ac686f859095","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"15b6e301-60d0-471a-901a-1efba6acc4fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"15b6e301-60d0-471a-901a-1efba6acc4fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"15b6e301-60d0-471a-901a-1efba6acc4fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T04:12:23Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"15b6e301-60d0-471a-901a-1efba6acc4fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:24Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"15b6e301-60d0-471a-901a-1efba6acc4fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T04:12:24Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"15b6e301-60d0-471a-901a-1efba6acc4fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T04:12:24Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"15b6e301-60d0-471a-901a-1efba6acc4fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:24Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56e59405-721f-4d17-95db-ac686f859095","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:12:24Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56e59405-721f-4d17-95db-ac686f859095","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-15T04:12:24Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56e59405-721f-4d17-95db-ac686f859095","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:24Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56e59405-721f-4d17-95db-ac686f859095","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:24Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bd86f1a7-cd4f-4599-b278-3870cd8b30dc"} {"level":"info","ts":"2026-07-15T04:12:24Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bd86f1a7-cd4f-4599-b278-3870cd8b30dc"} {"level":"info","ts":"2026-07-15T04:12:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bd86f1a7-cd4f-4599-b278-3870cd8b30dc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bd86f1a7-cd4f-4599-b278-3870cd8b30dc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:12:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bd86f1a7-cd4f-4599-b278-3870cd8b30dc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:12:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bd86f1a7-cd4f-4599-b278-3870cd8b30dc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:12:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bd86f1a7-cd4f-4599-b278-3870cd8b30dc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:12:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bd86f1a7-cd4f-4599-b278-3870cd8b30dc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:12:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bd86f1a7-cd4f-4599-b278-3870cd8b30dc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:12:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bd86f1a7-cd4f-4599-b278-3870cd8b30dc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:12:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bd86f1a7-cd4f-4599-b278-3870cd8b30dc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:12:24Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"5ff11170-0add-4268-8c97-3add4244aa0e","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:12:24Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"5ff11170-0add-4268-8c97-3add4244aa0e","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:12:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bd86f1a7-cd4f-4599-b278-3870cd8b30dc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:12:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bd86f1a7-cd4f-4599-b278-3870cd8b30dc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:12:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bd86f1a7-cd4f-4599-b278-3870cd8b30dc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bd86f1a7-cd4f-4599-b278-3870cd8b30dc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bd86f1a7-cd4f-4599-b278-3870cd8b30dc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:12:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bd86f1a7-cd4f-4599-b278-3870cd8b30dc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bd86f1a7-cd4f-4599-b278-3870cd8b30dc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:26Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"541c5341-9e17-4c49-abda-89dc10013b9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:26Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a469f333-d06a-4599-b102-855a0fc391be","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:26Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"baa99405-6b05-4efd-af41-46dcbfab966c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:26Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"baa99405-6b05-4efd-af41-46dcbfab966c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.updateStatus"} {"level":"info","ts":"2026-07-15T04:12:26Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"baa99405-6b05-4efd-af41-46dcbfab966c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:26Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"baa99405-6b05-4efd-af41-46dcbfab966c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:26Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"15b6e301-60d0-471a-901a-1efba6acc4fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-15T04:12:26Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"15b6e301-60d0-471a-901a-1efba6acc4fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:26Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"de8dfffb-5074-46a6-bd7a-b4f664acd973"} {"level":"info","ts":"2026-07-15T04:12:26Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"de8dfffb-5074-46a6-bd7a-b4f664acd973"} {"level":"info","ts":"2026-07-15T04:12:26Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"de8dfffb-5074-46a6-bd7a-b4f664acd973","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:12:26Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"de8dfffb-5074-46a6-bd7a-b4f664acd973","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:12:26Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"de8dfffb-5074-46a6-bd7a-b4f664acd973","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:12:26Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"de8dfffb-5074-46a6-bd7a-b4f664acd973","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:12:26Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"de8dfffb-5074-46a6-bd7a-b4f664acd973","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"0dcc735f-c82d-466b-a216-4bde56828e13","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"0dcc735f-c82d-466b-a216-4bde56828e13","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"0dcc735f-c82d-466b-a216-4bde56828e13","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"15b6e301-60d0-471a-901a-1efba6acc4fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"15b6e301-60d0-471a-901a-1efba6acc4fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d383230a-f031-4c5f-bfab-133197e3899d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"reconcile","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"a2d68ea3-39fb-4242-a29c-312e8281c4e6"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"apply","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"a2d68ea3-39fb-4242-a29c-312e8281c4e6"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"a2d68ea3-39fb-4242-a29c-312e8281c4e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainingoperator.initialize"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"a2d68ea3-39fb-4242-a29c-312e8281c4e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"a2d68ea3-39fb-4242-a29c-312e8281c4e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"reconcile","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"6a7eb760-b86a-433e-84c5-6a6af7a3285f"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"apply","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"6a7eb760-b86a-433e-84c5-6a6af7a3285f"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"6a7eb760-b86a-433e-84c5-6a6af7a3285f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.initialize"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"6a7eb760-b86a-433e-84c5-6a6af7a3285f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"6a7eb760-b86a-433e-84c5-6a6af7a3285f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"6a7eb760-b86a-433e-84c5-6a6af7a3285f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"6a7eb760-b86a-433e-84c5-6a6af7a3285f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"bfe595be-b453-4cc2-b731-5bb5b0b42769","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"bfe595be-b453-4cc2-b731-5bb5b0b42769","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0fd0cbe8-16db-469c-b86a-a43bbfb56b04"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0fd0cbe8-16db-469c-b86a-a43bbfb56b04"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0fd0cbe8-16db-469c-b86a-a43bbfb56b04","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0fd0cbe8-16db-469c-b86a-a43bbfb56b04","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0fd0cbe8-16db-469c-b86a-a43bbfb56b04","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0fd0cbe8-16db-469c-b86a-a43bbfb56b04","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0fd0cbe8-16db-469c-b86a-a43bbfb56b04","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0fd0cbe8-16db-469c-b86a-a43bbfb56b04","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0fd0cbe8-16db-469c-b86a-a43bbfb56b04","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0fd0cbe8-16db-469c-b86a-a43bbfb56b04","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0fd0cbe8-16db-469c-b86a-a43bbfb56b04","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0fd0cbe8-16db-469c-b86a-a43bbfb56b04","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0fd0cbe8-16db-469c-b86a-a43bbfb56b04","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0fd0cbe8-16db-469c-b86a-a43bbfb56b04","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0fd0cbe8-16db-469c-b86a-a43bbfb56b04","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0fd0cbe8-16db-469c-b86a-a43bbfb56b04","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0fd0cbe8-16db-469c-b86a-a43bbfb56b04","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0fd0cbe8-16db-469c-b86a-a43bbfb56b04","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"6a7eb760-b86a-433e-84c5-6a6af7a3285f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"6a7eb760-b86a-433e-84c5-6a6af7a3285f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"6a7eb760-b86a-433e-84c5-6a6af7a3285f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"reconcile","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"49f5529b-fdc5-474c-be8e-d29fdc1aa8ca"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"apply","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"49f5529b-fdc5-474c-be8e-d29fdc1aa8ca"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"49f5529b-fdc5-474c-be8e-d29fdc1aa8ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.initialize"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"49f5529b-fdc5-474c-be8e-d29fdc1aa8ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.customizeManifests"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"49f5529b-fdc5-474c-be8e-d29fdc1aa8ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"49f5529b-fdc5-474c-be8e-d29fdc1aa8ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.configureDependencies"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"49f5529b-fdc5-474c-be8e-d29fdc1aa8ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"49f5529b-fdc5-474c-be8e-d29fdc1aa8ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:27Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"49f5529b-fdc5-474c-be8e-d29fdc1aa8ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"de8dfffb-5074-46a6-bd7a-b4f664acd973","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"08e6aebe-5832-4bdb-99a2-75ecdbdcad60"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"08e6aebe-5832-4bdb-99a2-75ecdbdcad60"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"08e6aebe-5832-4bdb-99a2-75ecdbdcad60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"08e6aebe-5832-4bdb-99a2-75ecdbdcad60","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"08e6aebe-5832-4bdb-99a2-75ecdbdcad60","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"8d45b6dd-7207-428a-9219-0c159cd1eefc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"8d45b6dd-7207-428a-9219-0c159cd1eefc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"8d45b6dd-7207-428a-9219-0c159cd1eefc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"reconcile","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"98532176-6e0d-48c6-bbbf-cc6a7374e361"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"apply","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"98532176-6e0d-48c6-bbbf-cc6a7374e361"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"98532176-6e0d-48c6-bbbf-cc6a7374e361","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/sanitycheck.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"98532176-6e0d-48c6-bbbf-cc6a7374e361","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ray.initialize"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"98532176-6e0d-48c6-bbbf-cc6a7374e361","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"98532176-6e0d-48c6-bbbf-cc6a7374e361","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"49f5529b-fdc5-474c-be8e-d29fdc1aa8ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"98532176-6e0d-48c6-bbbf-cc6a7374e361","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"08e6aebe-5832-4bdb-99a2-75ecdbdcad60","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"08e6aebe-5832-4bdb-99a2-75ecdbdcad60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"08e6aebe-5832-4bdb-99a2-75ecdbdcad60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"08e6aebe-5832-4bdb-99a2-75ecdbdcad60","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"49f5529b-fdc5-474c-be8e-d29fdc1aa8ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.updateStatus"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"49f5529b-fdc5-474c-be8e-d29fdc1aa8ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"49f5529b-fdc5-474c-be8e-d29fdc1aa8ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"08e6aebe-5832-4bdb-99a2-75ecdbdcad60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"08e6aebe-5832-4bdb-99a2-75ecdbdcad60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T04:12:28Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"08e6aebe-5832-4bdb-99a2-75ecdbdcad60","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"35ab1edb-ff7d-4735-a259-b43e67250f2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"d416aed2-91b7-4bc5-bcde-2045af634608","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"98532176-6e0d-48c6-bbbf-cc6a7374e361","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"98532176-6e0d-48c6-bbbf-cc6a7374e361","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"98532176-6e0d-48c6-bbbf-cc6a7374e361","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"35ab1edb-ff7d-4735-a259-b43e67250f2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"35ab1edb-ff7d-4735-a259-b43e67250f2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"d416aed2-91b7-4bc5-bcde-2045af634608","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"d416aed2-91b7-4bc5-bcde-2045af634608","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:29Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"3a5c5dab-a9fa-46b2-a064-722d1b4750c1","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"3a5c5dab-a9fa-46b2-a064-722d1b4750c1","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"reconcile","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"38bd31a3-5139-48f2-b562-8d2ac5d06699"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"apply","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"38bd31a3-5139-48f2-b562-8d2ac5d06699"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"38bd31a3-5139-48f2-b562-8d2ac5d06699","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"38bd31a3-5139-48f2-b562-8d2ac5d06699","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.initialize"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"38bd31a3-5139-48f2-b562-8d2ac5d06699","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.argoWorkflowsControllersOptions"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"38bd31a3-5139-48f2-b562-8d2ac5d06699","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"38bd31a3-5139-48f2-b562-8d2ac5d06699","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"38bd31a3-5139-48f2-b562-8d2ac5d06699","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"750efeaf-6c3e-4bba-b2be-e27d8207958e"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"750efeaf-6c3e-4bba-b2be-e27d8207958e"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"750efeaf-6c3e-4bba-b2be-e27d8207958e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"750efeaf-6c3e-4bba-b2be-e27d8207958e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.(*componentHandler).NewComponentReconciler.checkSubscriptionDependencies.func26"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"750efeaf-6c3e-4bba-b2be-e27d8207958e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"750efeaf-6c3e-4bba-b2be-e27d8207958e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"750efeaf-6c3e-4bba-b2be-e27d8207958e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"750efeaf-6c3e-4bba-b2be-e27d8207958e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:29Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"750efeaf-6c3e-4bba-b2be-e27d8207958e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"38bd31a3-5139-48f2-b562-8d2ac5d06699","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"38bd31a3-5139-48f2-b562-8d2ac5d06699","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"38bd31a3-5139-48f2-b562-8d2ac5d06699","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"1c854a58-f5dc-4093-a232-4d7df43c5be5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"1c854a58-f5dc-4093-a232-4d7df43c5be5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"1c854a58-f5dc-4093-a232-4d7df43c5be5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"de8dfffb-5074-46a6-bd7a-b4f664acd973","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"reconcile","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"b6290168-0b33-4ee9-892a-9ac40e07da39"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"apply","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"b6290168-0b33-4ee9-892a-9ac40e07da39"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"b6290168-0b33-4ee9-892a-9ac40e07da39","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"b6290168-0b33-4ee9-892a-9ac40e07da39","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.initialize"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"b6290168-0b33-4ee9-892a-9ac40e07da39","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"b6290168-0b33-4ee9-892a-9ac40e07da39","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkJobSetCRD"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"b6290168-0b33-4ee9-892a-9ac40e07da39","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"b6290168-0b33-4ee9-892a-9ac40e07da39","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"b6290168-0b33-4ee9-892a-9ac40e07da39","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4ced842d-545a-45dc-bb63-16637ab2725a"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4ced842d-545a-45dc-bb63-16637ab2725a"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4ced842d-545a-45dc-bb63-16637ab2725a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4ced842d-545a-45dc-bb63-16637ab2725a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4ced842d-545a-45dc-bb63-16637ab2725a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4ced842d-545a-45dc-bb63-16637ab2725a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4ced842d-545a-45dc-bb63-16637ab2725a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"08e6aebe-5832-4bdb-99a2-75ecdbdcad60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"08e6aebe-5832-4bdb-99a2-75ecdbdcad60","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"08e6aebe-5832-4bdb-99a2-75ecdbdcad60","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"08e6aebe-5832-4bdb-99a2-75ecdbdcad60","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"b6290168-0b33-4ee9-892a-9ac40e07da39","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"b6290168-0b33-4ee9-892a-9ac40e07da39","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"b6290168-0b33-4ee9-892a-9ac40e07da39","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4ced842d-545a-45dc-bb63-16637ab2725a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3898d5c9-26db-4665-803c-9b73bc0cbfe3"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3898d5c9-26db-4665-803c-9b73bc0cbfe3"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3898d5c9-26db-4665-803c-9b73bc0cbfe3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3898d5c9-26db-4665-803c-9b73bc0cbfe3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3898d5c9-26db-4665-803c-9b73bc0cbfe3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3898d5c9-26db-4665-803c-9b73bc0cbfe3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3898d5c9-26db-4665-803c-9b73bc0cbfe3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3898d5c9-26db-4665-803c-9b73bc0cbfe3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3898d5c9-26db-4665-803c-9b73bc0cbfe3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3898d5c9-26db-4665-803c-9b73bc0cbfe3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:12:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3898d5c9-26db-4665-803c-9b73bc0cbfe3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3898d5c9-26db-4665-803c-9b73bc0cbfe3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3898d5c9-26db-4665-803c-9b73bc0cbfe3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3898d5c9-26db-4665-803c-9b73bc0cbfe3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3898d5c9-26db-4665-803c-9b73bc0cbfe3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3898d5c9-26db-4665-803c-9b73bc0cbfe3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3898d5c9-26db-4665-803c-9b73bc0cbfe3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3898d5c9-26db-4665-803c-9b73bc0cbfe3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"541c5341-9e17-4c49-abda-89dc10013b9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"541c5341-9e17-4c49-abda-89dc10013b9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"a2d68ea3-39fb-4242-a29c-312e8281c4e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4ced842d-545a-45dc-bb63-16637ab2725a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f2b868ce-c774-45f1-b7e4-fe7af50396ab"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f2b868ce-c774-45f1-b7e4-fe7af50396ab"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f2b868ce-c774-45f1-b7e4-fe7af50396ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f2b868ce-c774-45f1-b7e4-fe7af50396ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f2b868ce-c774-45f1-b7e4-fe7af50396ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f2b868ce-c774-45f1-b7e4-fe7af50396ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f2b868ce-c774-45f1-b7e4-fe7af50396ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f2b868ce-c774-45f1-b7e4-fe7af50396ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:31Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"1369e7c4-85d4-4ed8-a7ff-cc0ea2fa57a5","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"1369e7c4-85d4-4ed8-a7ff-cc0ea2fa57a5","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f2b868ce-c774-45f1-b7e4-fe7af50396ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d383230a-f031-4c5f-bfab-133197e3899d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:31Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d383230a-f031-4c5f-bfab-133197e3899d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/imagestreams.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d383230a-f031-4c5f-bfab-133197e3899d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.updateStatus"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d383230a-f031-4c5f-bfab-133197e3899d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56e59405-721f-4d17-95db-ac686f859095","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56e59405-721f-4d17-95db-ac686f859095","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56e59405-721f-4d17-95db-ac686f859095","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56e59405-721f-4d17-95db-ac686f859095","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56e59405-721f-4d17-95db-ac686f859095","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bfd8b285-dbdd-47e7-8031-524ae519a63a"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bfd8b285-dbdd-47e7-8031-524ae519a63a"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bfd8b285-dbdd-47e7-8031-524ae519a63a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bfd8b285-dbdd-47e7-8031-524ae519a63a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bfd8b285-dbdd-47e7-8031-524ae519a63a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bfd8b285-dbdd-47e7-8031-524ae519a63a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a49db5f0-eb33-40f9-9c58-af215a213ebd"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bfd8b285-dbdd-47e7-8031-524ae519a63a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a49db5f0-eb33-40f9-9c58-af215a213ebd"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a49db5f0-eb33-40f9-9c58-af215a213ebd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a49db5f0-eb33-40f9-9c58-af215a213ebd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a49db5f0-eb33-40f9-9c58-af215a213ebd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bfd8b285-dbdd-47e7-8031-524ae519a63a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a49db5f0-eb33-40f9-9c58-af215a213ebd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a49db5f0-eb33-40f9-9c58-af215a213ebd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a49db5f0-eb33-40f9-9c58-af215a213ebd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a49db5f0-eb33-40f9-9c58-af215a213ebd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:33Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"541c5341-9e17-4c49-abda-89dc10013b9b"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"541c5341-9e17-4c49-abda-89dc10013b9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"ca6bfdfc-2b0a-4239-95e4-3935dff527c9"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"ca6bfdfc-2b0a-4239-95e4-3935dff527c9"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"ca6bfdfc-2b0a-4239-95e4-3935dff527c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"ca6bfdfc-2b0a-4239-95e4-3935dff527c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"ca6bfdfc-2b0a-4239-95e4-3935dff527c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1b942be5-2023-443b-afbc-3698ad310a6d"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1b942be5-2023-443b-afbc-3698ad310a6d"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1b942be5-2023-443b-afbc-3698ad310a6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1b942be5-2023-443b-afbc-3698ad310a6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1b942be5-2023-443b-afbc-3698ad310a6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1b942be5-2023-443b-afbc-3698ad310a6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1b942be5-2023-443b-afbc-3698ad310a6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"ca6bfdfc-2b0a-4239-95e4-3935dff527c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1b942be5-2023-443b-afbc-3698ad310a6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:33Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d383230a-f031-4c5f-bfab-133197e3899d"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7a34083d-2b62-4056-a8be-3c1d850e9f54"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7a34083d-2b62-4056-a8be-3c1d850e9f54"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7a34083d-2b62-4056-a8be-3c1d850e9f54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7a34083d-2b62-4056-a8be-3c1d850e9f54","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7a34083d-2b62-4056-a8be-3c1d850e9f54","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7a34083d-2b62-4056-a8be-3c1d850e9f54","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7a34083d-2b62-4056-a8be-3c1d850e9f54","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7a34083d-2b62-4056-a8be-3c1d850e9f54","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7a34083d-2b62-4056-a8be-3c1d850e9f54","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7a34083d-2b62-4056-a8be-3c1d850e9f54","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7a34083d-2b62-4056-a8be-3c1d850e9f54","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7a34083d-2b62-4056-a8be-3c1d850e9f54","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7a34083d-2b62-4056-a8be-3c1d850e9f54","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7a34083d-2b62-4056-a8be-3c1d850e9f54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7a34083d-2b62-4056-a8be-3c1d850e9f54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7a34083d-2b62-4056-a8be-3c1d850e9f54","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7a34083d-2b62-4056-a8be-3c1d850e9f54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7a34083d-2b62-4056-a8be-3c1d850e9f54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"a2d68ea3-39fb-4242-a29c-312e8281c4e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"a2d68ea3-39fb-4242-a29c-312e8281c4e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d383230a-f031-4c5f-bfab-133197e3899d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"reconcile","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"8ca7bd27-cd0f-4657-8e2a-85be9a9ed94a"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"apply","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"8ca7bd27-cd0f-4657-8e2a-85be9a9ed94a"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"8ca7bd27-cd0f-4657-8e2a-85be9a9ed94a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.initialize"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"8ca7bd27-cd0f-4657-8e2a-85be9a9ed94a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"8ca7bd27-cd0f-4657-8e2a-85be9a9ed94a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.configureDependencies"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"8ca7bd27-cd0f-4657-8e2a-85be9a9ed94a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"8ca7bd27-cd0f-4657-8e2a-85be9a9ed94a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1b942be5-2023-443b-afbc-3698ad310a6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:33Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"435d2d14-b194-4cf0-9c7c-930d941b2245","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"435d2d14-b194-4cf0-9c7c-930d941b2245","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"47fabb9b-a81d-4ae1-80e8-45804c010821"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"47fabb9b-a81d-4ae1-80e8-45804c010821"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"47fabb9b-a81d-4ae1-80e8-45804c010821","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"47fabb9b-a81d-4ae1-80e8-45804c010821","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"47fabb9b-a81d-4ae1-80e8-45804c010821","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"47fabb9b-a81d-4ae1-80e8-45804c010821","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"47fabb9b-a81d-4ae1-80e8-45804c010821","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"47fabb9b-a81d-4ae1-80e8-45804c010821","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92df7f3c-febf-46a8-9f65-cfd478707916"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92df7f3c-febf-46a8-9f65-cfd478707916"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92df7f3c-febf-46a8-9f65-cfd478707916","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92df7f3c-febf-46a8-9f65-cfd478707916","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92df7f3c-febf-46a8-9f65-cfd478707916","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92df7f3c-febf-46a8-9f65-cfd478707916","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92df7f3c-febf-46a8-9f65-cfd478707916","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92df7f3c-febf-46a8-9f65-cfd478707916","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92df7f3c-febf-46a8-9f65-cfd478707916","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92df7f3c-febf-46a8-9f65-cfd478707916","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92df7f3c-febf-46a8-9f65-cfd478707916","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92df7f3c-febf-46a8-9f65-cfd478707916","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92df7f3c-febf-46a8-9f65-cfd478707916","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"47fabb9b-a81d-4ae1-80e8-45804c010821","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"ca6bfdfc-2b0a-4239-95e4-3935dff527c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"ca6bfdfc-2b0a-4239-95e4-3935dff527c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"ca6bfdfc-2b0a-4239-95e4-3935dff527c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c39c4e23-cfa2-47d5-bdd1-09a7eabf1bd4"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c39c4e23-cfa2-47d5-bdd1-09a7eabf1bd4"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c39c4e23-cfa2-47d5-bdd1-09a7eabf1bd4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c39c4e23-cfa2-47d5-bdd1-09a7eabf1bd4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c39c4e23-cfa2-47d5-bdd1-09a7eabf1bd4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c39c4e23-cfa2-47d5-bdd1-09a7eabf1bd4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c39c4e23-cfa2-47d5-bdd1-09a7eabf1bd4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c39c4e23-cfa2-47d5-bdd1-09a7eabf1bd4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:35Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c39c4e23-cfa2-47d5-bdd1-09a7eabf1bd4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:35Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bfd8b285-dbdd-47e7-8031-524ae519a63a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:35Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bfd8b285-dbdd-47e7-8031-524ae519a63a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-15T04:12:35Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bfd8b285-dbdd-47e7-8031-524ae519a63a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-15T04:12:35Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bfd8b285-dbdd-47e7-8031-524ae519a63a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:35Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bfd8b285-dbdd-47e7-8031-524ae519a63a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:35Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8711d57c-f4a3-4b7f-addd-8238bec6fd2b"} {"level":"info","ts":"2026-07-15T04:12:35Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8711d57c-f4a3-4b7f-addd-8238bec6fd2b"} {"level":"info","ts":"2026-07-15T04:12:35Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8711d57c-f4a3-4b7f-addd-8238bec6fd2b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:12:35Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8711d57c-f4a3-4b7f-addd-8238bec6fd2b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:12:35Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8711d57c-f4a3-4b7f-addd-8238bec6fd2b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:12:35Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8711d57c-f4a3-4b7f-addd-8238bec6fd2b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:12:35Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8711d57c-f4a3-4b7f-addd-8238bec6fd2b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:35Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8711d57c-f4a3-4b7f-addd-8238bec6fd2b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:35Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8711d57c-f4a3-4b7f-addd-8238bec6fd2b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:35Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"a2d68ea3-39fb-4242-a29c-312e8281c4e6"} {"level":"info","ts":"2026-07-15T04:12:35Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"a2d68ea3-39fb-4242-a29c-312e8281c4e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"reconcile","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"1845c4cb-5373-43d4-bc07-e18e20951856"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"apply","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"1845c4cb-5373-43d4-bc07-e18e20951856"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"1845c4cb-5373-43d4-bc07-e18e20951856","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainingoperator.initialize"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"1845c4cb-5373-43d4-bc07-e18e20951856","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"1845c4cb-5373-43d4-bc07-e18e20951856","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f3ab138f-1294-4c1c-b4d2-637084aa49f4"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f3ab138f-1294-4c1c-b4d2-637084aa49f4"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f3ab138f-1294-4c1c-b4d2-637084aa49f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f3ab138f-1294-4c1c-b4d2-637084aa49f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f3ab138f-1294-4c1c-b4d2-637084aa49f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f3ab138f-1294-4c1c-b4d2-637084aa49f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"1845c4cb-5373-43d4-bc07-e18e20951856","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"8ca7bd27-cd0f-4657-8e2a-85be9a9ed94a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f3ab138f-1294-4c1c-b4d2-637084aa49f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f3ab138f-1294-4c1c-b4d2-637084aa49f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f3ab138f-1294-4c1c-b4d2-637084aa49f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"8ca7bd27-cd0f-4657-8e2a-85be9a9ed94a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"8ca7bd27-cd0f-4657-8e2a-85be9a9ed94a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/imagestreams.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"8ca7bd27-cd0f-4657-8e2a-85be9a9ed94a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.updateStatus"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"8ca7bd27-cd0f-4657-8e2a-85be9a9ed94a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:36Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"8ca7bd27-cd0f-4657-8e2a-85be9a9ed94a"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"8ca7bd27-cd0f-4657-8e2a-85be9a9ed94a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"292c259f-cb90-40c2-9fc2-a51ed33580d6"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"292c259f-cb90-40c2-9fc2-a51ed33580d6"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"292c259f-cb90-40c2-9fc2-a51ed33580d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"292c259f-cb90-40c2-9fc2-a51ed33580d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"292c259f-cb90-40c2-9fc2-a51ed33580d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"292c259f-cb90-40c2-9fc2-a51ed33580d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"292c259f-cb90-40c2-9fc2-a51ed33580d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"292c259f-cb90-40c2-9fc2-a51ed33580d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"292c259f-cb90-40c2-9fc2-a51ed33580d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:37Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"1845c4cb-5373-43d4-bc07-e18e20951856","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:37Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"1845c4cb-5373-43d4-bc07-e18e20951856","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:37Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"1845c4cb-5373-43d4-bc07-e18e20951856","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:37Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30acc446-74ce-4f46-8104-642338f8cae4"} {"level":"info","ts":"2026-07-15T04:12:37Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30acc446-74ce-4f46-8104-642338f8cae4"} {"level":"info","ts":"2026-07-15T04:12:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30acc446-74ce-4f46-8104-642338f8cae4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:12:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30acc446-74ce-4f46-8104-642338f8cae4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:12:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30acc446-74ce-4f46-8104-642338f8cae4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:12:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30acc446-74ce-4f46-8104-642338f8cae4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:12:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30acc446-74ce-4f46-8104-642338f8cae4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30acc446-74ce-4f46-8104-642338f8cae4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"30acc446-74ce-4f46-8104-642338f8cae4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"reconcile","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"80c348c7-3deb-4257-92c9-bf7b6cdb762f"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"apply","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"80c348c7-3deb-4257-92c9-bf7b6cdb762f"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"80c348c7-3deb-4257-92c9-bf7b6cdb762f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainingoperator.initialize"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"80c348c7-3deb-4257-92c9-bf7b6cdb762f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"80c348c7-3deb-4257-92c9-bf7b6cdb762f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"80c348c7-3deb-4257-92c9-bf7b6cdb762f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"80c348c7-3deb-4257-92c9-bf7b6cdb762f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"80c348c7-3deb-4257-92c9-bf7b6cdb762f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"80c348c7-3deb-4257-92c9-bf7b6cdb762f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"43a676ff-776e-4d5f-98a2-2e2bfa30faf0"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"43a676ff-776e-4d5f-98a2-2e2bfa30faf0"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"43a676ff-776e-4d5f-98a2-2e2bfa30faf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"43a676ff-776e-4d5f-98a2-2e2bfa30faf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"43a676ff-776e-4d5f-98a2-2e2bfa30faf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"43a676ff-776e-4d5f-98a2-2e2bfa30faf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"43a676ff-776e-4d5f-98a2-2e2bfa30faf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"43a676ff-776e-4d5f-98a2-2e2bfa30faf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"43a676ff-776e-4d5f-98a2-2e2bfa30faf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ecef84ee-fcbf-480d-bf9c-18654466bb16"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ecef84ee-fcbf-480d-bf9c-18654466bb16"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ecef84ee-fcbf-480d-bf9c-18654466bb16","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ecef84ee-fcbf-480d-bf9c-18654466bb16","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ecef84ee-fcbf-480d-bf9c-18654466bb16","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ecef84ee-fcbf-480d-bf9c-18654466bb16","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ecef84ee-fcbf-480d-bf9c-18654466bb16","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ecef84ee-fcbf-480d-bf9c-18654466bb16","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ecef84ee-fcbf-480d-bf9c-18654466bb16","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ecef84ee-fcbf-480d-bf9c-18654466bb16","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ecef84ee-fcbf-480d-bf9c-18654466bb16","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ecef84ee-fcbf-480d-bf9c-18654466bb16","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ecef84ee-fcbf-480d-bf9c-18654466bb16","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ecef84ee-fcbf-480d-bf9c-18654466bb16","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ecef84ee-fcbf-480d-bf9c-18654466bb16","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ecef84ee-fcbf-480d-bf9c-18654466bb16","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ecef84ee-fcbf-480d-bf9c-18654466bb16","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ecef84ee-fcbf-480d-bf9c-18654466bb16","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:12:53Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"66ca47e7-91cd-49d3-906a-d90bb4ca0bc6","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:12:53Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"66ca47e7-91cd-49d3-906a-d90bb4ca0bc6","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:13:05Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"786f1bf7-eeb0-4821-b058-8c8e43a2c67c"} {"level":"info","ts":"2026-07-15T04:13:05Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"786f1bf7-eeb0-4821-b058-8c8e43a2c67c"} {"level":"info","ts":"2026-07-15T04:13:05Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"786f1bf7-eeb0-4821-b058-8c8e43a2c67c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:13:05Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"786f1bf7-eeb0-4821-b058-8c8e43a2c67c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:05Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"786f1bf7-eeb0-4821-b058-8c8e43a2c67c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:05Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"786f1bf7-eeb0-4821-b058-8c8e43a2c67c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"786f1bf7-eeb0-4821-b058-8c8e43a2c67c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"786f1bf7-eeb0-4821-b058-8c8e43a2c67c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"786f1bf7-eeb0-4821-b058-8c8e43a2c67c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"35f1d73c-62e0-4cb0-abdb-70f70856cd3d"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"35f1d73c-62e0-4cb0-abdb-70f70856cd3d"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"35f1d73c-62e0-4cb0-abdb-70f70856cd3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"35f1d73c-62e0-4cb0-abdb-70f70856cd3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"35f1d73c-62e0-4cb0-abdb-70f70856cd3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"35f1d73c-62e0-4cb0-abdb-70f70856cd3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b92d0044-0b0b-46fc-ba90-8a3fcc447f0e"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b92d0044-0b0b-46fc-ba90-8a3fcc447f0e"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b92d0044-0b0b-46fc-ba90-8a3fcc447f0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b92d0044-0b0b-46fc-ba90-8a3fcc447f0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b92d0044-0b0b-46fc-ba90-8a3fcc447f0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b92d0044-0b0b-46fc-ba90-8a3fcc447f0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b92d0044-0b0b-46fc-ba90-8a3fcc447f0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b92d0044-0b0b-46fc-ba90-8a3fcc447f0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"35f1d73c-62e0-4cb0-abdb-70f70856cd3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"35f1d73c-62e0-4cb0-abdb-70f70856cd3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"35f1d73c-62e0-4cb0-abdb-70f70856cd3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:13:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b92d0044-0b0b-46fc-ba90-8a3fcc447f0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8d5a9fd5-93b7-4d3d-a75e-fa8df777e7b5"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8d5a9fd5-93b7-4d3d-a75e-fa8df777e7b5"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8d5a9fd5-93b7-4d3d-a75e-fa8df777e7b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8d5a9fd5-93b7-4d3d-a75e-fa8df777e7b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8d5a9fd5-93b7-4d3d-a75e-fa8df777e7b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8d5a9fd5-93b7-4d3d-a75e-fa8df777e7b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8d5a9fd5-93b7-4d3d-a75e-fa8df777e7b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8d5a9fd5-93b7-4d3d-a75e-fa8df777e7b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8d5a9fd5-93b7-4d3d-a75e-fa8df777e7b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"7359bd8a-9a02-4222-a029-f2ea83ff0c27"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"7359bd8a-9a02-4222-a029-f2ea83ff0c27"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"7359bd8a-9a02-4222-a029-f2ea83ff0c27","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"7359bd8a-9a02-4222-a029-f2ea83ff0c27","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"7359bd8a-9a02-4222-a029-f2ea83ff0c27","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ba710544-9acd-4516-a5c0-ec69a1043f87"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ba710544-9acd-4516-a5c0-ec69a1043f87"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ba710544-9acd-4516-a5c0-ec69a1043f87","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ba710544-9acd-4516-a5c0-ec69a1043f87","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ba710544-9acd-4516-a5c0-ec69a1043f87","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ba710544-9acd-4516-a5c0-ec69a1043f87","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ba710544-9acd-4516-a5c0-ec69a1043f87","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"7359bd8a-9a02-4222-a029-f2ea83ff0c27","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ba710544-9acd-4516-a5c0-ec69a1043f87","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"7359bd8a-9a02-4222-a029-f2ea83ff0c27","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"7359bd8a-9a02-4222-a029-f2ea83ff0c27","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"7359bd8a-9a02-4222-a029-f2ea83ff0c27","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ba710544-9acd-4516-a5c0-ec69a1043f87","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f6ba452a-409a-434b-988f-0eac2f5aaa76"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f6ba452a-409a-434b-988f-0eac2f5aaa76"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f6ba452a-409a-434b-988f-0eac2f5aaa76","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f6ba452a-409a-434b-988f-0eac2f5aaa76","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f6ba452a-409a-434b-988f-0eac2f5aaa76","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f6ba452a-409a-434b-988f-0eac2f5aaa76","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98d544d7-8f21-43c7-94a8-5b527783fc11"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98d544d7-8f21-43c7-94a8-5b527783fc11"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98d544d7-8f21-43c7-94a8-5b527783fc11","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f6ba452a-409a-434b-988f-0eac2f5aaa76","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98d544d7-8f21-43c7-94a8-5b527783fc11","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98d544d7-8f21-43c7-94a8-5b527783fc11","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98d544d7-8f21-43c7-94a8-5b527783fc11","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98d544d7-8f21-43c7-94a8-5b527783fc11","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98d544d7-8f21-43c7-94a8-5b527783fc11","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98d544d7-8f21-43c7-94a8-5b527783fc11","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98d544d7-8f21-43c7-94a8-5b527783fc11","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98d544d7-8f21-43c7-94a8-5b527783fc11","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f6ba452a-409a-434b-988f-0eac2f5aaa76","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98d544d7-8f21-43c7-94a8-5b527783fc11","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98d544d7-8f21-43c7-94a8-5b527783fc11","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98d544d7-8f21-43c7-94a8-5b527783fc11","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98d544d7-8f21-43c7-94a8-5b527783fc11","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98d544d7-8f21-43c7-94a8-5b527783fc11","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98d544d7-8f21-43c7-94a8-5b527783fc11","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98d544d7-8f21-43c7-94a8-5b527783fc11","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:13:16Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"549ade5e-797d-4fb1-87ef-c6313155a71e","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"549ade5e-797d-4fb1-87ef-c6313155a71e","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:13:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f6ba452a-409a-434b-988f-0eac2f5aaa76","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:13:21Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"openldap","reconcileID":"e724d11b-0902-4873-baa5-eb3d21a18568"} {"level":"info","ts":"2026-07-15T04:13:21Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"openldap","reconcileID":"ba123787-9edf-4d4c-b418-9d45a3aa6e8a"} {"level":"info","ts":"2026-07-15T04:13:21Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"openldap","reconcileID":"979cf193-0d71-4959-b014-9a350201ad6a"} {"level":"info","ts":"2026-07-15T04:22:19Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aaac12a4-fbf0-42e4-9273-adb11d115ab3"} {"level":"info","ts":"2026-07-15T04:22:19Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aaac12a4-fbf0-42e4-9273-adb11d115ab3"} {"level":"info","ts":"2026-07-15T04:22:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aaac12a4-fbf0-42e4-9273-adb11d115ab3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T04:22:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aaac12a4-fbf0-42e4-9273-adb11d115ab3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T04:22:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aaac12a4-fbf0-42e4-9273-adb11d115ab3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T04:22:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aaac12a4-fbf0-42e4-9273-adb11d115ab3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T04:22:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aaac12a4-fbf0-42e4-9273-adb11d115ab3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T04:22:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aaac12a4-fbf0-42e4-9273-adb11d115ab3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T04:22:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aaac12a4-fbf0-42e4-9273-adb11d115ab3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:22:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aaac12a4-fbf0-42e4-9273-adb11d115ab3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:22:19Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm","msg":"EnvoyFilter exposes internal implementation details that may change at any time. Prefer other APIs if possible, and exercise extreme caution, especially around upgrades.","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aaac12a4-fbf0-42e4-9273-adb11d115ab3"} {"level":"info","ts":"2026-07-15T04:22:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aaac12a4-fbf0-42e4-9273-adb11d115ab3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-15T04:22:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aaac12a4-fbf0-42e4-9273-adb11d115ab3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:22:19Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aaac12a4-fbf0-42e4-9273-adb11d115ab3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:22:34Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e53b39c3-6edb-44d5-8c86-ee2f7ffc6843"} {"level":"info","ts":"2026-07-15T04:22:34Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e53b39c3-6edb-44d5-8c86-ee2f7ffc6843"} {"level":"info","ts":"2026-07-15T04:22:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e53b39c3-6edb-44d5-8c86-ee2f7ffc6843","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-15T04:22:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e53b39c3-6edb-44d5-8c86-ee2f7ffc6843","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-15T04:22:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e53b39c3-6edb-44d5-8c86-ee2f7ffc6843","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-15T04:22:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e53b39c3-6edb-44d5-8c86-ee2f7ffc6843","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-15T04:22:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e53b39c3-6edb-44d5-8c86-ee2f7ffc6843","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-15T04:22:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e53b39c3-6edb-44d5-8c86-ee2f7ffc6843","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-15T04:22:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e53b39c3-6edb-44d5-8c86-ee2f7ffc6843","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:22:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e53b39c3-6edb-44d5-8c86-ee2f7ffc6843","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:22:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e53b39c3-6edb-44d5-8c86-ee2f7ffc6843","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-15T04:22:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e53b39c3-6edb-44d5-8c86-ee2f7ffc6843","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:22:34Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e53b39c3-6edb-44d5-8c86-ee2f7ffc6843","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:24:39Z","msg":"reconcile","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"90707923-2444-4c2a-93d5-e4adcc858e5a"} {"level":"info","ts":"2026-07-15T04:24:39Z","msg":"apply","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"90707923-2444-4c2a-93d5-e4adcc858e5a"} {"level":"info","ts":"2026-07-15T04:24:39Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"90707923-2444-4c2a-93d5-e4adcc858e5a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.initialize"} {"level":"info","ts":"2026-07-15T04:24:39Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"90707923-2444-4c2a-93d5-e4adcc858e5a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.customizeManifests"} {"level":"info","ts":"2026-07-15T04:24:39Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"90707923-2444-4c2a-93d5-e4adcc858e5a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:39Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"90707923-2444-4c2a-93d5-e4adcc858e5a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.configureDependencies"} {"level":"info","ts":"2026-07-15T04:24:39Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"90707923-2444-4c2a-93d5-e4adcc858e5a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:39Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"90707923-2444-4c2a-93d5-e4adcc858e5a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:39Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"90707923-2444-4c2a-93d5-e4adcc858e5a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"90707923-2444-4c2a-93d5-e4adcc858e5a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"90707923-2444-4c2a-93d5-e4adcc858e5a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.updateStatus"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"90707923-2444-4c2a-93d5-e4adcc858e5a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"90707923-2444-4c2a-93d5-e4adcc858e5a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"reconcile","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"9500d807-65fe-46b6-ac02-5a700defdbaf"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"apply","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"9500d807-65fe-46b6-ac02-5a700defdbaf"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"9500d807-65fe-46b6-ac02-5a700defdbaf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.initialize"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"9500d807-65fe-46b6-ac02-5a700defdbaf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.customizeManifests"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"9500d807-65fe-46b6-ac02-5a700defdbaf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"9500d807-65fe-46b6-ac02-5a700defdbaf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.configureDependencies"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"9500d807-65fe-46b6-ac02-5a700defdbaf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"9500d807-65fe-46b6-ac02-5a700defdbaf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"065cd551-9826-4466-9eb0-310a4d871602"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"9500d807-65fe-46b6-ac02-5a700defdbaf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"065cd551-9826-4466-9eb0-310a4d871602"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"065cd551-9826-4466-9eb0-310a4d871602","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"065cd551-9826-4466-9eb0-310a4d871602","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"065cd551-9826-4466-9eb0-310a4d871602","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"065cd551-9826-4466-9eb0-310a4d871602","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"065cd551-9826-4466-9eb0-310a4d871602","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"9500d807-65fe-46b6-ac02-5a700defdbaf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"9500d807-65fe-46b6-ac02-5a700defdbaf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.updateStatus"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"9500d807-65fe-46b6-ac02-5a700defdbaf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"9500d807-65fe-46b6-ac02-5a700defdbaf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"065cd551-9826-4466-9eb0-310a4d871602","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"065cd551-9826-4466-9eb0-310a4d871602","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bb6c8df-c1b4-49f7-8529-1e389fe1253c"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bb6c8df-c1b4-49f7-8529-1e389fe1253c"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bb6c8df-c1b4-49f7-8529-1e389fe1253c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bb6c8df-c1b4-49f7-8529-1e389fe1253c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bb6c8df-c1b4-49f7-8529-1e389fe1253c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bb6c8df-c1b4-49f7-8529-1e389fe1253c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bb6c8df-c1b4-49f7-8529-1e389fe1253c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bb6c8df-c1b4-49f7-8529-1e389fe1253c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bb6c8df-c1b4-49f7-8529-1e389fe1253c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bb6c8df-c1b4-49f7-8529-1e389fe1253c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bb6c8df-c1b4-49f7-8529-1e389fe1253c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bb6c8df-c1b4-49f7-8529-1e389fe1253c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bb6c8df-c1b4-49f7-8529-1e389fe1253c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bb6c8df-c1b4-49f7-8529-1e389fe1253c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bb6c8df-c1b4-49f7-8529-1e389fe1253c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bb6c8df-c1b4-49f7-8529-1e389fe1253c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bb6c8df-c1b4-49f7-8529-1e389fe1253c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0bb6c8df-c1b4-49f7-8529-1e389fe1253c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:24:40Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"ab20aabd-0409-459a-87f9-3c8f0a940364","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:24:40Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"ab20aabd-0409-459a-87f9-3c8f0a940364","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:24:48Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-user-perm-test-526006","reconcileID":"aa50a5f0-e769-4a24-ab45-751f30cca918"} {"level":"info","ts":"2026-07-15T04:24:48Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-user-perm-test-526006","reconcileID":"eaab10d4-4cc8-4e43-880e-f1be4a00024e"} {"level":"info","ts":"2026-07-15T04:24:48Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-user-perm-test-526006","reconcileID":"7d1080ab-f07c-45dd-b6fd-115bba82e8e4"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"reconcile","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"368c2cbc-fa37-4340-8e13-87e44b954f5f"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"apply","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"368c2cbc-fa37-4340-8e13-87e44b954f5f"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"368c2cbc-fa37-4340-8e13-87e44b954f5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.initialize"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"368c2cbc-fa37-4340-8e13-87e44b954f5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.customizeManifests"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"368c2cbc-fa37-4340-8e13-87e44b954f5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"368c2cbc-fa37-4340-8e13-87e44b954f5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.configureDependencies"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"368c2cbc-fa37-4340-8e13-87e44b954f5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"368c2cbc-fa37-4340-8e13-87e44b954f5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"368c2cbc-fa37-4340-8e13-87e44b954f5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"368c2cbc-fa37-4340-8e13-87e44b954f5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"368c2cbc-fa37-4340-8e13-87e44b954f5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.updateStatus"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"368c2cbc-fa37-4340-8e13-87e44b954f5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"368c2cbc-fa37-4340-8e13-87e44b954f5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9d810ad7-8b98-4f42-9cf5-78ebcdd657c7"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9d810ad7-8b98-4f42-9cf5-78ebcdd657c7"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9d810ad7-8b98-4f42-9cf5-78ebcdd657c7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9d810ad7-8b98-4f42-9cf5-78ebcdd657c7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9d810ad7-8b98-4f42-9cf5-78ebcdd657c7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9d810ad7-8b98-4f42-9cf5-78ebcdd657c7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9d810ad7-8b98-4f42-9cf5-78ebcdd657c7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"reconcile","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"3001cbe9-4a95-4918-a255-bb81a70825e8"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"apply","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"3001cbe9-4a95-4918-a255-bb81a70825e8"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"3001cbe9-4a95-4918-a255-bb81a70825e8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.initialize"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"3001cbe9-4a95-4918-a255-bb81a70825e8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.customizeManifests"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"3001cbe9-4a95-4918-a255-bb81a70825e8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"3001cbe9-4a95-4918-a255-bb81a70825e8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.configureDependencies"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"3001cbe9-4a95-4918-a255-bb81a70825e8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"3001cbe9-4a95-4918-a255-bb81a70825e8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"3001cbe9-4a95-4918-a255-bb81a70825e8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9d810ad7-8b98-4f42-9cf5-78ebcdd657c7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"3001cbe9-4a95-4918-a255-bb81a70825e8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"3001cbe9-4a95-4918-a255-bb81a70825e8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.updateStatus"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"3001cbe9-4a95-4918-a255-bb81a70825e8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"3001cbe9-4a95-4918-a255-bb81a70825e8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9d810ad7-8b98-4f42-9cf5-78ebcdd657c7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ffef439b-516e-4f2a-86a5-492fafd66769"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ffef439b-516e-4f2a-86a5-492fafd66769"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ffef439b-516e-4f2a-86a5-492fafd66769","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ffef439b-516e-4f2a-86a5-492fafd66769","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ffef439b-516e-4f2a-86a5-492fafd66769","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ffef439b-516e-4f2a-86a5-492fafd66769","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ffef439b-516e-4f2a-86a5-492fafd66769","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ffef439b-516e-4f2a-86a5-492fafd66769","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ffef439b-516e-4f2a-86a5-492fafd66769","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ffef439b-516e-4f2a-86a5-492fafd66769","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ffef439b-516e-4f2a-86a5-492fafd66769","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ffef439b-516e-4f2a-86a5-492fafd66769","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ffef439b-516e-4f2a-86a5-492fafd66769","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ffef439b-516e-4f2a-86a5-492fafd66769","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ffef439b-516e-4f2a-86a5-492fafd66769","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ffef439b-516e-4f2a-86a5-492fafd66769","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ffef439b-516e-4f2a-86a5-492fafd66769","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:24:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ffef439b-516e-4f2a-86a5-492fafd66769","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:24:52Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"68a1f10a-b25c-4e66-b053-7719130718df","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:24:52Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"68a1f10a-b25c-4e66-b053-7719130718df","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:25:01Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-user-perm-test-526006","reconcileID":"4e22fb8e-7528-4d73-8242-2eb03a0a5b0d"} {"level":"info","ts":"2026-07-15T04:25:01Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-user-perm-test-526006","reconcileID":"e2e331a5-1c4a-4900-b781-07da48962de3"} {"level":"info","ts":"2026-07-15T04:25:01Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-user-perm-test-526006","reconcileID":"4caf4597-bc75-41ce-bf1f-5dd0a9bf0b60"} {"level":"info","ts":"2026-07-15T04:25:08Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-edit-test-project-609558","reconcileID":"5e4c11b6-79fb-4a44-9af1-6896ac1dc86c"} {"level":"info","ts":"2026-07-15T04:25:08Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-edit-test-project-609558","reconcileID":"d7429bb4-d717-480c-aee7-308cf949509a"} {"level":"info","ts":"2026-07-15T04:25:08Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-edit-test-project-609558","reconcileID":"5e9b8d22-0c33-43df-a005-78b5b6ea6cfd"} {"level":"info","ts":"2026-07-15T04:25:19Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-edit-test-project-609558","reconcileID":"e80dfa2e-cd22-4987-9999-cdac59d72603"} {"level":"info","ts":"2026-07-15T04:25:19Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-edit-test-project-609558","reconcileID":"76c4e7dd-56c9-4154-99e8-2bf347d6f7e7"} {"level":"info","ts":"2026-07-15T04:25:19Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-edit-test-project-609558","reconcileID":"ed1d88b7-b2bb-41d0-83cd-32cf1c5aa50c"} {"level":"info","ts":"2026-07-15T04:25:22Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-user-perm-test-526006","reconcileID":"d2630e59-6589-4a69-9638-2fa3f815ffa6"} {"level":"info","ts":"2026-07-15T04:25:22Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-user-perm-test-526006","reconcileID":"3acdc492-17e7-4a6d-b6ef-d498d99c7956"} {"level":"info","ts":"2026-07-15T04:25:22Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-user-perm-test-526006","reconcileID":"5f7c4cec-6b35-4fd8-a6d7-eabd306de14f"} {"level":"info","ts":"2026-07-15T04:25:39Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-edit-test-project-609558","reconcileID":"0751ba08-8248-444a-afbf-9cd3d48868a5"} {"level":"info","ts":"2026-07-15T04:25:39Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-edit-test-project-609558","reconcileID":"fd3656c9-d26a-4ed2-a94a-f76222413448"} {"level":"info","ts":"2026-07-15T04:25:39Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-edit-test-project-609558","reconcileID":"a905ae27-e96a-4055-a3cc-33738e45d9c5"} {"level":"info","ts":"2026-07-15T04:25:51Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-user-perm-test-526006","reconcileID":"f271e7f8-066f-4ae0-9192-ca79f1475b70"} {"level":"info","ts":"2026-07-15T04:25:51Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-user-perm-test-526006","reconcileID":"f9e36b40-c42f-464a-a4e5-b740b2a7091c"} {"level":"info","ts":"2026-07-15T04:25:51Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-user-perm-test-526006","reconcileID":"6f83dc0a-1c57-4c21-b94c-8c16a1f74091"} {"level":"info","ts":"2026-07-15T04:25:56Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"qe-cluster-storage-sc-dsp","reconcileID":"296113ca-739b-46a6-8417-234a283ff6d3"} {"level":"info","ts":"2026-07-15T04:25:56Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"qe-cluster-storage-sc-dsp","reconcileID":"9ec417c3-8218-41d9-ba9e-31aaffdb8478"} {"level":"info","ts":"2026-07-15T04:25:56Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"qe-cluster-storage-sc-dsp","reconcileID":"655e55be-1ed7-41d1-80d8-4d5108ef104c"} {"level":"info","ts":"2026-07-15T04:26:08Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"qe-cluster-storage-sc-dsp","reconcileID":"ba786708-e3b5-40fa-aeba-d8f5143ffcef"} {"level":"info","ts":"2026-07-15T04:26:08Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"qe-cluster-storage-sc-dsp","reconcileID":"c12a5b5c-d5ea-4f7d-b22a-f0aba6a3901c"} {"level":"info","ts":"2026-07-15T04:26:08Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"qe-cluster-storage-sc-dsp","reconcileID":"522a1367-2e46-4918-9b93-0427c745604a"} {"level":"info","ts":"2026-07-15T04:26:21Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-user-perm-test-526006","reconcileID":"245b7b89-8b1b-477e-a826-dc77f2a711a5"} {"level":"info","ts":"2026-07-15T04:26:21Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-user-perm-test-526006","reconcileID":"00a8ca07-ea81-433b-aacf-efb45d45509e"} {"level":"info","ts":"2026-07-15T04:26:21Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-user-perm-test-526006","reconcileID":"00c85a17-a7db-4e72-bf2e-2ce0b7cbcb4c"} {"level":"info","ts":"2026-07-15T04:26:27Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"qe-cluster-storage-sc-dsp","reconcileID":"4583a6f7-4a06-4d31-97dc-ad2c3ff0533b"} {"level":"info","ts":"2026-07-15T04:26:27Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"qe-cluster-storage-sc-dsp","reconcileID":"fdb124fb-9ea3-4e3d-9993-87b5943f96dd"} {"level":"info","ts":"2026-07-15T04:26:28Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"qe-cluster-storage-sc-dsp","reconcileID":"3bb88e6d-6fe5-4f9b-902c-0d099e23f9f3"} {"level":"info","ts":"2026-07-15T04:28:39Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-cluster-storage-access-modes","reconcileID":"c8815189-3b2c-433b-b57f-873f75c4b334"} {"level":"info","ts":"2026-07-15T04:28:39Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-cluster-storage-access-modes","reconcileID":"e4cc30a6-b139-4396-be5e-82fe5c7f9e29"} {"level":"info","ts":"2026-07-15T04:28:39Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-cluster-storage-access-modes","reconcileID":"a3a6e456-ddee-4225-b6e6-02d78abd1f54"} {"level":"info","ts":"2026-07-15T04:28:52Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-cluster-storage-access-modes","reconcileID":"867d1f25-8711-4d9a-bcef-bbce9ab93ece"} {"level":"info","ts":"2026-07-15T04:28:52Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-cluster-storage-access-modes","reconcileID":"f67e2989-3d6f-4bf9-82f4-bd0e5b5c553c"} {"level":"info","ts":"2026-07-15T04:28:52Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-cluster-storage-access-modes","reconcileID":"1328c707-3f28-4961-9c22-57b4a6956784"} {"level":"info","ts":"2026-07-15T04:29:13Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-cluster-storage-access-modes","reconcileID":"4d7845d1-0605-4315-b962-126586d29b00"} {"level":"info","ts":"2026-07-15T04:29:13Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-cluster-storage-access-modes","reconcileID":"b594198e-6268-4160-8c3d-2b7563f2278c"} {"level":"info","ts":"2026-07-15T04:29:13Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-cluster-storage-access-modes","reconcileID":"c7e044eb-5e80-4dfa-a638-61ec6d031595"} {"level":"info","ts":"2026-07-15T04:29:20Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-register-store-662874","reconcileID":"daf73edc-b9f9-4c83-9837-61f2b8ee1d04"} {"level":"info","ts":"2026-07-15T04:29:20Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-register-store-662874","reconcileID":"00d554cb-edcc-45b6-9af3-a39d55850dbd"} {"level":"info","ts":"2026-07-15T04:29:20Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-register-store-662874","reconcileID":"671a9adc-26cb-4183-95bb-71de23c96fff"} {"level":"info","ts":"2026-07-15T04:29:42Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-test-connection-type-185825","reconcileID":"3cd85845-9012-44f4-84da-1f21bfca1e53"} {"level":"info","ts":"2026-07-15T04:29:42Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-test-connection-type-185825","reconcileID":"a3b68674-ed8f-4eae-b20d-30a08939f9d1"} {"level":"info","ts":"2026-07-15T04:29:42Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-test-connection-type-185825","reconcileID":"ed97d83f-7aed-40fc-972f-b046748b9a12"} {"level":"info","ts":"2026-07-15T04:29:49Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-register-store-662874","reconcileID":"57626214-19b8-457d-992c-b31cf513b868"} {"level":"info","ts":"2026-07-15T04:29:49Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-register-store-662874","reconcileID":"a7379415-f96a-4493-ab0f-82819752c580"} {"level":"info","ts":"2026-07-15T04:29:49Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-register-store-662874","reconcileID":"c1890854-6192-4e8e-b1cc-016763aba6ca"} {"level":"info","ts":"2026-07-15T04:29:54Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-test-connection-type-185825","reconcileID":"153c2693-30c3-4502-8fa7-c5c412d77583"} {"level":"info","ts":"2026-07-15T04:29:54Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-test-connection-type-185825","reconcileID":"028bd12e-3ec9-43c1-91e3-e2adfcfe9cd3"} {"level":"info","ts":"2026-07-15T04:29:54Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-test-connection-type-185825","reconcileID":"853ec13a-4efb-4f44-b7a2-8f45f1d6118d"} {"level":"info","ts":"2026-07-15T04:30:13Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-test-connection-type-185825","reconcileID":"41740b88-24a0-445f-b737-ac1c23f3425f"} {"level":"info","ts":"2026-07-15T04:30:13Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-test-connection-type-185825","reconcileID":"c18563f7-0c41-4e29-9792-e4f3f2d738d9"} {"level":"info","ts":"2026-07-15T04:30:13Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-test-connection-type-185825","reconcileID":"141d4a6f-6cf9-49c1-b33c-58a7dc1795d8"} {"level":"info","ts":"2026-07-15T04:30:43Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-test-connection-type-185825","reconcileID":"905a5719-3a1f-45c8-88c5-35d4a8849558"} {"level":"info","ts":"2026-07-15T04:30:43Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-test-connection-type-185825","reconcileID":"4118f02d-acc4-4c8b-a55c-8838e733436e"} {"level":"info","ts":"2026-07-15T04:30:43Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-test-connection-type-185825","reconcileID":"8e349712-e078-4eb4-be57-56e701a53a8e"} {"level":"info","ts":"2026-07-15T04:30:50Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-workbench-storage-preset-167984","reconcileID":"c8858000-b4e5-488e-a04a-21dfafa43e22"} {"level":"info","ts":"2026-07-15T04:30:50Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-workbench-storage-preset-167984","reconcileID":"1dcaf3b6-8e08-4c84-9c38-f04707c734fe"} {"level":"info","ts":"2026-07-15T04:30:50Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-workbench-storage-preset-167984","reconcileID":"de84d0b9-c8d4-4bc5-baa9-10d31e135319"} {"level":"info","ts":"2026-07-15T04:31:03Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-workbench-storage-preset-167984","reconcileID":"7971ae5a-9330-4c62-9b4e-756683bd2451"} {"level":"info","ts":"2026-07-15T04:31:03Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-workbench-storage-preset-167984","reconcileID":"b800634f-b193-4c85-b18d-1efd82e4e60e"} {"level":"info","ts":"2026-07-15T04:31:03Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-workbench-storage-preset-167984","reconcileID":"0d12360e-d9bf-4ca7-a8ba-f67a5e6556b1"} {"level":"info","ts":"2026-07-15T04:31:23Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-workbench-storage-preset-167984","reconcileID":"c8af313f-a85d-48b0-9cda-cfddb1ecd3f2"} {"level":"info","ts":"2026-07-15T04:31:23Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-workbench-storage-preset-167984","reconcileID":"5fb29d37-a5a7-4251-958d-ee3830538c07"} {"level":"info","ts":"2026-07-15T04:31:23Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-workbench-storage-preset-167984","reconcileID":"f4d83e62-8686-4d69-a9fd-2f1d015206bb"} {"level":"info","ts":"2026-07-15T04:31:45Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"lifecycle-test-141919","reconcileID":"beb9205d-6368-4adc-81a0-366ce864fb40"} {"level":"info","ts":"2026-07-15T04:31:45Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"lifecycle-test-141919","reconcileID":"3978f748-412d-44d0-a6ef-bbe261110f0a"} {"level":"info","ts":"2026-07-15T04:31:45Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"lifecycle-test-141919","reconcileID":"31d0b9d5-fd7d-4d88-908f-eee82199261c"} {"level":"info","ts":"2026-07-15T04:31:46Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a7788335-bdeb-4ebd-8bb2-d11c88624a30"} {"level":"info","ts":"2026-07-15T04:32:40Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"81c3d391-2483-45e2-bf62-d8bad1b7c7a4"} {"level":"info","ts":"2026-07-15T04:32:42Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"lifecycle-test-141919","reconcileID":"c42665d1-115c-4c68-987b-735858b3faab"} {"level":"info","ts":"2026-07-15T04:32:42Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"lifecycle-test-141919","reconcileID":"e00e61f5-2843-4c00-af79-71e29d9914fc"} {"level":"info","ts":"2026-07-15T04:32:42Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"lifecycle-test-141919","reconcileID":"083249a9-67ac-4c2c-af6e-19f2087ceb6f"} {"level":"info","ts":"2026-07-15T04:32:43Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"49152265-f4fc-406a-8297-257c8cd45cb0"} {"level":"info","ts":"2026-07-15T04:33:46Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"f6c3e4c8-01fb-467e-b380-7d85d2c35d5e"} {"level":"info","ts":"2026-07-15T04:33:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"lifecycle-test-141919","reconcileID":"3358e5f2-37fb-4d8c-a857-c3614e3b80f3"} {"level":"info","ts":"2026-07-15T04:33:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"lifecycle-test-141919","reconcileID":"9536d0e8-6ed7-4261-aa18-6ed5a63c4c2b"} {"level":"info","ts":"2026-07-15T04:33:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"lifecycle-test-141919","reconcileID":"fa3ccd72-e92a-41f3-814c-d8f913b047bf"} {"level":"info","ts":"2026-07-15T04:33:48Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"ff62f53d-7f01-4ebe-beb8-dfe5b86349b1"} {"level":"info","ts":"2026-07-15T04:34:07Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"trainer-v2-test-113378","reconcileID":"a32f4e26-73f0-48f7-af89-aafa4d4a3010"} {"level":"info","ts":"2026-07-15T04:34:07Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"trainer-v2-test-113378","reconcileID":"a66bb329-8502-44ab-9f56-c401f93a1a76"} {"level":"info","ts":"2026-07-15T04:34:07Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"trainer-v2-test-113378","reconcileID":"8c8b54c4-a1a5-4f94-9b31-d39adefad35c"} {"level":"info","ts":"2026-07-15T04:34:08Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a0b46629-3d71-4871-a343-35cd088b0014"} {"level":"info","ts":"2026-07-15T04:34:51Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"53c4a999-ecdb-491f-a35f-41154090efe1"} {"level":"info","ts":"2026-07-15T04:35:02Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"cb87f67a-a1bf-4a21-b225-f06e8922ea84"} {"level":"info","ts":"2026-07-15T04:35:03Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"trainer-v2-test-113378","reconcileID":"3f50574c-4049-49fa-9ea4-45378f160ad1"} {"level":"info","ts":"2026-07-15T04:35:03Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"trainer-v2-test-113378","reconcileID":"0137fea7-5655-4675-92aa-2a77cec7b60c"} {"level":"info","ts":"2026-07-15T04:35:03Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"trainer-v2-test-113378","reconcileID":"d6d68864-1067-407f-8cc5-98c8ea9974fc"} {"level":"info","ts":"2026-07-15T04:35:05Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"9adcc4b7-1f36-489f-8a62-dd0afbf33f26"} {"level":"info","ts":"2026-07-15T04:36:08Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"5d111a03-97fe-4ccf-a580-b59c876b61f7"} {"level":"info","ts":"2026-07-15T04:36:10Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"trainer-v2-test-113378","reconcileID":"b0a377cf-1b25-483d-b8b1-374763e4dfa1"} {"level":"info","ts":"2026-07-15T04:36:10Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"trainer-v2-test-113378","reconcileID":"ad58deb2-495a-42ce-a4d2-d0009501ab89"} {"level":"info","ts":"2026-07-15T04:36:10Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"trainer-v2-test-113378","reconcileID":"f961e8bf-2370-4462-9c33-be26ade25f5e"} {"level":"info","ts":"2026-07-15T04:36:11Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"e52e49f1-21dc-4e12-986a-3d8e9ec1f65e"} {"level":"info","ts":"2026-07-15T04:37:15Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8f8b8e09-00ae-44bc-939f-4ab8ccf1b03b"} {"level":"info","ts":"2026-07-15T04:44:22Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"ca3dda2b-ba5c-4c8f-bc7f-d4f406974195","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:44:22Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"ca3dda2b-ba5c-4c8f-bc7f-d4f406974195","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"24d6b81f-a815-4889-a37f-6aa08560d1ef"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"24d6b81f-a815-4889-a37f-6aa08560d1ef"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"24d6b81f-a815-4889-a37f-6aa08560d1ef","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"24d6b81f-a815-4889-a37f-6aa08560d1ef","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b6d90944-9458-4597-800d-a7523c639c09"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b6d90944-9458-4597-800d-a7523c639c09"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b6d90944-9458-4597-800d-a7523c639c09","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"24d6b81f-a815-4889-a37f-6aa08560d1ef","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b6d90944-9458-4597-800d-a7523c639c09","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b6d90944-9458-4597-800d-a7523c639c09","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b6d90944-9458-4597-800d-a7523c639c09","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b6d90944-9458-4597-800d-a7523c639c09","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b6d90944-9458-4597-800d-a7523c639c09","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b6d90944-9458-4597-800d-a7523c639c09","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b6d90944-9458-4597-800d-a7523c639c09","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b6d90944-9458-4597-800d-a7523c639c09","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"24d6b81f-a815-4889-a37f-6aa08560d1ef","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"24d6b81f-a815-4889-a37f-6aa08560d1ef","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b6d90944-9458-4597-800d-a7523c639c09","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b6d90944-9458-4597-800d-a7523c639c09","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b6d90944-9458-4597-800d-a7523c639c09","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b6d90944-9458-4597-800d-a7523c639c09","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"reconcile","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"edb51107-70a2-4255-a692-360947aa46db"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"apply","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"edb51107-70a2-4255-a692-360947aa46db"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"edb51107-70a2-4255-a692-360947aa46db","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.initialize"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"edb51107-70a2-4255-a692-360947aa46db","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"edb51107-70a2-4255-a692-360947aa46db","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"edb51107-70a2-4255-a692-360947aa46db","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"edb51107-70a2-4255-a692-360947aa46db","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b6d90944-9458-4597-800d-a7523c639c09","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b6d90944-9458-4597-800d-a7523c639c09","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b6d90944-9458-4597-800d-a7523c639c09","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"reconcile","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"7399f680-c4ac-401f-8955-5a7321e32bc8"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"apply","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"7399f680-c4ac-401f-8955-5a7321e32bc8"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"7399f680-c4ac-401f-8955-5a7321e32bc8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"7399f680-c4ac-401f-8955-5a7321e32bc8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.initialize"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"7399f680-c4ac-401f-8955-5a7321e32bc8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.argoWorkflowsControllersOptions"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"7399f680-c4ac-401f-8955-5a7321e32bc8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"7399f680-c4ac-401f-8955-5a7321e32bc8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"7399f680-c4ac-401f-8955-5a7321e32bc8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"63311d8a-f752-4e8b-9ed5-e518a924063d"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"63311d8a-f752-4e8b-9ed5-e518a924063d"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"63311d8a-f752-4e8b-9ed5-e518a924063d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"63311d8a-f752-4e8b-9ed5-e518a924063d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.(*componentHandler).NewComponentReconciler.checkSubscriptionDependencies.func26"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"63311d8a-f752-4e8b-9ed5-e518a924063d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"63311d8a-f752-4e8b-9ed5-e518a924063d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"reconcile","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"837403fa-5f11-4f2c-bfab-725fb8e7116b"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"apply","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"837403fa-5f11-4f2c-bfab-725fb8e7116b"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"837403fa-5f11-4f2c-bfab-725fb8e7116b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainingoperator.initialize"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"837403fa-5f11-4f2c-bfab-725fb8e7116b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"837403fa-5f11-4f2c-bfab-725fb8e7116b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"837403fa-5f11-4f2c-bfab-725fb8e7116b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"ecc679ea-eb6c-4da1-992f-1dbea49b7c0a"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"ecc679ea-eb6c-4da1-992f-1dbea49b7c0a"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"ecc679ea-eb6c-4da1-992f-1dbea49b7c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-15T04:44:32Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"ecc679ea-eb6c-4da1-992f-1dbea49b7c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"reconcile","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e8792a40-5a69-4061-b71d-2c09231624eb"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"apply","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e8792a40-5a69-4061-b71d-2c09231624eb"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e8792a40-5a69-4061-b71d-2c09231624eb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/sanitycheck.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e8792a40-5a69-4061-b71d-2c09231624eb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ray.initialize"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e8792a40-5a69-4061-b71d-2c09231624eb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e8792a40-5a69-4061-b71d-2c09231624eb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"ecc679ea-eb6c-4da1-992f-1dbea49b7c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"ecc679ea-eb6c-4da1-992f-1dbea49b7c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"ecc679ea-eb6c-4da1-992f-1dbea49b7c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"ecc679ea-eb6c-4da1-992f-1dbea49b7c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"reconcile","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"c6f473b0-70c3-4145-9c0e-e5c602c53748"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"apply","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"c6f473b0-70c3-4145-9c0e-e5c602c53748"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"c6f473b0-70c3-4145-9c0e-e5c602c53748","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.initialize"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"c6f473b0-70c3-4145-9c0e-e5c602c53748","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.customizeManifests"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"c6f473b0-70c3-4145-9c0e-e5c602c53748","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"c6f473b0-70c3-4145-9c0e-e5c602c53748","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.configureDependencies"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"c6f473b0-70c3-4145-9c0e-e5c602c53748","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"c6f473b0-70c3-4145-9c0e-e5c602c53748","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"c6f473b0-70c3-4145-9c0e-e5c602c53748","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e8792a40-5a69-4061-b71d-2c09231624eb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"reconcile","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"501b611b-c207-4631-92ef-2ac4e6c774c1"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"apply","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"501b611b-c207-4631-92ef-2ac4e6c774c1"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"501b611b-c207-4631-92ef-2ac4e6c774c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"501b611b-c207-4631-92ef-2ac4e6c774c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.initialize"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"501b611b-c207-4631-92ef-2ac4e6c774c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"501b611b-c207-4631-92ef-2ac4e6c774c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkJobSetCRD"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"501b611b-c207-4631-92ef-2ac4e6c774c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"501b611b-c207-4631-92ef-2ac4e6c774c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"reconcile","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"c0ef9327-f9c2-4a9a-ae5d-83f43953aa62"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"apply","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"c0ef9327-f9c2-4a9a-ae5d-83f43953aa62"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"c0ef9327-f9c2-4a9a-ae5d-83f43953aa62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.initialize"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"c0ef9327-f9c2-4a9a-ae5d-83f43953aa62","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"c0ef9327-f9c2-4a9a-ae5d-83f43953aa62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.configureDependencies"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"c0ef9327-f9c2-4a9a-ae5d-83f43953aa62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"c0ef9327-f9c2-4a9a-ae5d-83f43953aa62","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"501b611b-c207-4631-92ef-2ac4e6c774c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eaddc5fb-7f05-4cb6-8224-f930781410b6"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eaddc5fb-7f05-4cb6-8224-f930781410b6"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eaddc5fb-7f05-4cb6-8224-f930781410b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eaddc5fb-7f05-4cb6-8224-f930781410b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eaddc5fb-7f05-4cb6-8224-f930781410b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"24d6b81f-a815-4889-a37f-6aa08560d1ef","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:33Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"d0f82644-5b4e-4145-a178-17f4c0ffeca8","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:44:33Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"d0f82644-5b4e-4145-a178-17f4c0ffeca8","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:34Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eaddc5fb-7f05-4cb6-8224-f930781410b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:34Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eaddc5fb-7f05-4cb6-8224-f930781410b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T04:44:34Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eaddc5fb-7f05-4cb6-8224-f930781410b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T04:44:34Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eaddc5fb-7f05-4cb6-8224-f930781410b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:34Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eaddc5fb-7f05-4cb6-8224-f930781410b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T04:44:34Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eaddc5fb-7f05-4cb6-8224-f930781410b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T04:44:34Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eaddc5fb-7f05-4cb6-8224-f930781410b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:35Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"delete","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"24d6b81f-a815-4889-a37f-6aa08560d1ef","gvk":"components.platform.opendatahub.io/v1alpha1, Kind=SparkOperator","ns":"","name":"default-sparkoperator"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"5edf84d8-a122-4f21-bce7-846f16d92454"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"52132810-be3c-497c-9fa8-24437fe4a4cb"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"c6f473b0-70c3-4145-9c0e-e5c602c53748","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8bf74186-0303-4568-a0f3-fb242f58fb94"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"c6f473b0-70c3-4145-9c0e-e5c602c53748","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.updateStatus"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"c6f473b0-70c3-4145-9c0e-e5c602c53748","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"c6f473b0-70c3-4145-9c0e-e5c602c53748","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"46b968e4-e2fe-4997-be2c-66ad0413586a"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"c8699027-bbc2-4aa2-a751-3ddd68bb8cfb"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"6c01ba5b-ebef-4888-bb7a-3784d091f5c3"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"2369a2c1-733a-4865-b1a3-1e8df5be9fe5"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b81ba022-4e13-437d-8755-6c87d950e69a"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b81ba022-4e13-437d-8755-6c87d950e69a"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b81ba022-4e13-437d-8755-6c87d950e69a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"4d5a0d4a-23e3-47c8-a63c-b82d0b282309"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"516e5801-6e3b-44ad-a278-c74ed97c5013"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"0f0c3b74-7c5f-4376-b70d-448ac538376f"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"e3123220-5ce2-4178-a9cd-6356ebc9325e"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"c8a3915e-8852-4339-9490-88a5cbc82553"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"c76f6f22-a996-4977-ac5e-0af579919cf2"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"aeddf365-c932-4d7d-b40c-afdaa691a7eb"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b81ba022-4e13-437d-8755-6c87d950e69a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b81ba022-4e13-437d-8755-6c87d950e69a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b81ba022-4e13-437d-8755-6c87d950e69a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b81ba022-4e13-437d-8755-6c87d950e69a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b81ba022-4e13-437d-8755-6c87d950e69a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b81ba022-4e13-437d-8755-6c87d950e69a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b81ba022-4e13-437d-8755-6c87d950e69a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b81ba022-4e13-437d-8755-6c87d950e69a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"aa874ff5-2f9f-4642-999d-dc238c9d2419"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"79ba6927-bac1-485e-980e-765986b9d607"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"886a84b9-4f7c-47d3-b888-501b30101e9d"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"fd516550-0ba8-4ffc-8786-1246b7b97500"} {"level":"info","ts":"2026-07-15T04:44:35Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"69a145a7-eeaf-49e5-9bf7-37dd593ea9e4"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b81ba022-4e13-437d-8755-6c87d950e69a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b81ba022-4e13-437d-8755-6c87d950e69a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b81ba022-4e13-437d-8755-6c87d950e69a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b81ba022-4e13-437d-8755-6c87d950e69a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b81ba022-4e13-437d-8755-6c87d950e69a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b81ba022-4e13-437d-8755-6c87d950e69a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b81ba022-4e13-437d-8755-6c87d950e69a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8ca6e445-b2f9-4714-8bab-9cfb0f30fbfe"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"24d6b81f-a815-4889-a37f-6aa08560d1ef","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"2379a948-ae1d-4839-8f52-6a52bee992e8"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"adfa207a-2671-4c76-8904-a1ba543734dd"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"959d8a82-ccc6-41cf-8a73-dc18490f7ac1"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"a68c0ad0-5638-4a9a-91a2-59d56bb0658a"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"481c52a7-7de1-48e1-8cd0-0576420532e3"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"19b0a3fc-5fca-42e1-8f48-fd5bf430ca18"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"19b0a3fc-5fca-42e1-8f48-fd5bf430ca18"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"19b0a3fc-5fca-42e1-8f48-fd5bf430ca18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"19b0a3fc-5fca-42e1-8f48-fd5bf430ca18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"19b0a3fc-5fca-42e1-8f48-fd5bf430ca18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"19b0a3fc-5fca-42e1-8f48-fd5bf430ca18","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"19b0a3fc-5fca-42e1-8f48-fd5bf430ca18","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"19b0a3fc-5fca-42e1-8f48-fd5bf430ca18","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"edb51107-70a2-4255-a692-360947aa46db","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"edb51107-70a2-4255-a692-360947aa46db","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:36Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"edb51107-70a2-4255-a692-360947aa46db","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"f48bf695-5064-4939-bde1-670207cd64b1"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"381dbed4-7329-4a2e-bf13-c86dafe942ae"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"381dbed4-7329-4a2e-bf13-c86dafe942ae"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"381dbed4-7329-4a2e-bf13-c86dafe942ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"381dbed4-7329-4a2e-bf13-c86dafe942ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"381dbed4-7329-4a2e-bf13-c86dafe942ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"381dbed4-7329-4a2e-bf13-c86dafe942ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"381dbed4-7329-4a2e-bf13-c86dafe942ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"381dbed4-7329-4a2e-bf13-c86dafe942ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"381dbed4-7329-4a2e-bf13-c86dafe942ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"381dbed4-7329-4a2e-bf13-c86dafe942ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"381dbed4-7329-4a2e-bf13-c86dafe942ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:44:37Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"92d71427-c489-488f-b00e-e0804694102c","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"92d71427-c489-488f-b00e-e0804694102c","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"6e80fd73-b516-416c-a7d1-2afec6099085"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"381dbed4-7329-4a2e-bf13-c86dafe942ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"381dbed4-7329-4a2e-bf13-c86dafe942ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"381dbed4-7329-4a2e-bf13-c86dafe942ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"381dbed4-7329-4a2e-bf13-c86dafe942ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"381dbed4-7329-4a2e-bf13-c86dafe942ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"381dbed4-7329-4a2e-bf13-c86dafe942ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"381dbed4-7329-4a2e-bf13-c86dafe942ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"63311d8a-f752-4e8b-9ed5-e518a924063d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"63311d8a-f752-4e8b-9ed5-e518a924063d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"63311d8a-f752-4e8b-9ed5-e518a924063d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"c0ef9327-f9c2-4a9a-ae5d-83f43953aa62","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"19b0a3fc-5fca-42e1-8f48-fd5bf430ca18","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"7399f680-c4ac-401f-8955-5a7321e32bc8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"7399f680-c4ac-401f-8955-5a7321e32bc8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"7399f680-c4ac-401f-8955-5a7321e32bc8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"64d1ebdd-f3a2-47e9-8992-e91ac90143b4"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"64d1ebdd-f3a2-47e9-8992-e91ac90143b4"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"64d1ebdd-f3a2-47e9-8992-e91ac90143b4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"64d1ebdd-f3a2-47e9-8992-e91ac90143b4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"64d1ebdd-f3a2-47e9-8992-e91ac90143b4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"64d1ebdd-f3a2-47e9-8992-e91ac90143b4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:44:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"64d1ebdd-f3a2-47e9-8992-e91ac90143b4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"64d1ebdd-f3a2-47e9-8992-e91ac90143b4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"837403fa-5f11-4f2c-bfab-725fb8e7116b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"837403fa-5f11-4f2c-bfab-725fb8e7116b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"837403fa-5f11-4f2c-bfab-725fb8e7116b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"d0141b4d-948f-4cfc-b02a-e4d048b1a2ec","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"d0141b4d-948f-4cfc-b02a-e4d048b1a2ec","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fa5eadef-3855-495a-8cdd-eb4396ce350b"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fa5eadef-3855-495a-8cdd-eb4396ce350b"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fa5eadef-3855-495a-8cdd-eb4396ce350b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fa5eadef-3855-495a-8cdd-eb4396ce350b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fa5eadef-3855-495a-8cdd-eb4396ce350b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fa5eadef-3855-495a-8cdd-eb4396ce350b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fa5eadef-3855-495a-8cdd-eb4396ce350b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fa5eadef-3855-495a-8cdd-eb4396ce350b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fa5eadef-3855-495a-8cdd-eb4396ce350b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fa5eadef-3855-495a-8cdd-eb4396ce350b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fa5eadef-3855-495a-8cdd-eb4396ce350b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fa5eadef-3855-495a-8cdd-eb4396ce350b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fa5eadef-3855-495a-8cdd-eb4396ce350b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fa5eadef-3855-495a-8cdd-eb4396ce350b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fa5eadef-3855-495a-8cdd-eb4396ce350b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fa5eadef-3855-495a-8cdd-eb4396ce350b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fa5eadef-3855-495a-8cdd-eb4396ce350b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fa5eadef-3855-495a-8cdd-eb4396ce350b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"501b611b-c207-4631-92ef-2ac4e6c774c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"501b611b-c207-4631-92ef-2ac4e6c774c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"501b611b-c207-4631-92ef-2ac4e6c774c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"64d1ebdd-f3a2-47e9-8992-e91ac90143b4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e8792a40-5a69-4061-b71d-2c09231624eb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e8792a40-5a69-4061-b71d-2c09231624eb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e8792a40-5a69-4061-b71d-2c09231624eb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a2c7ceba-9a5f-4e21-80a3-fecb23685875"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a2c7ceba-9a5f-4e21-80a3-fecb23685875"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a2c7ceba-9a5f-4e21-80a3-fecb23685875","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a2c7ceba-9a5f-4e21-80a3-fecb23685875","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a2c7ceba-9a5f-4e21-80a3-fecb23685875","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a2c7ceba-9a5f-4e21-80a3-fecb23685875","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a2c7ceba-9a5f-4e21-80a3-fecb23685875","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a2c7ceba-9a5f-4e21-80a3-fecb23685875","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e1713c5e-f672-4453-975a-e0e4e5299b6b","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e1713c5e-f672-4453-975a-e0e4e5299b6b","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9130ee71-f7b6-476a-ba83-da3fc04ec5d5"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9130ee71-f7b6-476a-ba83-da3fc04ec5d5"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9130ee71-f7b6-476a-ba83-da3fc04ec5d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9130ee71-f7b6-476a-ba83-da3fc04ec5d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9130ee71-f7b6-476a-ba83-da3fc04ec5d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9130ee71-f7b6-476a-ba83-da3fc04ec5d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9130ee71-f7b6-476a-ba83-da3fc04ec5d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9130ee71-f7b6-476a-ba83-da3fc04ec5d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9130ee71-f7b6-476a-ba83-da3fc04ec5d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9130ee71-f7b6-476a-ba83-da3fc04ec5d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9130ee71-f7b6-476a-ba83-da3fc04ec5d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9130ee71-f7b6-476a-ba83-da3fc04ec5d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9130ee71-f7b6-476a-ba83-da3fc04ec5d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9130ee71-f7b6-476a-ba83-da3fc04ec5d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9130ee71-f7b6-476a-ba83-da3fc04ec5d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9130ee71-f7b6-476a-ba83-da3fc04ec5d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9130ee71-f7b6-476a-ba83-da3fc04ec5d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9130ee71-f7b6-476a-ba83-da3fc04ec5d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a2c7ceba-9a5f-4e21-80a3-fecb23685875","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d746b3ca-c2df-4e07-944c-2592dcb2e635"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d746b3ca-c2df-4e07-944c-2592dcb2e635"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d746b3ca-c2df-4e07-944c-2592dcb2e635","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d746b3ca-c2df-4e07-944c-2592dcb2e635","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d746b3ca-c2df-4e07-944c-2592dcb2e635","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d746b3ca-c2df-4e07-944c-2592dcb2e635","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d746b3ca-c2df-4e07-944c-2592dcb2e635","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d746b3ca-c2df-4e07-944c-2592dcb2e635","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d746b3ca-c2df-4e07-944c-2592dcb2e635","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"ecc679ea-eb6c-4da1-992f-1dbea49b7c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"ecc679ea-eb6c-4da1-992f-1dbea49b7c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"ecc679ea-eb6c-4da1-992f-1dbea49b7c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"ecc679ea-eb6c-4da1-992f-1dbea49b7c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"ecc679ea-eb6c-4da1-992f-1dbea49b7c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8a7c9e2a-5a0e-4000-9b5c-b016aa9d3084"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8a7c9e2a-5a0e-4000-9b5c-b016aa9d3084"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8a7c9e2a-5a0e-4000-9b5c-b016aa9d3084","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8a7c9e2a-5a0e-4000-9b5c-b016aa9d3084","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8a7c9e2a-5a0e-4000-9b5c-b016aa9d3084","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8a7c9e2a-5a0e-4000-9b5c-b016aa9d3084","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8a7c9e2a-5a0e-4000-9b5c-b016aa9d3084","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8a7c9e2a-5a0e-4000-9b5c-b016aa9d3084","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:39Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8a7c9e2a-5a0e-4000-9b5c-b016aa9d3084","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:39Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"c0ef9327-f9c2-4a9a-ae5d-83f43953aa62","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:39Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"c0ef9327-f9c2-4a9a-ae5d-83f43953aa62","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/imagestreams.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:39Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"c0ef9327-f9c2-4a9a-ae5d-83f43953aa62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.updateStatus"} {"level":"info","ts":"2026-07-15T04:44:39Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"c0ef9327-f9c2-4a9a-ae5d-83f43953aa62","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:39Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"c0ef9327-f9c2-4a9a-ae5d-83f43953aa62"} {"level":"info","ts":"2026-07-15T04:44:39Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"c0ef9327-f9c2-4a9a-ae5d-83f43953aa62","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:39Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"870bb5af-c5db-4d5f-bf24-fc83898a3f3c"} {"level":"info","ts":"2026-07-15T04:44:39Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"870bb5af-c5db-4d5f-bf24-fc83898a3f3c"} {"level":"info","ts":"2026-07-15T04:44:39Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"870bb5af-c5db-4d5f-bf24-fc83898a3f3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:44:39Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"870bb5af-c5db-4d5f-bf24-fc83898a3f3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:44:39Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"870bb5af-c5db-4d5f-bf24-fc83898a3f3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:44:39Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"870bb5af-c5db-4d5f-bf24-fc83898a3f3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:44:39Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"870bb5af-c5db-4d5f-bf24-fc83898a3f3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:39Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"870bb5af-c5db-4d5f-bf24-fc83898a3f3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:39Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"870bb5af-c5db-4d5f-bf24-fc83898a3f3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"bc9e1607-1023-44f6-a1af-44d66797478a"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"bc9e1607-1023-44f6-a1af-44d66797478a"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"bc9e1607-1023-44f6-a1af-44d66797478a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"bc9e1607-1023-44f6-a1af-44d66797478a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb98b62-703f-470f-b185-5888a059d5b8"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb98b62-703f-470f-b185-5888a059d5b8"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb98b62-703f-470f-b185-5888a059d5b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"bc9e1607-1023-44f6-a1af-44d66797478a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb98b62-703f-470f-b185-5888a059d5b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb98b62-703f-470f-b185-5888a059d5b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb98b62-703f-470f-b185-5888a059d5b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb98b62-703f-470f-b185-5888a059d5b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb98b62-703f-470f-b185-5888a059d5b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb98b62-703f-470f-b185-5888a059d5b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb98b62-703f-470f-b185-5888a059d5b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb98b62-703f-470f-b185-5888a059d5b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"bc9e1607-1023-44f6-a1af-44d66797478a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"bc9e1607-1023-44f6-a1af-44d66797478a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb98b62-703f-470f-b185-5888a059d5b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb98b62-703f-470f-b185-5888a059d5b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb98b62-703f-470f-b185-5888a059d5b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb98b62-703f-470f-b185-5888a059d5b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb98b62-703f-470f-b185-5888a059d5b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb98b62-703f-470f-b185-5888a059d5b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb98b62-703f-470f-b185-5888a059d5b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"reconcile","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"91503c9e-711a-484e-b9be-e398f6f3de54"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"apply","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"91503c9e-711a-484e-b9be-e398f6f3de54"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"91503c9e-711a-484e-b9be-e398f6f3de54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/sanitycheck.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"91503c9e-711a-484e-b9be-e398f6f3de54","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ray.initialize"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"91503c9e-711a-484e-b9be-e398f6f3de54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"91503c9e-711a-484e-b9be-e398f6f3de54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"reconcile","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"5b643afd-043b-49d4-9b66-6ae97fb16e30"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"apply","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"5b643afd-043b-49d4-9b66-6ae97fb16e30"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"5b643afd-043b-49d4-9b66-6ae97fb16e30","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.initialize"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"5b643afd-043b-49d4-9b66-6ae97fb16e30","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.customizeManifests"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"5b643afd-043b-49d4-9b66-6ae97fb16e30","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"5b643afd-043b-49d4-9b66-6ae97fb16e30","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.configureDependencies"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"5b643afd-043b-49d4-9b66-6ae97fb16e30","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"5b643afd-043b-49d4-9b66-6ae97fb16e30","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"5b643afd-043b-49d4-9b66-6ae97fb16e30","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"91503c9e-711a-484e-b9be-e398f6f3de54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"reconcile","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"efa7afe1-20e4-49f7-9745-f55326ed612a"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"apply","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"efa7afe1-20e4-49f7-9745-f55326ed612a"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"efa7afe1-20e4-49f7-9745-f55326ed612a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"efa7afe1-20e4-49f7-9745-f55326ed612a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.initialize"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"efa7afe1-20e4-49f7-9745-f55326ed612a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"efa7afe1-20e4-49f7-9745-f55326ed612a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkJobSetCRD"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"5b643afd-043b-49d4-9b66-6ae97fb16e30","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"5b643afd-043b-49d4-9b66-6ae97fb16e30","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.updateStatus"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"5b643afd-043b-49d4-9b66-6ae97fb16e30","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"5b643afd-043b-49d4-9b66-6ae97fb16e30","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"reconcile","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"e0934b66-c080-44b2-bead-f996f0a1fa50"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"apply","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"e0934b66-c080-44b2-bead-f996f0a1fa50"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"e0934b66-c080-44b2-bead-f996f0a1fa50","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.initialize"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"e0934b66-c080-44b2-bead-f996f0a1fa50","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"e0934b66-c080-44b2-bead-f996f0a1fa50","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.configureDependencies"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"e0934b66-c080-44b2-bead-f996f0a1fa50","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:44:42Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"e0934b66-c080-44b2-bead-f996f0a1fa50","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"reconcile","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"b154beea-051d-456d-bd18-539ef4bf5ed2"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"apply","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"b154beea-051d-456d-bd18-539ef4bf5ed2"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"b154beea-051d-456d-bd18-539ef4bf5ed2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.initialize"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"b154beea-051d-456d-bd18-539ef4bf5ed2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"b154beea-051d-456d-bd18-539ef4bf5ed2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"b154beea-051d-456d-bd18-539ef4bf5ed2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"efa7afe1-20e4-49f7-9745-f55326ed612a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"efa7afe1-20e4-49f7-9745-f55326ed612a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"b154beea-051d-456d-bd18-539ef4bf5ed2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"efa7afe1-20e4-49f7-9745-f55326ed612a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"reconcile","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"5102c729-1de0-40cd-9fbe-f24b7e45b3f6"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"apply","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"5102c729-1de0-40cd-9fbe-f24b7e45b3f6"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"5102c729-1de0-40cd-9fbe-f24b7e45b3f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"5102c729-1de0-40cd-9fbe-f24b7e45b3f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.initialize"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"5102c729-1de0-40cd-9fbe-f24b7e45b3f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.argoWorkflowsControllersOptions"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"5102c729-1de0-40cd-9fbe-f24b7e45b3f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"5102c729-1de0-40cd-9fbe-f24b7e45b3f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"5102c729-1de0-40cd-9fbe-f24b7e45b3f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"c49542f0-9935-4731-a8a2-5c90507fa161"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"c49542f0-9935-4731-a8a2-5c90507fa161"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"c49542f0-9935-4731-a8a2-5c90507fa161","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"c49542f0-9935-4731-a8a2-5c90507fa161","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.(*componentHandler).NewComponentReconciler.checkSubscriptionDependencies.func26"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"c49542f0-9935-4731-a8a2-5c90507fa161","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"c49542f0-9935-4731-a8a2-5c90507fa161","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"reconcile","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"678dd155-685a-484f-b915-11b6876a7d36"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"apply","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"678dd155-685a-484f-b915-11b6876a7d36"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"678dd155-685a-484f-b915-11b6876a7d36","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainingoperator.initialize"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"678dd155-685a-484f-b915-11b6876a7d36","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"678dd155-685a-484f-b915-11b6876a7d36","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"678dd155-685a-484f-b915-11b6876a7d36","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"aea96390-2651-4ff5-9418-cdc5a30e94ce"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"aea96390-2651-4ff5-9418-cdc5a30e94ce"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"aea96390-2651-4ff5-9418-cdc5a30e94ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"aea96390-2651-4ff5-9418-cdc5a30e94ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"c49542f0-9935-4731-a8a2-5c90507fa161","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"c49542f0-9935-4731-a8a2-5c90507fa161","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"c49542f0-9935-4731-a8a2-5c90507fa161","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"bc9e1607-1023-44f6-a1af-44d66797478a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"e8b170bd-5586-492c-abad-b5069e1f602a"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"e8b170bd-5586-492c-abad-b5069e1f602a"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"e8b170bd-5586-492c-abad-b5069e1f602a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"e8b170bd-5586-492c-abad-b5069e1f602a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"e8b170bd-5586-492c-abad-b5069e1f602a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:43Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"5102c729-1de0-40cd-9fbe-f24b7e45b3f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:44Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"91503c9e-711a-484e-b9be-e398f6f3de54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:44Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"91503c9e-711a-484e-b9be-e398f6f3de54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:44Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"91503c9e-711a-484e-b9be-e398f6f3de54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:44Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"b154beea-051d-456d-bd18-539ef4bf5ed2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:44Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"b154beea-051d-456d-bd18-539ef4bf5ed2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:44Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"b154beea-051d-456d-bd18-539ef4bf5ed2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:44Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"efa7afe1-20e4-49f7-9745-f55326ed612a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:44Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"efa7afe1-20e4-49f7-9745-f55326ed612a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:44Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"efa7afe1-20e4-49f7-9745-f55326ed612a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:44Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"678dd155-685a-484f-b915-11b6876a7d36","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:44Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"678dd155-685a-484f-b915-11b6876a7d36","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:44Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"678dd155-685a-484f-b915-11b6876a7d36","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:44Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"aea96390-2651-4ff5-9418-cdc5a30e94ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:44:44Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"aea96390-2651-4ff5-9418-cdc5a30e94ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-15T04:44:44Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"aea96390-2651-4ff5-9418-cdc5a30e94ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:44Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"aea96390-2651-4ff5-9418-cdc5a30e94ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:44Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"5102c729-1de0-40cd-9fbe-f24b7e45b3f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:44Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"5102c729-1de0-40cd-9fbe-f24b7e45b3f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:44Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e465b404-3863-4642-9257-ee2134b40218","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:44:44Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e465b404-3863-4642-9257-ee2134b40218","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"e8b170bd-5586-492c-abad-b5069e1f602a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"bc9e1607-1023-44f6-a1af-44d66797478a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7c52024c-969b-4e68-903a-bd22802d97c2"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7c52024c-969b-4e68-903a-bd22802d97c2"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7c52024c-969b-4e68-903a-bd22802d97c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7c52024c-969b-4e68-903a-bd22802d97c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7c52024c-969b-4e68-903a-bd22802d97c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7c52024c-969b-4e68-903a-bd22802d97c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7c52024c-969b-4e68-903a-bd22802d97c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dc926f4b-c9a2-4b80-959e-52cc216ae5ea"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dc926f4b-c9a2-4b80-959e-52cc216ae5ea"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dc926f4b-c9a2-4b80-959e-52cc216ae5ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dc926f4b-c9a2-4b80-959e-52cc216ae5ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dc926f4b-c9a2-4b80-959e-52cc216ae5ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dc926f4b-c9a2-4b80-959e-52cc216ae5ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dc926f4b-c9a2-4b80-959e-52cc216ae5ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dc926f4b-c9a2-4b80-959e-52cc216ae5ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dc926f4b-c9a2-4b80-959e-52cc216ae5ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dc926f4b-c9a2-4b80-959e-52cc216ae5ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dc926f4b-c9a2-4b80-959e-52cc216ae5ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dc926f4b-c9a2-4b80-959e-52cc216ae5ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dc926f4b-c9a2-4b80-959e-52cc216ae5ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dc926f4b-c9a2-4b80-959e-52cc216ae5ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dc926f4b-c9a2-4b80-959e-52cc216ae5ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dc926f4b-c9a2-4b80-959e-52cc216ae5ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dc926f4b-c9a2-4b80-959e-52cc216ae5ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dc926f4b-c9a2-4b80-959e-52cc216ae5ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"e0934b66-c080-44b2-bead-f996f0a1fa50","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7c52024c-969b-4e68-903a-bd22802d97c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"e0934b66-c080-44b2-bead-f996f0a1fa50","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"e0934b66-c080-44b2-bead-f996f0a1fa50","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/imagestreams.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"e0934b66-c080-44b2-bead-f996f0a1fa50","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.updateStatus"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"e0934b66-c080-44b2-bead-f996f0a1fa50","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:46Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"3b0e7e7c-3033-465b-a602-d756a9794681","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"3b0e7e7c-3033-465b-a602-d756a9794681","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7c52024c-969b-4e68-903a-bd22802d97c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eaddc5fb-7f05-4cb6-8224-f930781410b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eaddc5fb-7f05-4cb6-8224-f930781410b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eaddc5fb-7f05-4cb6-8224-f930781410b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eaddc5fb-7f05-4cb6-8224-f930781410b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"695efd16-a7b9-4220-a035-f639809a7ee9"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"695efd16-a7b9-4220-a035-f639809a7ee9"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"695efd16-a7b9-4220-a035-f639809a7ee9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"695efd16-a7b9-4220-a035-f639809a7ee9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"695efd16-a7b9-4220-a035-f639809a7ee9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"695efd16-a7b9-4220-a035-f639809a7ee9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"695efd16-a7b9-4220-a035-f639809a7ee9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bf866047-59c1-47d5-8ba4-9c54cd7f5ead"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bf866047-59c1-47d5-8ba4-9c54cd7f5ead"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bf866047-59c1-47d5-8ba4-9c54cd7f5ead","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bf866047-59c1-47d5-8ba4-9c54cd7f5ead","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bf866047-59c1-47d5-8ba4-9c54cd7f5ead","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"695efd16-a7b9-4220-a035-f639809a7ee9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bf866047-59c1-47d5-8ba4-9c54cd7f5ead","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bf866047-59c1-47d5-8ba4-9c54cd7f5ead","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bf866047-59c1-47d5-8ba4-9c54cd7f5ead","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bf866047-59c1-47d5-8ba4-9c54cd7f5ead","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bf866047-59c1-47d5-8ba4-9c54cd7f5ead","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bf866047-59c1-47d5-8ba4-9c54cd7f5ead","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bf866047-59c1-47d5-8ba4-9c54cd7f5ead","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"695efd16-a7b9-4220-a035-f639809a7ee9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bf866047-59c1-47d5-8ba4-9c54cd7f5ead","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bf866047-59c1-47d5-8ba4-9c54cd7f5ead","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bf866047-59c1-47d5-8ba4-9c54cd7f5ead","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bf866047-59c1-47d5-8ba4-9c54cd7f5ead","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:47Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"e0934b66-c080-44b2-bead-f996f0a1fa50"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4c873bb5-cfc6-46f4-be60-0f8a7563a395"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4c873bb5-cfc6-46f4-be60-0f8a7563a395"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4c873bb5-cfc6-46f4-be60-0f8a7563a395","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4c873bb5-cfc6-46f4-be60-0f8a7563a395","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4c873bb5-cfc6-46f4-be60-0f8a7563a395","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4c873bb5-cfc6-46f4-be60-0f8a7563a395","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4c873bb5-cfc6-46f4-be60-0f8a7563a395","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"aea96390-2651-4ff5-9418-cdc5a30e94ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"aea96390-2651-4ff5-9418-cdc5a30e94ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"aea96390-2651-4ff5-9418-cdc5a30e94ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"aea96390-2651-4ff5-9418-cdc5a30e94ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"aea96390-2651-4ff5-9418-cdc5a30e94ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4c873bb5-cfc6-46f4-be60-0f8a7563a395","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:47Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"e0934b66-c080-44b2-bead-f996f0a1fa50","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4c873bb5-cfc6-46f4-be60-0f8a7563a395","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef3cfd47-ae3e-441a-88c6-ef3113c8865f"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef3cfd47-ae3e-441a-88c6-ef3113c8865f"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef3cfd47-ae3e-441a-88c6-ef3113c8865f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef3cfd47-ae3e-441a-88c6-ef3113c8865f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef3cfd47-ae3e-441a-88c6-ef3113c8865f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef3cfd47-ae3e-441a-88c6-ef3113c8865f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef3cfd47-ae3e-441a-88c6-ef3113c8865f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef3cfd47-ae3e-441a-88c6-ef3113c8865f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef3cfd47-ae3e-441a-88c6-ef3113c8865f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef3cfd47-ae3e-441a-88c6-ef3113c8865f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef3cfd47-ae3e-441a-88c6-ef3113c8865f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef3cfd47-ae3e-441a-88c6-ef3113c8865f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef3cfd47-ae3e-441a-88c6-ef3113c8865f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef3cfd47-ae3e-441a-88c6-ef3113c8865f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef3cfd47-ae3e-441a-88c6-ef3113c8865f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef3cfd47-ae3e-441a-88c6-ef3113c8865f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef3cfd47-ae3e-441a-88c6-ef3113c8865f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef3cfd47-ae3e-441a-88c6-ef3113c8865f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fcea4a64-96e7-4c24-8e95-b3b1d282957e"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fcea4a64-96e7-4c24-8e95-b3b1d282957e"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fcea4a64-96e7-4c24-8e95-b3b1d282957e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fcea4a64-96e7-4c24-8e95-b3b1d282957e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fcea4a64-96e7-4c24-8e95-b3b1d282957e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fcea4a64-96e7-4c24-8e95-b3b1d282957e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fcea4a64-96e7-4c24-8e95-b3b1d282957e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"e8b170bd-5586-492c-abad-b5069e1f602a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"e8b170bd-5586-492c-abad-b5069e1f602a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fcea4a64-96e7-4c24-8e95-b3b1d282957e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e20e4187-e9b6-4e33-980b-b31c255b3f53","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e20e4187-e9b6-4e33-980b-b31c255b3f53","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fcea4a64-96e7-4c24-8e95-b3b1d282957e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"e8b170bd-5586-492c-abad-b5069e1f602a"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"e8b170bd-5586-492c-abad-b5069e1f602a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8e01a92c-1220-4ea8-a788-1d1324251ac8"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8e01a92c-1220-4ea8-a788-1d1324251ac8"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8e01a92c-1220-4ea8-a788-1d1324251ac8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8e01a92c-1220-4ea8-a788-1d1324251ac8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8e01a92c-1220-4ea8-a788-1d1324251ac8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6d21893a-ba4a-4c72-87ba-641296b13c87"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6d21893a-ba4a-4c72-87ba-641296b13c87"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6d21893a-ba4a-4c72-87ba-641296b13c87","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6d21893a-ba4a-4c72-87ba-641296b13c87","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6d21893a-ba4a-4c72-87ba-641296b13c87","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6d21893a-ba4a-4c72-87ba-641296b13c87","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6d21893a-ba4a-4c72-87ba-641296b13c87","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8e01a92c-1220-4ea8-a788-1d1324251ac8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6d21893a-ba4a-4c72-87ba-641296b13c87","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8e01a92c-1220-4ea8-a788-1d1324251ac8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8e01a92c-1220-4ea8-a788-1d1324251ac8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8e01a92c-1220-4ea8-a788-1d1324251ac8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:44:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6d21893a-ba4a-4c72-87ba-641296b13c87","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"77295146-f402-417e-a416-fe89b36b75db"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"77295146-f402-417e-a416-fe89b36b75db"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"77295146-f402-417e-a416-fe89b36b75db","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"77295146-f402-417e-a416-fe89b36b75db","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"77295146-f402-417e-a416-fe89b36b75db","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"77295146-f402-417e-a416-fe89b36b75db","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"77295146-f402-417e-a416-fe89b36b75db","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"77295146-f402-417e-a416-fe89b36b75db","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"77295146-f402-417e-a416-fe89b36b75db","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"51e6f4d7-3726-4c7d-81ae-bbb832a3da7e"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"22c95216-ccca-419f-b57f-b5a032c294c4"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"22c95216-ccca-419f-b57f-b5a032c294c4"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"22c95216-ccca-419f-b57f-b5a032c294c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"22c95216-ccca-419f-b57f-b5a032c294c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"22c95216-ccca-419f-b57f-b5a032c294c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"51e6f4d7-3726-4c7d-81ae-bbb832a3da7e"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"51e6f4d7-3726-4c7d-81ae-bbb832a3da7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"51e6f4d7-3726-4c7d-81ae-bbb832a3da7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"51e6f4d7-3726-4c7d-81ae-bbb832a3da7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"51e6f4d7-3726-4c7d-81ae-bbb832a3da7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"51e6f4d7-3726-4c7d-81ae-bbb832a3da7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"22c95216-ccca-419f-b57f-b5a032c294c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"51e6f4d7-3726-4c7d-81ae-bbb832a3da7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"22c95216-ccca-419f-b57f-b5a032c294c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"22c95216-ccca-419f-b57f-b5a032c294c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"22c95216-ccca-419f-b57f-b5a032c294c4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"51e6f4d7-3726-4c7d-81ae-bbb832a3da7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a33a8055-e5eb-4805-8430-27e608a08536"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a33a8055-e5eb-4805-8430-27e608a08536"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a33a8055-e5eb-4805-8430-27e608a08536","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a33a8055-e5eb-4805-8430-27e608a08536","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a33a8055-e5eb-4805-8430-27e608a08536","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3b125129-7e31-4188-9168-dcafef0497e4"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3b125129-7e31-4188-9168-dcafef0497e4"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3b125129-7e31-4188-9168-dcafef0497e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3b125129-7e31-4188-9168-dcafef0497e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3b125129-7e31-4188-9168-dcafef0497e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3b125129-7e31-4188-9168-dcafef0497e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3b125129-7e31-4188-9168-dcafef0497e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3b125129-7e31-4188-9168-dcafef0497e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3b125129-7e31-4188-9168-dcafef0497e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3b125129-7e31-4188-9168-dcafef0497e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3b125129-7e31-4188-9168-dcafef0497e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a33a8055-e5eb-4805-8430-27e608a08536","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a33a8055-e5eb-4805-8430-27e608a08536","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3b125129-7e31-4188-9168-dcafef0497e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3b125129-7e31-4188-9168-dcafef0497e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3b125129-7e31-4188-9168-dcafef0497e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3b125129-7e31-4188-9168-dcafef0497e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3b125129-7e31-4188-9168-dcafef0497e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3b125129-7e31-4188-9168-dcafef0497e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3b125129-7e31-4188-9168-dcafef0497e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a33a8055-e5eb-4805-8430-27e608a08536","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:00Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"4a5c3efb-8e3a-4a8e-9993-3e3d49339fb3","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"4a5c3efb-8e3a-4a8e-9993-3e3d49339fb3","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:45:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a33a8055-e5eb-4805-8430-27e608a08536","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"5fb9a0bb-87d8-4422-87c5-ea222024070d"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"5fb9a0bb-87d8-4422-87c5-ea222024070d"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"5fb9a0bb-87d8-4422-87c5-ea222024070d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"5fb9a0bb-87d8-4422-87c5-ea222024070d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"5fb9a0bb-87d8-4422-87c5-ea222024070d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"5fb9a0bb-87d8-4422-87c5-ea222024070d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"5fb9a0bb-87d8-4422-87c5-ea222024070d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"5fb9a0bb-87d8-4422-87c5-ea222024070d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"5fb9a0bb-87d8-4422-87c5-ea222024070d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"564098f8-32ba-437f-a849-bfa9300151e7"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"564098f8-32ba-437f-a849-bfa9300151e7"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"564098f8-32ba-437f-a849-bfa9300151e7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"564098f8-32ba-437f-a849-bfa9300151e7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"564098f8-32ba-437f-a849-bfa9300151e7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"564098f8-32ba-437f-a849-bfa9300151e7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"564098f8-32ba-437f-a849-bfa9300151e7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"4343c279-56f3-48c4-97ed-999b3ca3b17e"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"4343c279-56f3-48c4-97ed-999b3ca3b17e"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"4343c279-56f3-48c4-97ed-999b3ca3b17e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"4343c279-56f3-48c4-97ed-999b3ca3b17e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"4343c279-56f3-48c4-97ed-999b3ca3b17e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"564098f8-32ba-437f-a849-bfa9300151e7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"4343c279-56f3-48c4-97ed-999b3ca3b17e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"4343c279-56f3-48c4-97ed-999b3ca3b17e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"4343c279-56f3-48c4-97ed-999b3ca3b17e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"4343c279-56f3-48c4-97ed-999b3ca3b17e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"564098f8-32ba-437f-a849-bfa9300151e7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8ad58275-1aa4-4e5b-bb03-6720c8d8c3b2"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8ad58275-1aa4-4e5b-bb03-6720c8d8c3b2"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8ad58275-1aa4-4e5b-bb03-6720c8d8c3b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8ad58275-1aa4-4e5b-bb03-6720c8d8c3b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8ad58275-1aa4-4e5b-bb03-6720c8d8c3b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8ad58275-1aa4-4e5b-bb03-6720c8d8c3b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8ad58275-1aa4-4e5b-bb03-6720c8d8c3b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8ad58275-1aa4-4e5b-bb03-6720c8d8c3b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8ad58275-1aa4-4e5b-bb03-6720c8d8c3b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5e8255c8-37b3-4753-9c83-d5e91fe27c4e"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5e8255c8-37b3-4753-9c83-d5e91fe27c4e"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5e8255c8-37b3-4753-9c83-d5e91fe27c4e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5e8255c8-37b3-4753-9c83-d5e91fe27c4e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5e8255c8-37b3-4753-9c83-d5e91fe27c4e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5e8255c8-37b3-4753-9c83-d5e91fe27c4e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5e8255c8-37b3-4753-9c83-d5e91fe27c4e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5e8255c8-37b3-4753-9c83-d5e91fe27c4e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5e8255c8-37b3-4753-9c83-d5e91fe27c4e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5e8255c8-37b3-4753-9c83-d5e91fe27c4e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5e8255c8-37b3-4753-9c83-d5e91fe27c4e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5e8255c8-37b3-4753-9c83-d5e91fe27c4e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5e8255c8-37b3-4753-9c83-d5e91fe27c4e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5e8255c8-37b3-4753-9c83-d5e91fe27c4e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5e8255c8-37b3-4753-9c83-d5e91fe27c4e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5e8255c8-37b3-4753-9c83-d5e91fe27c4e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5e8255c8-37b3-4753-9c83-d5e91fe27c4e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5e8255c8-37b3-4753-9c83-d5e91fe27c4e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:03Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"f6031f57-52c0-4659-9e4c-87245a26295f","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:45:03Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"f6031f57-52c0-4659-9e4c-87245a26295f","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"170d2877-dbb4-48a4-b8b4-ed15c38c24bb"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"170d2877-dbb4-48a4-b8b4-ed15c38c24bb"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"170d2877-dbb4-48a4-b8b4-ed15c38c24bb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"170d2877-dbb4-48a4-b8b4-ed15c38c24bb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"170d2877-dbb4-48a4-b8b4-ed15c38c24bb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"170d2877-dbb4-48a4-b8b4-ed15c38c24bb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"170d2877-dbb4-48a4-b8b4-ed15c38c24bb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"170d2877-dbb4-48a4-b8b4-ed15c38c24bb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"170d2877-dbb4-48a4-b8b4-ed15c38c24bb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"0276e93e-ea70-4a76-90c8-1b9f9bb3eb94"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"0276e93e-ea70-4a76-90c8-1b9f9bb3eb94"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"0276e93e-ea70-4a76-90c8-1b9f9bb3eb94","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"0276e93e-ea70-4a76-90c8-1b9f9bb3eb94","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"0276e93e-ea70-4a76-90c8-1b9f9bb3eb94","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e0fcbec7-ba54-485d-ad14-33c57fee99f8"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e0fcbec7-ba54-485d-ad14-33c57fee99f8"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e0fcbec7-ba54-485d-ad14-33c57fee99f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e0fcbec7-ba54-485d-ad14-33c57fee99f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e0fcbec7-ba54-485d-ad14-33c57fee99f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e0fcbec7-ba54-485d-ad14-33c57fee99f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e0fcbec7-ba54-485d-ad14-33c57fee99f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"0276e93e-ea70-4a76-90c8-1b9f9bb3eb94","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e0fcbec7-ba54-485d-ad14-33c57fee99f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"0276e93e-ea70-4a76-90c8-1b9f9bb3eb94","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"0276e93e-ea70-4a76-90c8-1b9f9bb3eb94","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"0276e93e-ea70-4a76-90c8-1b9f9bb3eb94","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:04Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e0fcbec7-ba54-485d-ad14-33c57fee99f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"cd0752fe-560f-4b44-956d-a7e842c81606"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"cd0752fe-560f-4b44-956d-a7e842c81606"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"cd0752fe-560f-4b44-956d-a7e842c81606","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"cd0752fe-560f-4b44-956d-a7e842c81606","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"cd0752fe-560f-4b44-956d-a7e842c81606","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"cd0752fe-560f-4b44-956d-a7e842c81606","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"cd0752fe-560f-4b44-956d-a7e842c81606","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"cd0752fe-560f-4b44-956d-a7e842c81606","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"cd0752fe-560f-4b44-956d-a7e842c81606","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6cd47ffd-c3e3-4c7f-a75c-a56d9d6ce726"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6cd47ffd-c3e3-4c7f-a75c-a56d9d6ce726"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6cd47ffd-c3e3-4c7f-a75c-a56d9d6ce726","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6cd47ffd-c3e3-4c7f-a75c-a56d9d6ce726","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6cd47ffd-c3e3-4c7f-a75c-a56d9d6ce726","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6cd47ffd-c3e3-4c7f-a75c-a56d9d6ce726","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6cd47ffd-c3e3-4c7f-a75c-a56d9d6ce726","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6cd47ffd-c3e3-4c7f-a75c-a56d9d6ce726","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"572c6108-3da5-40d3-b9ca-3f9bd6b17bf9"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"572c6108-3da5-40d3-b9ca-3f9bd6b17bf9"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"572c6108-3da5-40d3-b9ca-3f9bd6b17bf9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"572c6108-3da5-40d3-b9ca-3f9bd6b17bf9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"572c6108-3da5-40d3-b9ca-3f9bd6b17bf9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"572c6108-3da5-40d3-b9ca-3f9bd6b17bf9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"572c6108-3da5-40d3-b9ca-3f9bd6b17bf9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"572c6108-3da5-40d3-b9ca-3f9bd6b17bf9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"572c6108-3da5-40d3-b9ca-3f9bd6b17bf9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6cd47ffd-c3e3-4c7f-a75c-a56d9d6ce726","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"42ee5b54-bc7b-4f2a-8864-004637644363"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"42ee5b54-bc7b-4f2a-8864-004637644363"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"42ee5b54-bc7b-4f2a-8864-004637644363","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"42ee5b54-bc7b-4f2a-8864-004637644363","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"42ee5b54-bc7b-4f2a-8864-004637644363","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"42ee5b54-bc7b-4f2a-8864-004637644363","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"42ee5b54-bc7b-4f2a-8864-004637644363","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"42ee5b54-bc7b-4f2a-8864-004637644363","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"42ee5b54-bc7b-4f2a-8864-004637644363","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:35Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"f4b764d2-91f0-4ae9-af31-63a280be773b"} {"level":"info","ts":"2026-07-15T04:45:35Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"f4b764d2-91f0-4ae9-af31-63a280be773b"} {"level":"info","ts":"2026-07-15T04:45:35Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"f4b764d2-91f0-4ae9-af31-63a280be773b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:45:35Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"f4b764d2-91f0-4ae9-af31-63a280be773b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:35Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"f4b764d2-91f0-4ae9-af31-63a280be773b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:35Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"f4b764d2-91f0-4ae9-af31-63a280be773b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:35Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"f4b764d2-91f0-4ae9-af31-63a280be773b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:35Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"f4b764d2-91f0-4ae9-af31-63a280be773b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:35Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"f4b764d2-91f0-4ae9-af31-63a280be773b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:35Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"518f0c4f-f222-454e-a2c2-451a81d5472e"} {"level":"info","ts":"2026-07-15T04:45:35Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"518f0c4f-f222-454e-a2c2-451a81d5472e"} {"level":"info","ts":"2026-07-15T04:45:35Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"518f0c4f-f222-454e-a2c2-451a81d5472e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:45:35Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"518f0c4f-f222-454e-a2c2-451a81d5472e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:45:35Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"518f0c4f-f222-454e-a2c2-451a81d5472e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:45:35Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"518f0c4f-f222-454e-a2c2-451a81d5472e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:45:35Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"518f0c4f-f222-454e-a2c2-451a81d5472e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:35Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"518f0c4f-f222-454e-a2c2-451a81d5472e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:35Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"518f0c4f-f222-454e-a2c2-451a81d5472e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"578514c8-cb7c-4922-96a1-e45d24c6055c"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"578514c8-cb7c-4922-96a1-e45d24c6055c"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"578514c8-cb7c-4922-96a1-e45d24c6055c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"578514c8-cb7c-4922-96a1-e45d24c6055c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"578514c8-cb7c-4922-96a1-e45d24c6055c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"578514c8-cb7c-4922-96a1-e45d24c6055c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"578514c8-cb7c-4922-96a1-e45d24c6055c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"578514c8-cb7c-4922-96a1-e45d24c6055c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"578514c8-cb7c-4922-96a1-e45d24c6055c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2a6dd440-cfe8-49a0-b3fd-5a7c0f207220"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2a6dd440-cfe8-49a0-b3fd-5a7c0f207220"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2a6dd440-cfe8-49a0-b3fd-5a7c0f207220","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2a6dd440-cfe8-49a0-b3fd-5a7c0f207220","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2a6dd440-cfe8-49a0-b3fd-5a7c0f207220","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2a6dd440-cfe8-49a0-b3fd-5a7c0f207220","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2a6dd440-cfe8-49a0-b3fd-5a7c0f207220","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2a6dd440-cfe8-49a0-b3fd-5a7c0f207220","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2a6dd440-cfe8-49a0-b3fd-5a7c0f207220","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01852798-d7e5-4fbd-a097-c8dffd2811fa"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01852798-d7e5-4fbd-a097-c8dffd2811fa"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01852798-d7e5-4fbd-a097-c8dffd2811fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01852798-d7e5-4fbd-a097-c8dffd2811fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01852798-d7e5-4fbd-a097-c8dffd2811fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01852798-d7e5-4fbd-a097-c8dffd2811fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01852798-d7e5-4fbd-a097-c8dffd2811fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01852798-d7e5-4fbd-a097-c8dffd2811fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01852798-d7e5-4fbd-a097-c8dffd2811fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01852798-d7e5-4fbd-a097-c8dffd2811fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01852798-d7e5-4fbd-a097-c8dffd2811fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01852798-d7e5-4fbd-a097-c8dffd2811fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01852798-d7e5-4fbd-a097-c8dffd2811fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01852798-d7e5-4fbd-a097-c8dffd2811fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01852798-d7e5-4fbd-a097-c8dffd2811fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01852798-d7e5-4fbd-a097-c8dffd2811fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01852798-d7e5-4fbd-a097-c8dffd2811fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01852798-d7e5-4fbd-a097-c8dffd2811fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:46Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"ae64d3dc-de1c-4a7d-ac63-78df24cbacd4","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:45:46Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"ae64d3dc-de1c-4a7d-ac63-78df24cbacd4","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"173b847f-a709-43c8-9a01-9ae5cbe3150e"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"173b847f-a709-43c8-9a01-9ae5cbe3150e"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"173b847f-a709-43c8-9a01-9ae5cbe3150e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"173b847f-a709-43c8-9a01-9ae5cbe3150e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"173b847f-a709-43c8-9a01-9ae5cbe3150e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"173b847f-a709-43c8-9a01-9ae5cbe3150e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"173b847f-a709-43c8-9a01-9ae5cbe3150e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"173b847f-a709-43c8-9a01-9ae5cbe3150e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"173b847f-a709-43c8-9a01-9ae5cbe3150e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"173b847f-a709-43c8-9a01-9ae5cbe3150e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"173b847f-a709-43c8-9a01-9ae5cbe3150e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"173b847f-a709-43c8-9a01-9ae5cbe3150e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"173b847f-a709-43c8-9a01-9ae5cbe3150e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"173b847f-a709-43c8-9a01-9ae5cbe3150e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"173b847f-a709-43c8-9a01-9ae5cbe3150e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"173b847f-a709-43c8-9a01-9ae5cbe3150e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"173b847f-a709-43c8-9a01-9ae5cbe3150e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"173b847f-a709-43c8-9a01-9ae5cbe3150e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:45:56Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"d9b89b98-1748-49cf-bfd2-b88428b7db59","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"d9b89b98-1748-49cf-bfd2-b88428b7db59","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5c305d39-32f2-47c4-90ff-6667a1a22317"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5c305d39-32f2-47c4-90ff-6667a1a22317"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5c305d39-32f2-47c4-90ff-6667a1a22317","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5c305d39-32f2-47c4-90ff-6667a1a22317","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5c305d39-32f2-47c4-90ff-6667a1a22317","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5c305d39-32f2-47c4-90ff-6667a1a22317","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5c305d39-32f2-47c4-90ff-6667a1a22317","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5c305d39-32f2-47c4-90ff-6667a1a22317","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5c305d39-32f2-47c4-90ff-6667a1a22317","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5c305d39-32f2-47c4-90ff-6667a1a22317","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5c305d39-32f2-47c4-90ff-6667a1a22317","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5c305d39-32f2-47c4-90ff-6667a1a22317","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5c305d39-32f2-47c4-90ff-6667a1a22317","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5c305d39-32f2-47c4-90ff-6667a1a22317","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5c305d39-32f2-47c4-90ff-6667a1a22317","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5c305d39-32f2-47c4-90ff-6667a1a22317","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5c305d39-32f2-47c4-90ff-6667a1a22317","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:45:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5c305d39-32f2-47c4-90ff-6667a1a22317","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:46:22Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"de55f8f0-e447-403c-ac87-a71330002bdb"} {"level":"info","ts":"2026-07-15T04:46:22Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"de55f8f0-e447-403c-ac87-a71330002bdb"} {"level":"info","ts":"2026-07-15T04:46:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"de55f8f0-e447-403c-ac87-a71330002bdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:46:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"de55f8f0-e447-403c-ac87-a71330002bdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:46:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"de55f8f0-e447-403c-ac87-a71330002bdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:46:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"de55f8f0-e447-403c-ac87-a71330002bdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:46:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"de55f8f0-e447-403c-ac87-a71330002bdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:46:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"de55f8f0-e447-403c-ac87-a71330002bdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:46:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"de55f8f0-e447-403c-ac87-a71330002bdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:46:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"de55f8f0-e447-403c-ac87-a71330002bdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:46:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"de55f8f0-e447-403c-ac87-a71330002bdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:46:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"de55f8f0-e447-403c-ac87-a71330002bdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:46:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"de55f8f0-e447-403c-ac87-a71330002bdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:46:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"de55f8f0-e447-403c-ac87-a71330002bdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:46:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"de55f8f0-e447-403c-ac87-a71330002bdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:46:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"de55f8f0-e447-403c-ac87-a71330002bdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:46:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"de55f8f0-e447-403c-ac87-a71330002bdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:46:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"de55f8f0-e447-403c-ac87-a71330002bdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:46:22Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"f44bfef1-b70a-4290-999c-19a80680aac5","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:46:22Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"f44bfef1-b70a-4290-999c-19a80680aac5","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:46:52Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0564f798-3728-4ece-ba5a-39a1cd17eea0"} {"level":"info","ts":"2026-07-15T04:46:52Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0564f798-3728-4ece-ba5a-39a1cd17eea0"} {"level":"info","ts":"2026-07-15T04:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0564f798-3728-4ece-ba5a-39a1cd17eea0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0564f798-3728-4ece-ba5a-39a1cd17eea0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0564f798-3728-4ece-ba5a-39a1cd17eea0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0564f798-3728-4ece-ba5a-39a1cd17eea0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0564f798-3728-4ece-ba5a-39a1cd17eea0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0564f798-3728-4ece-ba5a-39a1cd17eea0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0564f798-3728-4ece-ba5a-39a1cd17eea0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0564f798-3728-4ece-ba5a-39a1cd17eea0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0564f798-3728-4ece-ba5a-39a1cd17eea0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0564f798-3728-4ece-ba5a-39a1cd17eea0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0564f798-3728-4ece-ba5a-39a1cd17eea0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0564f798-3728-4ece-ba5a-39a1cd17eea0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0564f798-3728-4ece-ba5a-39a1cd17eea0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0564f798-3728-4ece-ba5a-39a1cd17eea0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0564f798-3728-4ece-ba5a-39a1cd17eea0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0564f798-3728-4ece-ba5a-39a1cd17eea0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:46:52Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"0f9db813-bdc7-4b2f-9ef7-9bc3d2887cd2","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:46:52Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"0f9db813-bdc7-4b2f-9ef7-9bc3d2887cd2","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7bd3803c-db13-411b-b317-ae37516deb7e"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7bd3803c-db13-411b-b317-ae37516deb7e"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7bd3803c-db13-411b-b317-ae37516deb7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7bd3803c-db13-411b-b317-ae37516deb7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7bd3803c-db13-411b-b317-ae37516deb7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7bd3803c-db13-411b-b317-ae37516deb7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7bd3803c-db13-411b-b317-ae37516deb7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7bd3803c-db13-411b-b317-ae37516deb7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7bd3803c-db13-411b-b317-ae37516deb7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7bd3803c-db13-411b-b317-ae37516deb7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7bd3803c-db13-411b-b317-ae37516deb7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7bd3803c-db13-411b-b317-ae37516deb7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7bd3803c-db13-411b-b317-ae37516deb7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7bd3803c-db13-411b-b317-ae37516deb7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7bd3803c-db13-411b-b317-ae37516deb7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7bd3803c-db13-411b-b317-ae37516deb7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7bd3803c-db13-411b-b317-ae37516deb7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"7bd3803c-db13-411b-b317-ae37516deb7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d076c2ac-e052-4cb1-b1ab-1060210f76cc"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d076c2ac-e052-4cb1-b1ab-1060210f76cc"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d076c2ac-e052-4cb1-b1ab-1060210f76cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d076c2ac-e052-4cb1-b1ab-1060210f76cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d076c2ac-e052-4cb1-b1ab-1060210f76cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d076c2ac-e052-4cb1-b1ab-1060210f76cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d076c2ac-e052-4cb1-b1ab-1060210f76cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d076c2ac-e052-4cb1-b1ab-1060210f76cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d076c2ac-e052-4cb1-b1ab-1060210f76cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d076c2ac-e052-4cb1-b1ab-1060210f76cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d076c2ac-e052-4cb1-b1ab-1060210f76cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:47:03Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"379cff0b-b991-406e-87b0-28995be6bb47","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"379cff0b-b991-406e-87b0-28995be6bb47","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d076c2ac-e052-4cb1-b1ab-1060210f76cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d076c2ac-e052-4cb1-b1ab-1060210f76cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d076c2ac-e052-4cb1-b1ab-1060210f76cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d076c2ac-e052-4cb1-b1ab-1060210f76cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d076c2ac-e052-4cb1-b1ab-1060210f76cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d076c2ac-e052-4cb1-b1ab-1060210f76cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:47:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d076c2ac-e052-4cb1-b1ab-1060210f76cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b01fc97f-69b3-4340-9fde-82a63ae44ece"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b01fc97f-69b3-4340-9fde-82a63ae44ece"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b01fc97f-69b3-4340-9fde-82a63ae44ece","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b01fc97f-69b3-4340-9fde-82a63ae44ece","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b01fc97f-69b3-4340-9fde-82a63ae44ece","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b01fc97f-69b3-4340-9fde-82a63ae44ece","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b01fc97f-69b3-4340-9fde-82a63ae44ece","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b01fc97f-69b3-4340-9fde-82a63ae44ece","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b01fc97f-69b3-4340-9fde-82a63ae44ece","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b01fc97f-69b3-4340-9fde-82a63ae44ece","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b01fc97f-69b3-4340-9fde-82a63ae44ece","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b01fc97f-69b3-4340-9fde-82a63ae44ece","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b01fc97f-69b3-4340-9fde-82a63ae44ece","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b01fc97f-69b3-4340-9fde-82a63ae44ece","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b01fc97f-69b3-4340-9fde-82a63ae44ece","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b01fc97f-69b3-4340-9fde-82a63ae44ece","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b01fc97f-69b3-4340-9fde-82a63ae44ece","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b01fc97f-69b3-4340-9fde-82a63ae44ece","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:47:47Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"2477f893-26ce-4700-85be-1ed82d217637","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"2477f893-26ce-4700-85be-1ed82d217637","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a76bd76-88e9-4cc4-b5f9-f4f0f97138d5"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a76bd76-88e9-4cc4-b5f9-f4f0f97138d5"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a76bd76-88e9-4cc4-b5f9-f4f0f97138d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a76bd76-88e9-4cc4-b5f9-f4f0f97138d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a76bd76-88e9-4cc4-b5f9-f4f0f97138d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a76bd76-88e9-4cc4-b5f9-f4f0f97138d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a76bd76-88e9-4cc4-b5f9-f4f0f97138d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a76bd76-88e9-4cc4-b5f9-f4f0f97138d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a76bd76-88e9-4cc4-b5f9-f4f0f97138d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a76bd76-88e9-4cc4-b5f9-f4f0f97138d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a76bd76-88e9-4cc4-b5f9-f4f0f97138d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a76bd76-88e9-4cc4-b5f9-f4f0f97138d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a76bd76-88e9-4cc4-b5f9-f4f0f97138d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a76bd76-88e9-4cc4-b5f9-f4f0f97138d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a76bd76-88e9-4cc4-b5f9-f4f0f97138d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a76bd76-88e9-4cc4-b5f9-f4f0f97138d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a76bd76-88e9-4cc4-b5f9-f4f0f97138d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1a76bd76-88e9-4cc4-b5f9-f4f0f97138d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:47:56Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d6fa21d2-78ec-4c79-aeea-2c7e50a0f08f"} {"level":"info","ts":"2026-07-15T04:47:56Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d6fa21d2-78ec-4c79-aeea-2c7e50a0f08f"} {"level":"info","ts":"2026-07-15T04:47:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d6fa21d2-78ec-4c79-aeea-2c7e50a0f08f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:47:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d6fa21d2-78ec-4c79-aeea-2c7e50a0f08f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:47:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d6fa21d2-78ec-4c79-aeea-2c7e50a0f08f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:47:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d6fa21d2-78ec-4c79-aeea-2c7e50a0f08f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:47:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d6fa21d2-78ec-4c79-aeea-2c7e50a0f08f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:47:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d6fa21d2-78ec-4c79-aeea-2c7e50a0f08f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:47:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d6fa21d2-78ec-4c79-aeea-2c7e50a0f08f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:47:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d6fa21d2-78ec-4c79-aeea-2c7e50a0f08f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:47:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d6fa21d2-78ec-4c79-aeea-2c7e50a0f08f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:47:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d6fa21d2-78ec-4c79-aeea-2c7e50a0f08f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:47:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d6fa21d2-78ec-4c79-aeea-2c7e50a0f08f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:47:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d6fa21d2-78ec-4c79-aeea-2c7e50a0f08f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:47:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d6fa21d2-78ec-4c79-aeea-2c7e50a0f08f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:47:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d6fa21d2-78ec-4c79-aeea-2c7e50a0f08f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:47:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d6fa21d2-78ec-4c79-aeea-2c7e50a0f08f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:47:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d6fa21d2-78ec-4c79-aeea-2c7e50a0f08f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:47:56Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8414f6a2-c6b1-4972-8df8-3158c5e511ff","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:47:56Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8414f6a2-c6b1-4972-8df8-3158c5e511ff","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:48:11Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1b1bb448-d08b-413b-961b-93e17048aa57"} {"level":"info","ts":"2026-07-15T04:48:11Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1b1bb448-d08b-413b-961b-93e17048aa57"} {"level":"info","ts":"2026-07-15T04:48:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1b1bb448-d08b-413b-961b-93e17048aa57","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1b1bb448-d08b-413b-961b-93e17048aa57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:48:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1b1bb448-d08b-413b-961b-93e17048aa57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:48:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1b1bb448-d08b-413b-961b-93e17048aa57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:48:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1b1bb448-d08b-413b-961b-93e17048aa57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:48:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1b1bb448-d08b-413b-961b-93e17048aa57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:48:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1b1bb448-d08b-413b-961b-93e17048aa57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:48:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1b1bb448-d08b-413b-961b-93e17048aa57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:48:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1b1bb448-d08b-413b-961b-93e17048aa57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:48:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1b1bb448-d08b-413b-961b-93e17048aa57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:48:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1b1bb448-d08b-413b-961b-93e17048aa57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:48:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1b1bb448-d08b-413b-961b-93e17048aa57","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1b1bb448-d08b-413b-961b-93e17048aa57","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1b1bb448-d08b-413b-961b-93e17048aa57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:48:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1b1bb448-d08b-413b-961b-93e17048aa57","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:11Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1b1bb448-d08b-413b-961b-93e17048aa57","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:12Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"2a0b1284-eb25-4d1d-9564-46c6f00be3b5","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:48:12Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"2a0b1284-eb25-4d1d-9564-46c6f00be3b5","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e9db5c1d-2c60-4a90-97d5-1a22ec8e7463"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e9db5c1d-2c60-4a90-97d5-1a22ec8e7463"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e9db5c1d-2c60-4a90-97d5-1a22ec8e7463","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e9db5c1d-2c60-4a90-97d5-1a22ec8e7463","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e9db5c1d-2c60-4a90-97d5-1a22ec8e7463","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e9db5c1d-2c60-4a90-97d5-1a22ec8e7463","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e9db5c1d-2c60-4a90-97d5-1a22ec8e7463","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e9db5c1d-2c60-4a90-97d5-1a22ec8e7463","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e9db5c1d-2c60-4a90-97d5-1a22ec8e7463","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e9db5c1d-2c60-4a90-97d5-1a22ec8e7463","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e9db5c1d-2c60-4a90-97d5-1a22ec8e7463","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e9db5c1d-2c60-4a90-97d5-1a22ec8e7463","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e9db5c1d-2c60-4a90-97d5-1a22ec8e7463","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e9db5c1d-2c60-4a90-97d5-1a22ec8e7463","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e9db5c1d-2c60-4a90-97d5-1a22ec8e7463","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e9db5c1d-2c60-4a90-97d5-1a22ec8e7463","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e9db5c1d-2c60-4a90-97d5-1a22ec8e7463","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e9db5c1d-2c60-4a90-97d5-1a22ec8e7463","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"164e5138-16cb-49bb-8421-59365495e9a3"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"164e5138-16cb-49bb-8421-59365495e9a3"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"164e5138-16cb-49bb-8421-59365495e9a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"164e5138-16cb-49bb-8421-59365495e9a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"164e5138-16cb-49bb-8421-59365495e9a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"164e5138-16cb-49bb-8421-59365495e9a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"164e5138-16cb-49bb-8421-59365495e9a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"164e5138-16cb-49bb-8421-59365495e9a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"164e5138-16cb-49bb-8421-59365495e9a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"164e5138-16cb-49bb-8421-59365495e9a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"164e5138-16cb-49bb-8421-59365495e9a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:48:23Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"970b3abe-ac42-4a8c-9fec-004129f4164a","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"970b3abe-ac42-4a8c-9fec-004129f4164a","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"164e5138-16cb-49bb-8421-59365495e9a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"164e5138-16cb-49bb-8421-59365495e9a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"164e5138-16cb-49bb-8421-59365495e9a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"164e5138-16cb-49bb-8421-59365495e9a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"164e5138-16cb-49bb-8421-59365495e9a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"164e5138-16cb-49bb-8421-59365495e9a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"164e5138-16cb-49bb-8421-59365495e9a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2a212ce6-5159-4aa2-a554-2bcf09090aec"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"3c202086-9b81-452d-9bdb-fb48983bc999"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2a212ce6-5159-4aa2-a554-2bcf09090aec"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2a212ce6-5159-4aa2-a554-2bcf09090aec","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"3c202086-9b81-452d-9bdb-fb48983bc999"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"3c202086-9b81-452d-9bdb-fb48983bc999","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"3c202086-9b81-452d-9bdb-fb48983bc999","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"3c202086-9b81-452d-9bdb-fb48983bc999","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2a212ce6-5159-4aa2-a554-2bcf09090aec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2a212ce6-5159-4aa2-a554-2bcf09090aec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2a212ce6-5159-4aa2-a554-2bcf09090aec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2a212ce6-5159-4aa2-a554-2bcf09090aec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2a212ce6-5159-4aa2-a554-2bcf09090aec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2a212ce6-5159-4aa2-a554-2bcf09090aec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2a212ce6-5159-4aa2-a554-2bcf09090aec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2a212ce6-5159-4aa2-a554-2bcf09090aec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"3c202086-9b81-452d-9bdb-fb48983bc999","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2a212ce6-5159-4aa2-a554-2bcf09090aec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2a212ce6-5159-4aa2-a554-2bcf09090aec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2a212ce6-5159-4aa2-a554-2bcf09090aec","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2a212ce6-5159-4aa2-a554-2bcf09090aec","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2a212ce6-5159-4aa2-a554-2bcf09090aec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2a212ce6-5159-4aa2-a554-2bcf09090aec","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2a212ce6-5159-4aa2-a554-2bcf09090aec","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"74c902c3-5f5b-47c3-8fb9-0c0c343fdb59","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"74c902c3-5f5b-47c3-8fb9-0c0c343fdb59","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"99ffc2e2-f2e2-4d61-aa82-4157a911cdad"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"99ffc2e2-f2e2-4d61-aa82-4157a911cdad"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"99ffc2e2-f2e2-4d61-aa82-4157a911cdad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"99ffc2e2-f2e2-4d61-aa82-4157a911cdad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"3c202086-9b81-452d-9bdb-fb48983bc999","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"99ffc2e2-f2e2-4d61-aa82-4157a911cdad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"99ffc2e2-f2e2-4d61-aa82-4157a911cdad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"99ffc2e2-f2e2-4d61-aa82-4157a911cdad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"99ffc2e2-f2e2-4d61-aa82-4157a911cdad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"99ffc2e2-f2e2-4d61-aa82-4157a911cdad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"99ffc2e2-f2e2-4d61-aa82-4157a911cdad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"99ffc2e2-f2e2-4d61-aa82-4157a911cdad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"3c202086-9b81-452d-9bdb-fb48983bc999","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"3c202086-9b81-452d-9bdb-fb48983bc999","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"99ffc2e2-f2e2-4d61-aa82-4157a911cdad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"99ffc2e2-f2e2-4d61-aa82-4157a911cdad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"99ffc2e2-f2e2-4d61-aa82-4157a911cdad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"99ffc2e2-f2e2-4d61-aa82-4157a911cdad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"99ffc2e2-f2e2-4d61-aa82-4157a911cdad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"99ffc2e2-f2e2-4d61-aa82-4157a911cdad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"99ffc2e2-f2e2-4d61-aa82-4157a911cdad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"9731f027-a0c8-46ca-892d-c94c12760620"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"9731f027-a0c8-46ca-892d-c94c12760620"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"9731f027-a0c8-46ca-892d-c94c12760620","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"9731f027-a0c8-46ca-892d-c94c12760620","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"9731f027-a0c8-46ca-892d-c94c12760620","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"9731f027-a0c8-46ca-892d-c94c12760620","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"eab15c74-5973-4d2f-8e89-32cef3d330c2"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"eab15c74-5973-4d2f-8e89-32cef3d330c2"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"eab15c74-5973-4d2f-8e89-32cef3d330c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"eab15c74-5973-4d2f-8e89-32cef3d330c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"eab15c74-5973-4d2f-8e89-32cef3d330c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"eab15c74-5973-4d2f-8e89-32cef3d330c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"eab15c74-5973-4d2f-8e89-32cef3d330c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"eab15c74-5973-4d2f-8e89-32cef3d330c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"9731f027-a0c8-46ca-892d-c94c12760620","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"9731f027-a0c8-46ca-892d-c94c12760620","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"9731f027-a0c8-46ca-892d-c94c12760620","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:33Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"eab15c74-5973-4d2f-8e89-32cef3d330c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b0d58a3c-d16e-402f-978d-660947f7a9b2"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b0d58a3c-d16e-402f-978d-660947f7a9b2"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b0d58a3c-d16e-402f-978d-660947f7a9b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b0d58a3c-d16e-402f-978d-660947f7a9b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b0d58a3c-d16e-402f-978d-660947f7a9b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b0d58a3c-d16e-402f-978d-660947f7a9b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b0d58a3c-d16e-402f-978d-660947f7a9b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b0d58a3c-d16e-402f-978d-660947f7a9b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b0d58a3c-d16e-402f-978d-660947f7a9b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"2eaeec80-43f1-4758-a147-89d0b37ac541"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"2eaeec80-43f1-4758-a147-89d0b37ac541"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"2eaeec80-43f1-4758-a147-89d0b37ac541","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"2eaeec80-43f1-4758-a147-89d0b37ac541","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"2eaeec80-43f1-4758-a147-89d0b37ac541","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3bf10a2a-fda5-4554-b436-ba0f835bca47"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3bf10a2a-fda5-4554-b436-ba0f835bca47"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3bf10a2a-fda5-4554-b436-ba0f835bca47","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3bf10a2a-fda5-4554-b436-ba0f835bca47","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3bf10a2a-fda5-4554-b436-ba0f835bca47","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3bf10a2a-fda5-4554-b436-ba0f835bca47","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3bf10a2a-fda5-4554-b436-ba0f835bca47","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"2eaeec80-43f1-4758-a147-89d0b37ac541","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3bf10a2a-fda5-4554-b436-ba0f835bca47","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"2eaeec80-43f1-4758-a147-89d0b37ac541","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"2eaeec80-43f1-4758-a147-89d0b37ac541","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"2eaeec80-43f1-4758-a147-89d0b37ac541","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3bf10a2a-fda5-4554-b436-ba0f835bca47","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8e94c959-e3f8-482a-8e00-a45a2db88ce9"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8e94c959-e3f8-482a-8e00-a45a2db88ce9"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8e94c959-e3f8-482a-8e00-a45a2db88ce9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8e94c959-e3f8-482a-8e00-a45a2db88ce9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8e94c959-e3f8-482a-8e00-a45a2db88ce9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8e94c959-e3f8-482a-8e00-a45a2db88ce9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8e94c959-e3f8-482a-8e00-a45a2db88ce9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8e94c959-e3f8-482a-8e00-a45a2db88ce9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8e94c959-e3f8-482a-8e00-a45a2db88ce9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"41c6d62a-9714-46a0-9c76-3243f2275bf7"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"41c6d62a-9714-46a0-9c76-3243f2275bf7"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"41c6d62a-9714-46a0-9c76-3243f2275bf7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"41c6d62a-9714-46a0-9c76-3243f2275bf7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"41c6d62a-9714-46a0-9c76-3243f2275bf7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2fcd1264-8cbf-4544-bd76-9f2912c9c44f"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2fcd1264-8cbf-4544-bd76-9f2912c9c44f"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2fcd1264-8cbf-4544-bd76-9f2912c9c44f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2fcd1264-8cbf-4544-bd76-9f2912c9c44f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2fcd1264-8cbf-4544-bd76-9f2912c9c44f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2fcd1264-8cbf-4544-bd76-9f2912c9c44f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2fcd1264-8cbf-4544-bd76-9f2912c9c44f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"41c6d62a-9714-46a0-9c76-3243f2275bf7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2fcd1264-8cbf-4544-bd76-9f2912c9c44f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"41c6d62a-9714-46a0-9c76-3243f2275bf7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"41c6d62a-9714-46a0-9c76-3243f2275bf7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"41c6d62a-9714-46a0-9c76-3243f2275bf7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8166ecab-047c-42ea-94e4-c6c98635a3b3"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8166ecab-047c-42ea-94e4-c6c98635a3b3"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8166ecab-047c-42ea-94e4-c6c98635a3b3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8166ecab-047c-42ea-94e4-c6c98635a3b3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8166ecab-047c-42ea-94e4-c6c98635a3b3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8166ecab-047c-42ea-94e4-c6c98635a3b3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8166ecab-047c-42ea-94e4-c6c98635a3b3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8166ecab-047c-42ea-94e4-c6c98635a3b3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:43Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"8166ecab-047c-42ea-94e4-c6c98635a3b3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:44Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2fcd1264-8cbf-4544-bd76-9f2912c9c44f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:44Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d063a5e-db9d-4582-8d57-59ce76f352f6"} {"level":"info","ts":"2026-07-15T04:48:44Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d063a5e-db9d-4582-8d57-59ce76f352f6"} {"level":"info","ts":"2026-07-15T04:48:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d063a5e-db9d-4582-8d57-59ce76f352f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d063a5e-db9d-4582-8d57-59ce76f352f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:48:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d063a5e-db9d-4582-8d57-59ce76f352f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:48:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d063a5e-db9d-4582-8d57-59ce76f352f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:48:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d063a5e-db9d-4582-8d57-59ce76f352f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:48:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d063a5e-db9d-4582-8d57-59ce76f352f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:48:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d063a5e-db9d-4582-8d57-59ce76f352f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:48:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d063a5e-db9d-4582-8d57-59ce76f352f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:48:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d063a5e-db9d-4582-8d57-59ce76f352f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:48:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d063a5e-db9d-4582-8d57-59ce76f352f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:48:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d063a5e-db9d-4582-8d57-59ce76f352f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:48:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d063a5e-db9d-4582-8d57-59ce76f352f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d063a5e-db9d-4582-8d57-59ce76f352f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d063a5e-db9d-4582-8d57-59ce76f352f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:48:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d063a5e-db9d-4582-8d57-59ce76f352f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d063a5e-db9d-4582-8d57-59ce76f352f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:44Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e1757a86-3e9b-41d5-a771-7a2b59545ed5","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:48:44Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e1757a86-3e9b-41d5-a771-7a2b59545ed5","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"1caffa05-626b-4afa-8873-d5068ae7b7b1"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"1caffa05-626b-4afa-8873-d5068ae7b7b1"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"1caffa05-626b-4afa-8873-d5068ae7b7b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"1caffa05-626b-4afa-8873-d5068ae7b7b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"1caffa05-626b-4afa-8873-d5068ae7b7b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"1caffa05-626b-4afa-8873-d5068ae7b7b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"1caffa05-626b-4afa-8873-d5068ae7b7b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"1caffa05-626b-4afa-8873-d5068ae7b7b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"1caffa05-626b-4afa-8873-d5068ae7b7b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4ccc6ad0-680e-4052-aa1b-ef7e63da7da1"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4ccc6ad0-680e-4052-aa1b-ef7e63da7da1"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4ccc6ad0-680e-4052-aa1b-ef7e63da7da1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4ccc6ad0-680e-4052-aa1b-ef7e63da7da1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4ccc6ad0-680e-4052-aa1b-ef7e63da7da1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4ccc6ad0-680e-4052-aa1b-ef7e63da7da1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4ccc6ad0-680e-4052-aa1b-ef7e63da7da1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4ccc6ad0-680e-4052-aa1b-ef7e63da7da1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4ccc6ad0-680e-4052-aa1b-ef7e63da7da1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9474608a-e487-42be-89e5-af4b128673b5"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9474608a-e487-42be-89e5-af4b128673b5"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9474608a-e487-42be-89e5-af4b128673b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9474608a-e487-42be-89e5-af4b128673b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9474608a-e487-42be-89e5-af4b128673b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9474608a-e487-42be-89e5-af4b128673b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9474608a-e487-42be-89e5-af4b128673b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9474608a-e487-42be-89e5-af4b128673b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9474608a-e487-42be-89e5-af4b128673b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9474608a-e487-42be-89e5-af4b128673b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9474608a-e487-42be-89e5-af4b128673b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9474608a-e487-42be-89e5-af4b128673b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9474608a-e487-42be-89e5-af4b128673b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9474608a-e487-42be-89e5-af4b128673b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9474608a-e487-42be-89e5-af4b128673b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9474608a-e487-42be-89e5-af4b128673b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9474608a-e487-42be-89e5-af4b128673b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9474608a-e487-42be-89e5-af4b128673b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:55Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"54e1f8bd-b99f-47e5-961f-abf451eced33","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:48:55Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"54e1f8bd-b99f-47e5-961f-abf451eced33","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"619f53ce-894d-4c49-be1b-85899111017a"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"619f53ce-894d-4c49-be1b-85899111017a"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"619f53ce-894d-4c49-be1b-85899111017a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"619f53ce-894d-4c49-be1b-85899111017a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"619f53ce-894d-4c49-be1b-85899111017a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"619f53ce-894d-4c49-be1b-85899111017a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"619f53ce-894d-4c49-be1b-85899111017a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"619f53ce-894d-4c49-be1b-85899111017a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"619f53ce-894d-4c49-be1b-85899111017a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"93714a93-4bfa-4139-9569-40d351b6ca5e"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"93714a93-4bfa-4139-9569-40d351b6ca5e"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"93714a93-4bfa-4139-9569-40d351b6ca5e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"93714a93-4bfa-4139-9569-40d351b6ca5e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"93714a93-4bfa-4139-9569-40d351b6ca5e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"621b0bce-fc75-4d68-b55b-1616eccdf040"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"621b0bce-fc75-4d68-b55b-1616eccdf040"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"621b0bce-fc75-4d68-b55b-1616eccdf040","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"621b0bce-fc75-4d68-b55b-1616eccdf040","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"621b0bce-fc75-4d68-b55b-1616eccdf040","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"621b0bce-fc75-4d68-b55b-1616eccdf040","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"621b0bce-fc75-4d68-b55b-1616eccdf040","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"93714a93-4bfa-4139-9569-40d351b6ca5e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"621b0bce-fc75-4d68-b55b-1616eccdf040","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"93714a93-4bfa-4139-9569-40d351b6ca5e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"93714a93-4bfa-4139-9569-40d351b6ca5e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"93714a93-4bfa-4139-9569-40d351b6ca5e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"6b71f9e5-30dd-453c-a2b6-c5dbb5b891e3"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"6b71f9e5-30dd-453c-a2b6-c5dbb5b891e3"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"6b71f9e5-30dd-453c-a2b6-c5dbb5b891e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"6b71f9e5-30dd-453c-a2b6-c5dbb5b891e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"6b71f9e5-30dd-453c-a2b6-c5dbb5b891e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"6b71f9e5-30dd-453c-a2b6-c5dbb5b891e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"6b71f9e5-30dd-453c-a2b6-c5dbb5b891e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"6b71f9e5-30dd-453c-a2b6-c5dbb5b891e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"6b71f9e5-30dd-453c-a2b6-c5dbb5b891e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"29fa2e6b-b0b8-4202-bf6c-46efdb5355c5"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"29fa2e6b-b0b8-4202-bf6c-46efdb5355c5"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"29fa2e6b-b0b8-4202-bf6c-46efdb5355c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"29fa2e6b-b0b8-4202-bf6c-46efdb5355c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"29fa2e6b-b0b8-4202-bf6c-46efdb5355c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"29fa2e6b-b0b8-4202-bf6c-46efdb5355c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"621b0bce-fc75-4d68-b55b-1616eccdf040","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"29fa2e6b-b0b8-4202-bf6c-46efdb5355c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"29fa2e6b-b0b8-4202-bf6c-46efdb5355c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"29fa2e6b-b0b8-4202-bf6c-46efdb5355c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"829b25bd-8c08-4c14-98b6-f6685999b79f"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"829b25bd-8c08-4c14-98b6-f6685999b79f"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"829b25bd-8c08-4c14-98b6-f6685999b79f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"829b25bd-8c08-4c14-98b6-f6685999b79f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"829b25bd-8c08-4c14-98b6-f6685999b79f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"829b25bd-8c08-4c14-98b6-f6685999b79f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"829b25bd-8c08-4c14-98b6-f6685999b79f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"829b25bd-8c08-4c14-98b6-f6685999b79f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"829b25bd-8c08-4c14-98b6-f6685999b79f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"829b25bd-8c08-4c14-98b6-f6685999b79f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"829b25bd-8c08-4c14-98b6-f6685999b79f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"829b25bd-8c08-4c14-98b6-f6685999b79f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"829b25bd-8c08-4c14-98b6-f6685999b79f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"829b25bd-8c08-4c14-98b6-f6685999b79f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"829b25bd-8c08-4c14-98b6-f6685999b79f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"829b25bd-8c08-4c14-98b6-f6685999b79f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"829b25bd-8c08-4c14-98b6-f6685999b79f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:48:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"829b25bd-8c08-4c14-98b6-f6685999b79f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:48:59Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e30f4d78-2b1c-4185-9148-d45c55e82b36","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:48:59Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e30f4d78-2b1c-4185-9148-d45c55e82b36","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"24c1e1cb-b131-4fdb-8ab7-3d5b3cb398a4"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"24c1e1cb-b131-4fdb-8ab7-3d5b3cb398a4"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"24c1e1cb-b131-4fdb-8ab7-3d5b3cb398a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"24c1e1cb-b131-4fdb-8ab7-3d5b3cb398a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"24c1e1cb-b131-4fdb-8ab7-3d5b3cb398a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"24c1e1cb-b131-4fdb-8ab7-3d5b3cb398a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"24c1e1cb-b131-4fdb-8ab7-3d5b3cb398a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"24c1e1cb-b131-4fdb-8ab7-3d5b3cb398a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"24c1e1cb-b131-4fdb-8ab7-3d5b3cb398a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9c148118-4197-46f9-943a-e613f19f4e62"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9c148118-4197-46f9-943a-e613f19f4e62"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9c148118-4197-46f9-943a-e613f19f4e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9c148118-4197-46f9-943a-e613f19f4e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9c148118-4197-46f9-943a-e613f19f4e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9c148118-4197-46f9-943a-e613f19f4e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9c148118-4197-46f9-943a-e613f19f4e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9c148118-4197-46f9-943a-e613f19f4e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9c148118-4197-46f9-943a-e613f19f4e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fd7e0c8f-0ab1-44a7-b1e1-cc26c4ecdd75"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fd7e0c8f-0ab1-44a7-b1e1-cc26c4ecdd75"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fd7e0c8f-0ab1-44a7-b1e1-cc26c4ecdd75","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fd7e0c8f-0ab1-44a7-b1e1-cc26c4ecdd75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fd7e0c8f-0ab1-44a7-b1e1-cc26c4ecdd75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fd7e0c8f-0ab1-44a7-b1e1-cc26c4ecdd75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fd7e0c8f-0ab1-44a7-b1e1-cc26c4ecdd75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fd7e0c8f-0ab1-44a7-b1e1-cc26c4ecdd75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fd7e0c8f-0ab1-44a7-b1e1-cc26c4ecdd75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fd7e0c8f-0ab1-44a7-b1e1-cc26c4ecdd75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fd7e0c8f-0ab1-44a7-b1e1-cc26c4ecdd75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fd7e0c8f-0ab1-44a7-b1e1-cc26c4ecdd75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fd7e0c8f-0ab1-44a7-b1e1-cc26c4ecdd75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fd7e0c8f-0ab1-44a7-b1e1-cc26c4ecdd75","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fd7e0c8f-0ab1-44a7-b1e1-cc26c4ecdd75","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fd7e0c8f-0ab1-44a7-b1e1-cc26c4ecdd75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fd7e0c8f-0ab1-44a7-b1e1-cc26c4ecdd75","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:10Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fd7e0c8f-0ab1-44a7-b1e1-cc26c4ecdd75","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:11Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"833cf2b5-d9cc-4663-8268-30d51500aee6","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:49:11Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"833cf2b5-d9cc-4663-8268-30d51500aee6","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"756f005d-ddeb-4537-85cb-abd0e00d8a66"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"756f005d-ddeb-4537-85cb-abd0e00d8a66"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"756f005d-ddeb-4537-85cb-abd0e00d8a66","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"756f005d-ddeb-4537-85cb-abd0e00d8a66","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"839a9882-42b7-4262-a4c1-f753eeb3f3b6"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"839a9882-42b7-4262-a4c1-f753eeb3f3b6"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"839a9882-42b7-4262-a4c1-f753eeb3f3b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"839a9882-42b7-4262-a4c1-f753eeb3f3b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"756f005d-ddeb-4537-85cb-abd0e00d8a66","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"839a9882-42b7-4262-a4c1-f753eeb3f3b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"839a9882-42b7-4262-a4c1-f753eeb3f3b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"839a9882-42b7-4262-a4c1-f753eeb3f3b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"839a9882-42b7-4262-a4c1-f753eeb3f3b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"839a9882-42b7-4262-a4c1-f753eeb3f3b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"839a9882-42b7-4262-a4c1-f753eeb3f3b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"839a9882-42b7-4262-a4c1-f753eeb3f3b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"756f005d-ddeb-4537-85cb-abd0e00d8a66","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"756f005d-ddeb-4537-85cb-abd0e00d8a66","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"839a9882-42b7-4262-a4c1-f753eeb3f3b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"839a9882-42b7-4262-a4c1-f753eeb3f3b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"839a9882-42b7-4262-a4c1-f753eeb3f3b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"839a9882-42b7-4262-a4c1-f753eeb3f3b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"839a9882-42b7-4262-a4c1-f753eeb3f3b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"839a9882-42b7-4262-a4c1-f753eeb3f3b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"839a9882-42b7-4262-a4c1-f753eeb3f3b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"reconcile","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"05d3374e-0957-4614-a1dd-4eb4d2db3ea3"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"apply","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"05d3374e-0957-4614-a1dd-4eb4d2db3ea3"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"05d3374e-0957-4614-a1dd-4eb4d2db3ea3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.initialize"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"05d3374e-0957-4614-a1dd-4eb4d2db3ea3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.customizeManifests"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"05d3374e-0957-4614-a1dd-4eb4d2db3ea3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"05d3374e-0957-4614-a1dd-4eb4d2db3ea3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.configureDependencies"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"05d3374e-0957-4614-a1dd-4eb4d2db3ea3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"05d3374e-0957-4614-a1dd-4eb4d2db3ea3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"05d3374e-0957-4614-a1dd-4eb4d2db3ea3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"reconcile","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"06ded0f7-28d6-4c63-9178-4ed3c36956f7"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"apply","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"06ded0f7-28d6-4c63-9178-4ed3c36956f7"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"06ded0f7-28d6-4c63-9178-4ed3c36956f7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"06ded0f7-28d6-4c63-9178-4ed3c36956f7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.initialize"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"06ded0f7-28d6-4c63-9178-4ed3c36956f7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"06ded0f7-28d6-4c63-9178-4ed3c36956f7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkJobSetCRD"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"05d3374e-0957-4614-a1dd-4eb4d2db3ea3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"05d3374e-0957-4614-a1dd-4eb4d2db3ea3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.updateStatus"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"05d3374e-0957-4614-a1dd-4eb4d2db3ea3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"05d3374e-0957-4614-a1dd-4eb4d2db3ea3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"reconcile","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ae7e9458-68f5-4e45-8f9b-e4a57d5c845d"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"apply","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ae7e9458-68f5-4e45-8f9b-e4a57d5c845d"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ae7e9458-68f5-4e45-8f9b-e4a57d5c845d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.initialize"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ae7e9458-68f5-4e45-8f9b-e4a57d5c845d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ae7e9458-68f5-4e45-8f9b-e4a57d5c845d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.configureDependencies"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ae7e9458-68f5-4e45-8f9b-e4a57d5c845d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7559215e-d837-4e1c-9cbc-1f1c71debd63"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7559215e-d837-4e1c-9cbc-1f1c71debd63"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7559215e-d837-4e1c-9cbc-1f1c71debd63","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7559215e-d837-4e1c-9cbc-1f1c71debd63","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7559215e-d837-4e1c-9cbc-1f1c71debd63","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ae7e9458-68f5-4e45-8f9b-e4a57d5c845d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"06ded0f7-28d6-4c63-9178-4ed3c36956f7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"06ded0f7-28d6-4c63-9178-4ed3c36956f7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"06ded0f7-28d6-4c63-9178-4ed3c36956f7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"reconcile","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"ce7a5bb5-5395-49fb-a299-3dddd9da5fa8"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"apply","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"ce7a5bb5-5395-49fb-a299-3dddd9da5fa8"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"ce7a5bb5-5395-49fb-a299-3dddd9da5fa8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.initialize"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"ce7a5bb5-5395-49fb-a299-3dddd9da5fa8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"ce7a5bb5-5395-49fb-a299-3dddd9da5fa8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"ce7a5bb5-5395-49fb-a299-3dddd9da5fa8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"ce7a5bb5-5395-49fb-a299-3dddd9da5fa8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"reconcile","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b72723db-8344-4af5-b769-6014f22dd48c"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"apply","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b72723db-8344-4af5-b769-6014f22dd48c"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b72723db-8344-4af5-b769-6014f22dd48c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b72723db-8344-4af5-b769-6014f22dd48c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.initialize"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b72723db-8344-4af5-b769-6014f22dd48c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.argoWorkflowsControllersOptions"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b72723db-8344-4af5-b769-6014f22dd48c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b72723db-8344-4af5-b769-6014f22dd48c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b72723db-8344-4af5-b769-6014f22dd48c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"5349c161-83af-455e-81e9-a55c77903022"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"5349c161-83af-455e-81e9-a55c77903022"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"5349c161-83af-455e-81e9-a55c77903022","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"5349c161-83af-455e-81e9-a55c77903022","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.(*componentHandler).NewComponentReconciler.checkSubscriptionDependencies.func26"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"5349c161-83af-455e-81e9-a55c77903022","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:13Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"5349c161-83af-455e-81e9-a55c77903022","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"5349c161-83af-455e-81e9-a55c77903022","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"5349c161-83af-455e-81e9-a55c77903022","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"5349c161-83af-455e-81e9-a55c77903022","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b72723db-8344-4af5-b769-6014f22dd48c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"reconcile","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"a3eafb65-a91f-45f6-abbd-fa3a853f28fa"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"apply","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"a3eafb65-a91f-45f6-abbd-fa3a853f28fa"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"a3eafb65-a91f-45f6-abbd-fa3a853f28fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainingoperator.initialize"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"a3eafb65-a91f-45f6-abbd-fa3a853f28fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"a3eafb65-a91f-45f6-abbd-fa3a853f28fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"a3eafb65-a91f-45f6-abbd-fa3a853f28fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"582534cd-b9fb-42e8-950f-3aedd541b6c1"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"582534cd-b9fb-42e8-950f-3aedd541b6c1"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"582534cd-b9fb-42e8-950f-3aedd541b6c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"582534cd-b9fb-42e8-950f-3aedd541b6c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7559215e-d837-4e1c-9cbc-1f1c71debd63","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7559215e-d837-4e1c-9cbc-1f1c71debd63","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7559215e-d837-4e1c-9cbc-1f1c71debd63","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7559215e-d837-4e1c-9cbc-1f1c71debd63","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b72723db-8344-4af5-b769-6014f22dd48c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"b72723db-8344-4af5-b769-6014f22dd48c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"756f005d-ddeb-4537-85cb-abd0e00d8a66","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"reconcile","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e6fe7c44-be4e-4aed-9f66-848cd6011c77"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"apply","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e6fe7c44-be4e-4aed-9f66-848cd6011c77"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e6fe7c44-be4e-4aed-9f66-848cd6011c77","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/sanitycheck.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"06ded0f7-28d6-4c63-9178-4ed3c36956f7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"06ded0f7-28d6-4c63-9178-4ed3c36956f7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"06ded0f7-28d6-4c63-9178-4ed3c36956f7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e6fe7c44-be4e-4aed-9f66-848cd6011c77","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ray.initialize"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e6fe7c44-be4e-4aed-9f66-848cd6011c77","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e6fe7c44-be4e-4aed-9f66-848cd6011c77","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e6fe7c44-be4e-4aed-9f66-848cd6011c77","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7559215e-d837-4e1c-9cbc-1f1c71debd63","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7559215e-d837-4e1c-9cbc-1f1c71debd63","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7559215e-d837-4e1c-9cbc-1f1c71debd63","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"a3eafb65-a91f-45f6-abbd-fa3a853f28fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"a3eafb65-a91f-45f6-abbd-fa3a853f28fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"a3eafb65-a91f-45f6-abbd-fa3a853f28fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"ce7a5bb5-5395-49fb-a299-3dddd9da5fa8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"ce7a5bb5-5395-49fb-a299-3dddd9da5fa8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:14Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"ce7a5bb5-5395-49fb-a299-3dddd9da5fa8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:15Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"706a2abf-24fb-4025-9723-412d8b9d6d63","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:49:15Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"706a2abf-24fb-4025-9723-412d8b9d6d63","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:49:15Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"582534cd-b9fb-42e8-950f-3aedd541b6c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:49:15Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"582534cd-b9fb-42e8-950f-3aedd541b6c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-15T04:49:15Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"582534cd-b9fb-42e8-950f-3aedd541b6c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:15Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"582534cd-b9fb-42e8-950f-3aedd541b6c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:15Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e6fe7c44-be4e-4aed-9f66-848cd6011c77","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:15Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e6fe7c44-be4e-4aed-9f66-848cd6011c77","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:15Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e6fe7c44-be4e-4aed-9f66-848cd6011c77","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:15Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"delete","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"756f005d-ddeb-4537-85cb-abd0e00d8a66","gvk":"components.platform.opendatahub.io/v1alpha1, Kind=SparkOperator","ns":"","name":"default-sparkoperator"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"90064100-c15a-49ea-a430-7e8f45d6c78c"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"898aa39e-5f35-4b19-b1f0-9226c1c5c1ba"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"c7ee44bc-fdc3-4bb1-a4aa-2331d707136e"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"250c2651-ebeb-4f62-a42e-173ddb486279"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"793b8bda-39fb-45e8-9547-86c0d1501254"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"664c8069-12b4-4194-ab61-a9310161bad5"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"664c8069-12b4-4194-ab61-a9310161bad5"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"664c8069-12b4-4194-ab61-a9310161bad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"664c8069-12b4-4194-ab61-a9310161bad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"664c8069-12b4-4194-ab61-a9310161bad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"664c8069-12b4-4194-ab61-a9310161bad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"664c8069-12b4-4194-ab61-a9310161bad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"664c8069-12b4-4194-ab61-a9310161bad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"664c8069-12b4-4194-ab61-a9310161bad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"664c8069-12b4-4194-ab61-a9310161bad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"664c8069-12b4-4194-ab61-a9310161bad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"ae10dc33-6841-461f-8e6f-ebd53a5fcb6a"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"2b558b44-ff17-4f29-a4fc-e7f53e0f193e"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"e65af14a-d8ff-4739-b24e-b830d8976c47"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"357a5157-7877-4f93-b83f-d83d3ed84905"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"664c8069-12b4-4194-ab61-a9310161bad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"664c8069-12b4-4194-ab61-a9310161bad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"664c8069-12b4-4194-ab61-a9310161bad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"664c8069-12b4-4194-ab61-a9310161bad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"664c8069-12b4-4194-ab61-a9310161bad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"664c8069-12b4-4194-ab61-a9310161bad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"664c8069-12b4-4194-ab61-a9310161bad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"756f005d-ddeb-4537-85cb-abd0e00d8a66","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"a6b5b0f3-26da-477b-96d4-ed28e85a42aa"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"c4674709-5a6c-457f-9b40-905df0d16ab0"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8b2f38de-0208-4fe0-9fab-b0c4c7c7c619"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"76ab1600-a27f-4efd-b126-a02b4eb1ecb6"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"fcb68a97-1f32-496c-aa73-14e65be55c2a"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"29695142-aae0-47a8-9362-f8cc2d80e1ca"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"4635539d-e8c5-4c32-9f09-acb746768666"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"f4ef1f2e-fadc-46dc-8473-3b8d07257b5b"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"a909b756-e956-459f-9a86-1ed8c6502b85"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"31da5849-fa78-471b-b4fd-3ce45bd0d44f"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7559215e-d837-4e1c-9cbc-1f1c71debd63","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"29696f2c-0107-489f-8ee0-5ad883f8ff7d"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a3406363-b9cc-4638-8fd0-ec8216afcc33"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7559215e-d837-4e1c-9cbc-1f1c71debd63","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7559215e-d837-4e1c-9cbc-1f1c71debd63","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7559215e-d837-4e1c-9cbc-1f1c71debd63","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a3406363-b9cc-4638-8fd0-ec8216afcc33"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a3406363-b9cc-4638-8fd0-ec8216afcc33","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a3406363-b9cc-4638-8fd0-ec8216afcc33","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a3406363-b9cc-4638-8fd0-ec8216afcc33","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a3406363-b9cc-4638-8fd0-ec8216afcc33","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a3406363-b9cc-4638-8fd0-ec8216afcc33","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"5ab65750-f767-4207-9669-70b58f975a58"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"7c372209-ce7a-4293-ba48-2c1e2be31762"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"a4f893bf-d94d-493d-bcf0-56d823139285"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"0fd0f5ba-35e5-406d-80b5-11e74881a1bc"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"6610a84a-7054-41f2-91bb-75a833517635"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ae7e9458-68f5-4e45-8f9b-e4a57d5c845d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a3406363-b9cc-4638-8fd0-ec8216afcc33","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:16Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"53cf6965-274c-496e-a13e-4934f984282c","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"53cf6965-274c-496e-a13e-4934f984282c","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4ad40233-59e5-4517-8da2-4654413200f8"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4ad40233-59e5-4517-8da2-4654413200f8"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4ad40233-59e5-4517-8da2-4654413200f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4ad40233-59e5-4517-8da2-4654413200f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4ad40233-59e5-4517-8da2-4654413200f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4ad40233-59e5-4517-8da2-4654413200f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4ad40233-59e5-4517-8da2-4654413200f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4ad40233-59e5-4517-8da2-4654413200f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4ad40233-59e5-4517-8da2-4654413200f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4ad40233-59e5-4517-8da2-4654413200f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4ad40233-59e5-4517-8da2-4654413200f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4ad40233-59e5-4517-8da2-4654413200f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4ad40233-59e5-4517-8da2-4654413200f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4ad40233-59e5-4517-8da2-4654413200f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4ad40233-59e5-4517-8da2-4654413200f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4ad40233-59e5-4517-8da2-4654413200f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4ad40233-59e5-4517-8da2-4654413200f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4ad40233-59e5-4517-8da2-4654413200f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ae7e9458-68f5-4e45-8f9b-e4a57d5c845d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ae7e9458-68f5-4e45-8f9b-e4a57d5c845d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/imagestreams.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ae7e9458-68f5-4e45-8f9b-e4a57d5c845d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.updateStatus"} {"level":"info","ts":"2026-07-15T04:49:16Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ae7e9458-68f5-4e45-8f9b-e4a57d5c845d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"5370aaf1-d9bc-4856-a467-bc976bee04e8"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a3406363-b9cc-4638-8fd0-ec8216afcc33","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:17Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"dabfdb52-e1fe-469e-9317-bb4bdadca1e1","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"dabfdb52-e1fe-469e-9317-bb4bdadca1e1","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6c7ef5c1-b748-4043-a96d-add09561f68e"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6c7ef5c1-b748-4043-a96d-add09561f68e"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6c7ef5c1-b748-4043-a96d-add09561f68e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6c7ef5c1-b748-4043-a96d-add09561f68e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6c7ef5c1-b748-4043-a96d-add09561f68e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6c7ef5c1-b748-4043-a96d-add09561f68e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6c7ef5c1-b748-4043-a96d-add09561f68e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"39d2908c-6928-4afd-8356-c96c457dfc80"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"39d2908c-6928-4afd-8356-c96c457dfc80"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"39d2908c-6928-4afd-8356-c96c457dfc80","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"39d2908c-6928-4afd-8356-c96c457dfc80","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"39d2908c-6928-4afd-8356-c96c457dfc80","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"39d2908c-6928-4afd-8356-c96c457dfc80","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"39d2908c-6928-4afd-8356-c96c457dfc80","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"39d2908c-6928-4afd-8356-c96c457dfc80","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"39d2908c-6928-4afd-8356-c96c457dfc80","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"39d2908c-6928-4afd-8356-c96c457dfc80","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"39d2908c-6928-4afd-8356-c96c457dfc80","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6c7ef5c1-b748-4043-a96d-add09561f68e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"39d2908c-6928-4afd-8356-c96c457dfc80","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"39d2908c-6928-4afd-8356-c96c457dfc80","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"39d2908c-6928-4afd-8356-c96c457dfc80","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"39d2908c-6928-4afd-8356-c96c457dfc80","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"39d2908c-6928-4afd-8356-c96c457dfc80","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"39d2908c-6928-4afd-8356-c96c457dfc80","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"39d2908c-6928-4afd-8356-c96c457dfc80","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:17Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"fc6d1dba-fad2-4714-b8ec-7d50714659f9","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"fc6d1dba-fad2-4714-b8ec-7d50714659f9","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"df5023ce-bc3b-4b1f-a9e9-1ba2bf9c2d10"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"ba3f63bf-d833-4c51-abe4-c800214bbb87"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6c7ef5c1-b748-4043-a96d-add09561f68e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fc6b1625-5ddc-4670-9c65-6e94f1edb7c8"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fc6b1625-5ddc-4670-9c65-6e94f1edb7c8"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fc6b1625-5ddc-4670-9c65-6e94f1edb7c8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fc6b1625-5ddc-4670-9c65-6e94f1edb7c8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fc6b1625-5ddc-4670-9c65-6e94f1edb7c8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fc6b1625-5ddc-4670-9c65-6e94f1edb7c8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fc6b1625-5ddc-4670-9c65-6e94f1edb7c8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fc6b1625-5ddc-4670-9c65-6e94f1edb7c8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fc6b1625-5ddc-4670-9c65-6e94f1edb7c8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db223d00-14c0-47ef-8338-d3e4e42f81b7"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db223d00-14c0-47ef-8338-d3e4e42f81b7"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db223d00-14c0-47ef-8338-d3e4e42f81b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db223d00-14c0-47ef-8338-d3e4e42f81b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db223d00-14c0-47ef-8338-d3e4e42f81b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db223d00-14c0-47ef-8338-d3e4e42f81b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db223d00-14c0-47ef-8338-d3e4e42f81b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db223d00-14c0-47ef-8338-d3e4e42f81b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db223d00-14c0-47ef-8338-d3e4e42f81b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db223d00-14c0-47ef-8338-d3e4e42f81b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db223d00-14c0-47ef-8338-d3e4e42f81b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db223d00-14c0-47ef-8338-d3e4e42f81b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db223d00-14c0-47ef-8338-d3e4e42f81b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db223d00-14c0-47ef-8338-d3e4e42f81b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db223d00-14c0-47ef-8338-d3e4e42f81b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db223d00-14c0-47ef-8338-d3e4e42f81b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db223d00-14c0-47ef-8338-d3e4e42f81b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db223d00-14c0-47ef-8338-d3e4e42f81b7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:18Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ae7e9458-68f5-4e45-8f9b-e4a57d5c845d"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"582534cd-b9fb-42e8-950f-3aedd541b6c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"582534cd-b9fb-42e8-950f-3aedd541b6c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"582534cd-b9fb-42e8-950f-3aedd541b6c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"582534cd-b9fb-42e8-950f-3aedd541b6c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"582534cd-b9fb-42e8-950f-3aedd541b6c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ae7e9458-68f5-4e45-8f9b-e4a57d5c845d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d5e13724-f26c-4404-9f07-12ce995f442b"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d5e13724-f26c-4404-9f07-12ce995f442b"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d5e13724-f26c-4404-9f07-12ce995f442b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d5e13724-f26c-4404-9f07-12ce995f442b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d5e13724-f26c-4404-9f07-12ce995f442b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d5e13724-f26c-4404-9f07-12ce995f442b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d5e13724-f26c-4404-9f07-12ce995f442b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d5e13724-f26c-4404-9f07-12ce995f442b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d5e13724-f26c-4404-9f07-12ce995f442b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0877a38e-10b2-4dee-9dcf-9216b28736a9"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0877a38e-10b2-4dee-9dcf-9216b28736a9"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0877a38e-10b2-4dee-9dcf-9216b28736a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0877a38e-10b2-4dee-9dcf-9216b28736a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0877a38e-10b2-4dee-9dcf-9216b28736a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0877a38e-10b2-4dee-9dcf-9216b28736a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0877a38e-10b2-4dee-9dcf-9216b28736a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0877a38e-10b2-4dee-9dcf-9216b28736a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:49:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0877a38e-10b2-4dee-9dcf-9216b28736a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"33ae23bd-fabd-47ce-b019-4b969ce26377"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"33ae23bd-fabd-47ce-b019-4b969ce26377"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"33ae23bd-fabd-47ce-b019-4b969ce26377","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"33ae23bd-fabd-47ce-b019-4b969ce26377","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c7d2c956-61fe-4f81-82e7-26ac1dc2cbb3"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c7d2c956-61fe-4f81-82e7-26ac1dc2cbb3"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c7d2c956-61fe-4f81-82e7-26ac1dc2cbb3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"33ae23bd-fabd-47ce-b019-4b969ce26377","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c7d2c956-61fe-4f81-82e7-26ac1dc2cbb3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c7d2c956-61fe-4f81-82e7-26ac1dc2cbb3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c7d2c956-61fe-4f81-82e7-26ac1dc2cbb3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c7d2c956-61fe-4f81-82e7-26ac1dc2cbb3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c7d2c956-61fe-4f81-82e7-26ac1dc2cbb3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c7d2c956-61fe-4f81-82e7-26ac1dc2cbb3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c7d2c956-61fe-4f81-82e7-26ac1dc2cbb3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c7d2c956-61fe-4f81-82e7-26ac1dc2cbb3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"33ae23bd-fabd-47ce-b019-4b969ce26377","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"33ae23bd-fabd-47ce-b019-4b969ce26377","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c7d2c956-61fe-4f81-82e7-26ac1dc2cbb3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c7d2c956-61fe-4f81-82e7-26ac1dc2cbb3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c7d2c956-61fe-4f81-82e7-26ac1dc2cbb3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c7d2c956-61fe-4f81-82e7-26ac1dc2cbb3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c7d2c956-61fe-4f81-82e7-26ac1dc2cbb3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c7d2c956-61fe-4f81-82e7-26ac1dc2cbb3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c7d2c956-61fe-4f81-82e7-26ac1dc2cbb3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"reconcile","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"0ec16727-edf2-445c-a398-71caeee8aebb"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"apply","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"0ec16727-edf2-445c-a398-71caeee8aebb"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"0ec16727-edf2-445c-a398-71caeee8aebb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/sanitycheck.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"0ec16727-edf2-445c-a398-71caeee8aebb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ray.initialize"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"0ec16727-edf2-445c-a398-71caeee8aebb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"0ec16727-edf2-445c-a398-71caeee8aebb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"reconcile","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"81f46b1b-2c02-45a2-a720-7018a536a2c9"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"apply","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"81f46b1b-2c02-45a2-a720-7018a536a2c9"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"81f46b1b-2c02-45a2-a720-7018a536a2c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.initialize"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"81f46b1b-2c02-45a2-a720-7018a536a2c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.customizeManifests"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"81f46b1b-2c02-45a2-a720-7018a536a2c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"81f46b1b-2c02-45a2-a720-7018a536a2c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.configureDependencies"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"81f46b1b-2c02-45a2-a720-7018a536a2c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"81f46b1b-2c02-45a2-a720-7018a536a2c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"81f46b1b-2c02-45a2-a720-7018a536a2c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"0ec16727-edf2-445c-a398-71caeee8aebb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"reconcile","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"e57da7ec-9850-4d27-aba1-bbba8690a5ba"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"apply","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"e57da7ec-9850-4d27-aba1-bbba8690a5ba"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"e57da7ec-9850-4d27-aba1-bbba8690a5ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"e57da7ec-9850-4d27-aba1-bbba8690a5ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.initialize"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"e57da7ec-9850-4d27-aba1-bbba8690a5ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"e57da7ec-9850-4d27-aba1-bbba8690a5ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkJobSetCRD"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"81f46b1b-2c02-45a2-a720-7018a536a2c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"reconcile","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d28fb883-3a51-4447-9b17-73acec991fdb"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"apply","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d28fb883-3a51-4447-9b17-73acec991fdb"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d28fb883-3a51-4447-9b17-73acec991fdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.initialize"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d28fb883-3a51-4447-9b17-73acec991fdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d28fb883-3a51-4447-9b17-73acec991fdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.configureDependencies"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d28fb883-3a51-4447-9b17-73acec991fdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"81f46b1b-2c02-45a2-a720-7018a536a2c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.updateStatus"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"81f46b1b-2c02-45a2-a720-7018a536a2c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"81f46b1b-2c02-45a2-a720-7018a536a2c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"e57da7ec-9850-4d27-aba1-bbba8690a5ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"e57da7ec-9850-4d27-aba1-bbba8690a5ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"e57da7ec-9850-4d27-aba1-bbba8690a5ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d28fb883-3a51-4447-9b17-73acec991fdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"72a7424a-7ec7-4ba4-af95-c01220cf1018"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"72a7424a-7ec7-4ba4-af95-c01220cf1018"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"72a7424a-7ec7-4ba4-af95-c01220cf1018","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"72a7424a-7ec7-4ba4-af95-c01220cf1018","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"72a7424a-7ec7-4ba4-af95-c01220cf1018","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"reconcile","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"bbb65152-52f7-4275-adc6-e0733d0e0bd3"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"apply","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"bbb65152-52f7-4275-adc6-e0733d0e0bd3"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"bbb65152-52f7-4275-adc6-e0733d0e0bd3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.initialize"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"bbb65152-52f7-4275-adc6-e0733d0e0bd3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"bbb65152-52f7-4275-adc6-e0733d0e0bd3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:36Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"bbb65152-52f7-4275-adc6-e0733d0e0bd3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"bbb65152-52f7-4275-adc6-e0733d0e0bd3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"e57da7ec-9850-4d27-aba1-bbba8690a5ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"reconcile","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"8252f9d5-93ed-4301-bdd5-d7cfc5b88188"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"apply","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"8252f9d5-93ed-4301-bdd5-d7cfc5b88188"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"8252f9d5-93ed-4301-bdd5-d7cfc5b88188","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"8252f9d5-93ed-4301-bdd5-d7cfc5b88188","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.initialize"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"8252f9d5-93ed-4301-bdd5-d7cfc5b88188","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.argoWorkflowsControllersOptions"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"8252f9d5-93ed-4301-bdd5-d7cfc5b88188","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"8252f9d5-93ed-4301-bdd5-d7cfc5b88188","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"8252f9d5-93ed-4301-bdd5-d7cfc5b88188","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"e57da7ec-9850-4d27-aba1-bbba8690a5ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"e57da7ec-9850-4d27-aba1-bbba8690a5ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"f52443db-a515-41ab-8a67-0f8d89d7a953"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"f52443db-a515-41ab-8a67-0f8d89d7a953"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"f52443db-a515-41ab-8a67-0f8d89d7a953","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"f52443db-a515-41ab-8a67-0f8d89d7a953","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.(*componentHandler).NewComponentReconciler.checkSubscriptionDependencies.func26"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"f52443db-a515-41ab-8a67-0f8d89d7a953","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"f52443db-a515-41ab-8a67-0f8d89d7a953","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"0ec16727-edf2-445c-a398-71caeee8aebb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"0ec16727-edf2-445c-a398-71caeee8aebb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"0ec16727-edf2-445c-a398-71caeee8aebb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"reconcile","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"ff56d5c6-6194-4f59-80a0-75a0ce24525a"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"apply","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"ff56d5c6-6194-4f59-80a0-75a0ce24525a"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"ff56d5c6-6194-4f59-80a0-75a0ce24525a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainingoperator.initialize"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"ff56d5c6-6194-4f59-80a0-75a0ce24525a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"ff56d5c6-6194-4f59-80a0-75a0ce24525a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"bbb65152-52f7-4275-adc6-e0733d0e0bd3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"bbb65152-52f7-4275-adc6-e0733d0e0bd3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"bbb65152-52f7-4275-adc6-e0733d0e0bd3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"ff56d5c6-6194-4f59-80a0-75a0ce24525a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"6ebb3c1f-f59c-4c42-a67c-fc96a85a7781"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"6ebb3c1f-f59c-4c42-a67c-fc96a85a7781"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"6ebb3c1f-f59c-4c42-a67c-fc96a85a7781","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"6ebb3c1f-f59c-4c42-a67c-fc96a85a7781","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"cb4cdde0-155c-4d1f-9caa-7982fada4ea7"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"cb4cdde0-155c-4d1f-9caa-7982fada4ea7"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"cb4cdde0-155c-4d1f-9caa-7982fada4ea7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"cb4cdde0-155c-4d1f-9caa-7982fada4ea7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"cb4cdde0-155c-4d1f-9caa-7982fada4ea7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"33ae23bd-fabd-47ce-b019-4b969ce26377","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"72a7424a-7ec7-4ba4-af95-c01220cf1018","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"72a7424a-7ec7-4ba4-af95-c01220cf1018","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"72a7424a-7ec7-4ba4-af95-c01220cf1018","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"72a7424a-7ec7-4ba4-af95-c01220cf1018","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"f52443db-a515-41ab-8a67-0f8d89d7a953","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"f52443db-a515-41ab-8a67-0f8d89d7a953","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:37Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"f52443db-a515-41ab-8a67-0f8d89d7a953","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:38Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"72a7424a-7ec7-4ba4-af95-c01220cf1018","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T04:50:38Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"72a7424a-7ec7-4ba4-af95-c01220cf1018","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T04:50:38Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"72a7424a-7ec7-4ba4-af95-c01220cf1018","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:38Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"df9c2528-d423-4eb3-b07c-d4f82ba531f0","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:50:38Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"df9c2528-d423-4eb3-b07c-d4f82ba531f0","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:50:38Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"6ebb3c1f-f59c-4c42-a67c-fc96a85a7781","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:50:38Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"6ebb3c1f-f59c-4c42-a67c-fc96a85a7781","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-15T04:50:38Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"6ebb3c1f-f59c-4c42-a67c-fc96a85a7781","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:38Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"6ebb3c1f-f59c-4c42-a67c-fc96a85a7781","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:38Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"ff56d5c6-6194-4f59-80a0-75a0ce24525a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:38Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"ff56d5c6-6194-4f59-80a0-75a0ce24525a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:38Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"ff56d5c6-6194-4f59-80a0-75a0ce24525a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:38Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"8252f9d5-93ed-4301-bdd5-d7cfc5b88188","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:38Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"8252f9d5-93ed-4301-bdd5-d7cfc5b88188","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:38Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"8252f9d5-93ed-4301-bdd5-d7cfc5b88188","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:39Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"72a7424a-7ec7-4ba4-af95-c01220cf1018","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-15T04:50:39Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"72a7424a-7ec7-4ba4-af95-c01220cf1018","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:39Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"72a7424a-7ec7-4ba4-af95-c01220cf1018","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:39Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"72a7424a-7ec7-4ba4-af95-c01220cf1018","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:39Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"33ae23bd-fabd-47ce-b019-4b969ce26377","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a9811cb6-7531-4aa4-ad91-4b81ddb812e4"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a9811cb6-7531-4aa4-ad91-4b81ddb812e4"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a9811cb6-7531-4aa4-ad91-4b81ddb812e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a9811cb6-7531-4aa4-ad91-4b81ddb812e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a9811cb6-7531-4aa4-ad91-4b81ddb812e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a9811cb6-7531-4aa4-ad91-4b81ddb812e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a9811cb6-7531-4aa4-ad91-4b81ddb812e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"352bee90-e412-45c9-b4e0-6316a414fcd0"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"352bee90-e412-45c9-b4e0-6316a414fcd0"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"352bee90-e412-45c9-b4e0-6316a414fcd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"352bee90-e412-45c9-b4e0-6316a414fcd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"352bee90-e412-45c9-b4e0-6316a414fcd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"352bee90-e412-45c9-b4e0-6316a414fcd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"352bee90-e412-45c9-b4e0-6316a414fcd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"352bee90-e412-45c9-b4e0-6316a414fcd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"352bee90-e412-45c9-b4e0-6316a414fcd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"352bee90-e412-45c9-b4e0-6316a414fcd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"352bee90-e412-45c9-b4e0-6316a414fcd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"352bee90-e412-45c9-b4e0-6316a414fcd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"352bee90-e412-45c9-b4e0-6316a414fcd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"352bee90-e412-45c9-b4e0-6316a414fcd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"352bee90-e412-45c9-b4e0-6316a414fcd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"352bee90-e412-45c9-b4e0-6316a414fcd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"352bee90-e412-45c9-b4e0-6316a414fcd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"352bee90-e412-45c9-b4e0-6316a414fcd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"cb4cdde0-155c-4d1f-9caa-7982fada4ea7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d28fb883-3a51-4447-9b17-73acec991fdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a9811cb6-7531-4aa4-ad91-4b81ddb812e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d28fb883-3a51-4447-9b17-73acec991fdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d28fb883-3a51-4447-9b17-73acec991fdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/imagestreams.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d28fb883-3a51-4447-9b17-73acec991fdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.updateStatus"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d28fb883-3a51-4447-9b17-73acec991fdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8c32a5cd-1039-40a5-893e-d93bfff1ab9f","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8c32a5cd-1039-40a5-893e-d93bfff1ab9f","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a9811cb6-7531-4aa4-ad91-4b81ddb812e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5a07924c-bc12-4977-8fc4-9a5edff62e79"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5a07924c-bc12-4977-8fc4-9a5edff62e79"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5a07924c-bc12-4977-8fc4-9a5edff62e79","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5a07924c-bc12-4977-8fc4-9a5edff62e79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5a07924c-bc12-4977-8fc4-9a5edff62e79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5a07924c-bc12-4977-8fc4-9a5edff62e79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5a07924c-bc12-4977-8fc4-9a5edff62e79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5a07924c-bc12-4977-8fc4-9a5edff62e79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5a07924c-bc12-4977-8fc4-9a5edff62e79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5a07924c-bc12-4977-8fc4-9a5edff62e79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5a07924c-bc12-4977-8fc4-9a5edff62e79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5a07924c-bc12-4977-8fc4-9a5edff62e79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5a07924c-bc12-4977-8fc4-9a5edff62e79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5a07924c-bc12-4977-8fc4-9a5edff62e79","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5a07924c-bc12-4977-8fc4-9a5edff62e79","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5a07924c-bc12-4977-8fc4-9a5edff62e79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5a07924c-bc12-4977-8fc4-9a5edff62e79","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5a07924c-bc12-4977-8fc4-9a5edff62e79","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"cb4cdde0-155c-4d1f-9caa-7982fada4ea7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"cb4cdde0-155c-4d1f-9caa-7982fada4ea7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8feb0180-6d4d-4124-bbd4-d5c011357225","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8feb0180-6d4d-4124-bbd4-d5c011357225","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"6ebb3c1f-f59c-4c42-a67c-fc96a85a7781","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"6ebb3c1f-f59c-4c42-a67c-fc96a85a7781","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-15T04:50:41Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d28fb883-3a51-4447-9b17-73acec991fdb"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"6ebb3c1f-f59c-4c42-a67c-fc96a85a7781","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"6ebb3c1f-f59c-4c42-a67c-fc96a85a7781","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"6ebb3c1f-f59c-4c42-a67c-fc96a85a7781","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d2e6cc84-c8f8-4208-875a-9b17c787cd71"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d2e6cc84-c8f8-4208-875a-9b17c787cd71"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d2e6cc84-c8f8-4208-875a-9b17c787cd71","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d2e6cc84-c8f8-4208-875a-9b17c787cd71","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d2e6cc84-c8f8-4208-875a-9b17c787cd71","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d2e6cc84-c8f8-4208-875a-9b17c787cd71","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d2e6cc84-c8f8-4208-875a-9b17c787cd71","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d2e6cc84-c8f8-4208-875a-9b17c787cd71","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"d28fb883-3a51-4447-9b17-73acec991fdb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"d2e6cc84-c8f8-4208-875a-9b17c787cd71","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"cb4cdde0-155c-4d1f-9caa-7982fada4ea7"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"56000997-a80a-4706-9d2d-c9efedd39021"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"56000997-a80a-4706-9d2d-c9efedd39021"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"56000997-a80a-4706-9d2d-c9efedd39021","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"56000997-a80a-4706-9d2d-c9efedd39021","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"56000997-a80a-4706-9d2d-c9efedd39021","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"56000997-a80a-4706-9d2d-c9efedd39021","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"56000997-a80a-4706-9d2d-c9efedd39021","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"56000997-a80a-4706-9d2d-c9efedd39021","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"cb4cdde0-155c-4d1f-9caa-7982fada4ea7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b02406b2-932d-473e-aacf-45d1fe8cecaa"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b02406b2-932d-473e-aacf-45d1fe8cecaa"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b02406b2-932d-473e-aacf-45d1fe8cecaa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b02406b2-932d-473e-aacf-45d1fe8cecaa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b02406b2-932d-473e-aacf-45d1fe8cecaa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b02406b2-932d-473e-aacf-45d1fe8cecaa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"56000997-a80a-4706-9d2d-c9efedd39021","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3f0a91a4-ed39-4618-abce-2f3d8eccd948"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3f0a91a4-ed39-4618-abce-2f3d8eccd948"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3f0a91a4-ed39-4618-abce-2f3d8eccd948","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3f0a91a4-ed39-4618-abce-2f3d8eccd948","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3f0a91a4-ed39-4618-abce-2f3d8eccd948","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3f0a91a4-ed39-4618-abce-2f3d8eccd948","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3f0a91a4-ed39-4618-abce-2f3d8eccd948","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3f0a91a4-ed39-4618-abce-2f3d8eccd948","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b02406b2-932d-473e-aacf-45d1fe8cecaa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b02406b2-932d-473e-aacf-45d1fe8cecaa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b02406b2-932d-473e-aacf-45d1fe8cecaa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"3f0a91a4-ed39-4618-abce-2f3d8eccd948","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"fd8cadff-b294-4f6c-b2e4-b90807156e7b"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"fd8cadff-b294-4f6c-b2e4-b90807156e7b"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"fd8cadff-b294-4f6c-b2e4-b90807156e7b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"fd8cadff-b294-4f6c-b2e4-b90807156e7b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"fd8cadff-b294-4f6c-b2e4-b90807156e7b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"fd8cadff-b294-4f6c-b2e4-b90807156e7b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"fd8cadff-b294-4f6c-b2e4-b90807156e7b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"fd8cadff-b294-4f6c-b2e4-b90807156e7b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"fd8cadff-b294-4f6c-b2e4-b90807156e7b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"df558698-2dd6-4b9e-a9ed-5a136eeb3801"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"df558698-2dd6-4b9e-a9ed-5a136eeb3801"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"df558698-2dd6-4b9e-a9ed-5a136eeb3801","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"df558698-2dd6-4b9e-a9ed-5a136eeb3801","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"df558698-2dd6-4b9e-a9ed-5a136eeb3801","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"73effbc6-c870-468c-930b-c5934ca426fd"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"73effbc6-c870-468c-930b-c5934ca426fd"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"73effbc6-c870-468c-930b-c5934ca426fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"73effbc6-c870-468c-930b-c5934ca426fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"73effbc6-c870-468c-930b-c5934ca426fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"73effbc6-c870-468c-930b-c5934ca426fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"73effbc6-c870-468c-930b-c5934ca426fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"df558698-2dd6-4b9e-a9ed-5a136eeb3801","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"73effbc6-c870-468c-930b-c5934ca426fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"df558698-2dd6-4b9e-a9ed-5a136eeb3801","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"df558698-2dd6-4b9e-a9ed-5a136eeb3801","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"df558698-2dd6-4b9e-a9ed-5a136eeb3801","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"73effbc6-c870-468c-930b-c5934ca426fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2b573a72-fb65-4ae2-a0fd-5c769f164e62"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2b573a72-fb65-4ae2-a0fd-5c769f164e62"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2b573a72-fb65-4ae2-a0fd-5c769f164e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2b573a72-fb65-4ae2-a0fd-5c769f164e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2b573a72-fb65-4ae2-a0fd-5c769f164e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2b573a72-fb65-4ae2-a0fd-5c769f164e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2b573a72-fb65-4ae2-a0fd-5c769f164e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2b573a72-fb65-4ae2-a0fd-5c769f164e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2b573a72-fb65-4ae2-a0fd-5c769f164e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2b573a72-fb65-4ae2-a0fd-5c769f164e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2b573a72-fb65-4ae2-a0fd-5c769f164e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2b573a72-fb65-4ae2-a0fd-5c769f164e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2b573a72-fb65-4ae2-a0fd-5c769f164e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2b573a72-fb65-4ae2-a0fd-5c769f164e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2b573a72-fb65-4ae2-a0fd-5c769f164e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2b573a72-fb65-4ae2-a0fd-5c769f164e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2b573a72-fb65-4ae2-a0fd-5c769f164e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2b573a72-fb65-4ae2-a0fd-5c769f164e62","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:54Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"bc245479-1ffa-4131-b52b-d7796720c712","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:50:54Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"bc245479-1ffa-4131-b52b-d7796720c712","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"1a7c7c35-02a2-4026-9d17-74332e89a634"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"1a7c7c35-02a2-4026-9d17-74332e89a634"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"1a7c7c35-02a2-4026-9d17-74332e89a634","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"1a7c7c35-02a2-4026-9d17-74332e89a634","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"1a7c7c35-02a2-4026-9d17-74332e89a634","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"1a7c7c35-02a2-4026-9d17-74332e89a634","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"1a7c7c35-02a2-4026-9d17-74332e89a634","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"1a7c7c35-02a2-4026-9d17-74332e89a634","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"1a7c7c35-02a2-4026-9d17-74332e89a634","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"3b89c132-6d19-4216-9670-ceff7095169e"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"3b89c132-6d19-4216-9670-ceff7095169e"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"3b89c132-6d19-4216-9670-ceff7095169e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"3b89c132-6d19-4216-9670-ceff7095169e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"3b89c132-6d19-4216-9670-ceff7095169e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e2d2d964-6f5e-4e3e-aa6e-31ca7a1d1c73"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e2d2d964-6f5e-4e3e-aa6e-31ca7a1d1c73"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e2d2d964-6f5e-4e3e-aa6e-31ca7a1d1c73","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e2d2d964-6f5e-4e3e-aa6e-31ca7a1d1c73","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e2d2d964-6f5e-4e3e-aa6e-31ca7a1d1c73","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e2d2d964-6f5e-4e3e-aa6e-31ca7a1d1c73","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e2d2d964-6f5e-4e3e-aa6e-31ca7a1d1c73","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"3b89c132-6d19-4216-9670-ceff7095169e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e2d2d964-6f5e-4e3e-aa6e-31ca7a1d1c73","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"3b89c132-6d19-4216-9670-ceff7095169e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"3b89c132-6d19-4216-9670-ceff7095169e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:50:57Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"3b89c132-6d19-4216-9670-ceff7095169e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:50:58Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e2d2d964-6f5e-4e3e-aa6e-31ca7a1d1c73","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"634fa930-5048-4f50-bbdd-066fae7a1b52"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"634fa930-5048-4f50-bbdd-066fae7a1b52"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"634fa930-5048-4f50-bbdd-066fae7a1b52","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"634fa930-5048-4f50-bbdd-066fae7a1b52","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d07f486b-58c6-46c0-a496-37be1995d21c"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d07f486b-58c6-46c0-a496-37be1995d21c"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d07f486b-58c6-46c0-a496-37be1995d21c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"634fa930-5048-4f50-bbdd-066fae7a1b52","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d07f486b-58c6-46c0-a496-37be1995d21c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d07f486b-58c6-46c0-a496-37be1995d21c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d07f486b-58c6-46c0-a496-37be1995d21c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d07f486b-58c6-46c0-a496-37be1995d21c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d07f486b-58c6-46c0-a496-37be1995d21c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d07f486b-58c6-46c0-a496-37be1995d21c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d07f486b-58c6-46c0-a496-37be1995d21c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d07f486b-58c6-46c0-a496-37be1995d21c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"634fa930-5048-4f50-bbdd-066fae7a1b52","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"634fa930-5048-4f50-bbdd-066fae7a1b52","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d07f486b-58c6-46c0-a496-37be1995d21c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d07f486b-58c6-46c0-a496-37be1995d21c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d07f486b-58c6-46c0-a496-37be1995d21c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d07f486b-58c6-46c0-a496-37be1995d21c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d07f486b-58c6-46c0-a496-37be1995d21c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d07f486b-58c6-46c0-a496-37be1995d21c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d07f486b-58c6-46c0-a496-37be1995d21c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"f16cf3a1-190a-4c22-bc6c-f8a7edd7a3ac"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"apply","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"f16cf3a1-190a-4c22-bc6c-f8a7edd7a3ac"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"f16cf3a1-190a-4c22-bc6c-f8a7edd7a3ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"f16cf3a1-190a-4c22-bc6c-f8a7edd7a3ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.initialize"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"f16cf3a1-190a-4c22-bc6c-f8a7edd7a3ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"63266919-6b9e-4339-a8c3-ceb410d447df"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"63266919-6b9e-4339-a8c3-ceb410d447df"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"63266919-6b9e-4339-a8c3-ceb410d447df","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"63266919-6b9e-4339-a8c3-ceb410d447df","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"63266919-6b9e-4339-a8c3-ceb410d447df","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"63266919-6b9e-4339-a8c3-ceb410d447df","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"reconcile","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"9ce4d304-f7f1-4c40-bd40-d8e85b7979f9"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"apply","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"9ce4d304-f7f1-4c40-bd40-d8e85b7979f9"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"9ce4d304-f7f1-4c40-bd40-d8e85b7979f9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/sanitycheck.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"9ce4d304-f7f1-4c40-bd40-d8e85b7979f9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ray.initialize"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"9ce4d304-f7f1-4c40-bd40-d8e85b7979f9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"9ce4d304-f7f1-4c40-bd40-d8e85b7979f9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"reconcile","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a7c4e836-4831-457e-a53f-aa5251c015d8"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"apply","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a7c4e836-4831-457e-a53f-aa5251c015d8"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a7c4e836-4831-457e-a53f-aa5251c015d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.initialize"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a7c4e836-4831-457e-a53f-aa5251c015d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.customizeManifests"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a7c4e836-4831-457e-a53f-aa5251c015d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a7c4e836-4831-457e-a53f-aa5251c015d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.configureDependencies"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a7c4e836-4831-457e-a53f-aa5251c015d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a7c4e836-4831-457e-a53f-aa5251c015d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a7c4e836-4831-457e-a53f-aa5251c015d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"9ce4d304-f7f1-4c40-bd40-d8e85b7979f9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a7c4e836-4831-457e-a53f-aa5251c015d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a7c4e836-4831-457e-a53f-aa5251c015d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.updateStatus"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a7c4e836-4831-457e-a53f-aa5251c015d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"a7c4e836-4831-457e-a53f-aa5251c015d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"reconcile","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8aa13322-a126-47c0-9b1d-add2c874b8d2"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"apply","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8aa13322-a126-47c0-9b1d-add2c874b8d2"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8aa13322-a126-47c0-9b1d-add2c874b8d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8aa13322-a126-47c0-9b1d-add2c874b8d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.initialize"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8aa13322-a126-47c0-9b1d-add2c874b8d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8aa13322-a126-47c0-9b1d-add2c874b8d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkJobSetCRD"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"63266919-6b9e-4339-a8c3-ceb410d447df","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"63266919-6b9e-4339-a8c3-ceb410d447df","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"63266919-6b9e-4339-a8c3-ceb410d447df","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8aa13322-a126-47c0-9b1d-add2c874b8d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8aa13322-a126-47c0-9b1d-add2c874b8d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"f16cf3a1-190a-4c22-bc6c-f8a7edd7a3ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"f16cf3a1-190a-4c22-bc6c-f8a7edd7a3ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"f16cf3a1-190a-4c22-bc6c-f8a7edd7a3ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageDefaultKueueResourcesAction"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"f16cf3a1-190a-4c22-bc6c-f8a7edd7a3ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding"} {"level":"info","ts":"2026-07-15T04:52:34Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding","msg":"Successfully managed kueue admin role binding","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"f16cf3a1-190a-4c22-bc6c-f8a7edd7a3ac","adminGroups":["rhods-admins"]} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"f16cf3a1-190a-4c22-bc6c-f8a7edd7a3ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8aa13322-a126-47c0-9b1d-add2c874b8d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"reconcile","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"1bfd1738-1d25-4b1b-9a7e-c281587e8702"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"apply","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"1bfd1738-1d25-4b1b-9a7e-c281587e8702"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"1bfd1738-1d25-4b1b-9a7e-c281587e8702","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.initialize"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"1bfd1738-1d25-4b1b-9a7e-c281587e8702","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"1bfd1738-1d25-4b1b-9a7e-c281587e8702","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.configureDependencies"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"1bfd1738-1d25-4b1b-9a7e-c281587e8702","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:52:34Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"2f5e2aab-38e5-4506-b245-9d653169d3c2","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"2f5e2aab-38e5-4506-b245-9d653169d3c2","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"60d1a0f1-1bd5-421c-9966-700748a04554"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"60d1a0f1-1bd5-421c-9966-700748a04554"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"60d1a0f1-1bd5-421c-9966-700748a04554","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"60d1a0f1-1bd5-421c-9966-700748a04554","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"60d1a0f1-1bd5-421c-9966-700748a04554","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:34Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"1bfd1738-1d25-4b1b-9a7e-c281587e8702","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8aa13322-a126-47c0-9b1d-add2c874b8d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8aa13322-a126-47c0-9b1d-add2c874b8d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8aa13322-a126-47c0-9b1d-add2c874b8d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"reconcile","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"2c031b68-f60e-4dd9-b094-623fdcc8905f"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"apply","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"2c031b68-f60e-4dd9-b094-623fdcc8905f"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"2c031b68-f60e-4dd9-b094-623fdcc8905f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.initialize"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"2c031b68-f60e-4dd9-b094-623fdcc8905f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"2c031b68-f60e-4dd9-b094-623fdcc8905f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"2c031b68-f60e-4dd9-b094-623fdcc8905f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"9ce4d304-f7f1-4c40-bd40-d8e85b7979f9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"9ce4d304-f7f1-4c40-bd40-d8e85b7979f9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"9ce4d304-f7f1-4c40-bd40-d8e85b7979f9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"2c031b68-f60e-4dd9-b094-623fdcc8905f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"reconcile","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"1555e786-c7d1-4430-972d-c640e23988fc"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"apply","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"1555e786-c7d1-4430-972d-c640e23988fc"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"1555e786-c7d1-4430-972d-c640e23988fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"1555e786-c7d1-4430-972d-c640e23988fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.initialize"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"1555e786-c7d1-4430-972d-c640e23988fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.argoWorkflowsControllersOptions"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"1555e786-c7d1-4430-972d-c640e23988fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"1555e786-c7d1-4430-972d-c640e23988fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"1555e786-c7d1-4430-972d-c640e23988fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"1555e786-c7d1-4430-972d-c640e23988fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"1555e786-c7d1-4430-972d-c640e23988fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"1555e786-c7d1-4430-972d-c640e23988fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"0239de23-fed5-45da-9a2e-de123857e7c5"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"0239de23-fed5-45da-9a2e-de123857e7c5"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"0239de23-fed5-45da-9a2e-de123857e7c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"0239de23-fed5-45da-9a2e-de123857e7c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.(*componentHandler).NewComponentReconciler.checkSubscriptionDependencies.func26"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"0239de23-fed5-45da-9a2e-de123857e7c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"0239de23-fed5-45da-9a2e-de123857e7c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"2c031b68-f60e-4dd9-b094-623fdcc8905f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"2c031b68-f60e-4dd9-b094-623fdcc8905f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"2c031b68-f60e-4dd9-b094-623fdcc8905f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"0239de23-fed5-45da-9a2e-de123857e7c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"0239de23-fed5-45da-9a2e-de123857e7c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"0239de23-fed5-45da-9a2e-de123857e7c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"reconcile","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"4f4fa67b-6d79-410a-9bd2-43469902ca4b"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"apply","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"4f4fa67b-6d79-410a-9bd2-43469902ca4b"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"4f4fa67b-6d79-410a-9bd2-43469902ca4b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainingoperator.initialize"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"4f4fa67b-6d79-410a-9bd2-43469902ca4b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"4f4fa67b-6d79-410a-9bd2-43469902ca4b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bcf4c213-c4c1-43c8-9246-91a981346ba1"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bcf4c213-c4c1-43c8-9246-91a981346ba1"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bcf4c213-c4c1-43c8-9246-91a981346ba1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bcf4c213-c4c1-43c8-9246-91a981346ba1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"f16cf3a1-190a-4c22-bc6c-f8a7edd7a3ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"60d1a0f1-1bd5-421c-9966-700748a04554","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"60d1a0f1-1bd5-421c-9966-700748a04554","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"60d1a0f1-1bd5-421c-9966-700748a04554","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"60d1a0f1-1bd5-421c-9966-700748a04554","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bcf4c213-c4c1-43c8-9246-91a981346ba1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bcf4c213-c4c1-43c8-9246-91a981346ba1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bcf4c213-c4c1-43c8-9246-91a981346ba1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:35Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bcf4c213-c4c1-43c8-9246-91a981346ba1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:36Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"4f4fa67b-6d79-410a-9bd2-43469902ca4b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:36Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"4f4fa67b-6d79-410a-9bd2-43469902ca4b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:36Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"4f4fa67b-6d79-410a-9bd2-43469902ca4b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:36Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"60d1a0f1-1bd5-421c-9966-700748a04554","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T04:52:36Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"60d1a0f1-1bd5-421c-9966-700748a04554","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T04:52:36Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"60d1a0f1-1bd5-421c-9966-700748a04554","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"60d1a0f1-1bd5-421c-9966-700748a04554","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"60d1a0f1-1bd5-421c-9966-700748a04554","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"60d1a0f1-1bd5-421c-9966-700748a04554","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"60d1a0f1-1bd5-421c-9966-700748a04554","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"634fa930-5048-4f50-bbdd-066fae7a1b52","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6832c494-ba2a-4eca-acda-24d39636f64e"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6832c494-ba2a-4eca-acda-24d39636f64e"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6832c494-ba2a-4eca-acda-24d39636f64e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6832c494-ba2a-4eca-acda-24d39636f64e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6832c494-ba2a-4eca-acda-24d39636f64e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6832c494-ba2a-4eca-acda-24d39636f64e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6832c494-ba2a-4eca-acda-24d39636f64e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef887e0f-9118-4119-a48d-bc28fb2e1358"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef887e0f-9118-4119-a48d-bc28fb2e1358"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef887e0f-9118-4119-a48d-bc28fb2e1358","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef887e0f-9118-4119-a48d-bc28fb2e1358","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef887e0f-9118-4119-a48d-bc28fb2e1358","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef887e0f-9118-4119-a48d-bc28fb2e1358","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef887e0f-9118-4119-a48d-bc28fb2e1358","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef887e0f-9118-4119-a48d-bc28fb2e1358","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef887e0f-9118-4119-a48d-bc28fb2e1358","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef887e0f-9118-4119-a48d-bc28fb2e1358","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef887e0f-9118-4119-a48d-bc28fb2e1358","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef887e0f-9118-4119-a48d-bc28fb2e1358","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef887e0f-9118-4119-a48d-bc28fb2e1358","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef887e0f-9118-4119-a48d-bc28fb2e1358","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef887e0f-9118-4119-a48d-bc28fb2e1358","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef887e0f-9118-4119-a48d-bc28fb2e1358","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef887e0f-9118-4119-a48d-bc28fb2e1358","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef887e0f-9118-4119-a48d-bc28fb2e1358","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6832c494-ba2a-4eca-acda-24d39636f64e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:37Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"d8a4d310-babb-42e0-8b0f-8787442e2ee4","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"d8a4d310-babb-42e0-8b0f-8787442e2ee4","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"1bfd1738-1d25-4b1b-9a7e-c281587e8702","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6832c494-ba2a-4eca-acda-24d39636f64e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"1bfd1738-1d25-4b1b-9a7e-c281587e8702","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"1bfd1738-1d25-4b1b-9a7e-c281587e8702","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/imagestreams.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"1bfd1738-1d25-4b1b-9a7e-c281587e8702","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.updateStatus"} {"level":"info","ts":"2026-07-15T04:52:37Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"1bfd1738-1d25-4b1b-9a7e-c281587e8702","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"f16cf3a1-190a-4c22-bc6c-f8a7edd7a3ac"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"f16cf3a1-190a-4c22-bc6c-f8a7edd7a3ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Starting EventSource","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Starting EventSource","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Starting EventSource","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T04:52:38Z","logger":"controller-runtime.cache","msg":"Warning: This version is deprecated. Use v1beta2 instead."} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Starting EventSource","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Starting EventSource","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Starting EventSource","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Starting EventSource","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-15T04:52:38Z","logger":"controller-runtime.cache","msg":"Warning: This version is deprecated. Use v1beta2 instead."} {"level":"info","ts":"2026-07-15T04:52:38Z","logger":"controller-runtime.cache","msg":"Warning: This version is deprecated. Use v1beta2 instead."} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"38c75486-44a7-4ed1-9f5f-bc9de5a13871"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c48ba10c-230c-44b6-b2c0-be84b21c4590"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"apply","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"38c75486-44a7-4ed1-9f5f-bc9de5a13871"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"38c75486-44a7-4ed1-9f5f-bc9de5a13871","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c48ba10c-230c-44b6-b2c0-be84b21c4590"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c48ba10c-230c-44b6-b2c0-be84b21c4590","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c48ba10c-230c-44b6-b2c0-be84b21c4590","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"38c75486-44a7-4ed1-9f5f-bc9de5a13871","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.initialize"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"38c75486-44a7-4ed1-9f5f-bc9de5a13871","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"38c75486-44a7-4ed1-9f5f-bc9de5a13871","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"38c75486-44a7-4ed1-9f5f-bc9de5a13871","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"38c75486-44a7-4ed1-9f5f-bc9de5a13871","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageDefaultKueueResourcesAction"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c48ba10c-230c-44b6-b2c0-be84b21c4590","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c48ba10c-230c-44b6-b2c0-be84b21c4590","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c48ba10c-230c-44b6-b2c0-be84b21c4590","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"38c75486-44a7-4ed1-9f5f-bc9de5a13871","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding"} {"level":"info","ts":"2026-07-15T04:52:38Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding","msg":"Successfully managed kueue admin role binding","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"38c75486-44a7-4ed1-9f5f-bc9de5a13871","adminGroups":["rhods-admins"]} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"38c75486-44a7-4ed1-9f5f-bc9de5a13871","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c48ba10c-230c-44b6-b2c0-be84b21c4590","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"38c75486-44a7-4ed1-9f5f-bc9de5a13871","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"38c75486-44a7-4ed1-9f5f-bc9de5a13871","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"38c75486-44a7-4ed1-9f5f-bc9de5a13871","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.configureClusterQueueViewerRoleAction"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"38c75486-44a7-4ed1-9f5f-bc9de5a13871","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"38c75486-44a7-4ed1-9f5f-bc9de5a13871","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c48ba10c-230c-44b6-b2c0-be84b21c4590","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b5a6e459-beb4-45c8-ac86-ab6924300dae"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b5a6e459-beb4-45c8-ac86-ab6924300dae"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b5a6e459-beb4-45c8-ac86-ab6924300dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b5a6e459-beb4-45c8-ac86-ab6924300dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b5a6e459-beb4-45c8-ac86-ab6924300dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43856999-a0cd-43be-8bec-e9b0ed32c16b"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43856999-a0cd-43be-8bec-e9b0ed32c16b"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43856999-a0cd-43be-8bec-e9b0ed32c16b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43856999-a0cd-43be-8bec-e9b0ed32c16b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43856999-a0cd-43be-8bec-e9b0ed32c16b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43856999-a0cd-43be-8bec-e9b0ed32c16b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b5a6e459-beb4-45c8-ac86-ab6924300dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43856999-a0cd-43be-8bec-e9b0ed32c16b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43856999-a0cd-43be-8bec-e9b0ed32c16b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43856999-a0cd-43be-8bec-e9b0ed32c16b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43856999-a0cd-43be-8bec-e9b0ed32c16b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43856999-a0cd-43be-8bec-e9b0ed32c16b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b5a6e459-beb4-45c8-ac86-ab6924300dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b5a6e459-beb4-45c8-ac86-ab6924300dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43856999-a0cd-43be-8bec-e9b0ed32c16b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43856999-a0cd-43be-8bec-e9b0ed32c16b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43856999-a0cd-43be-8bec-e9b0ed32c16b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43856999-a0cd-43be-8bec-e9b0ed32c16b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43856999-a0cd-43be-8bec-e9b0ed32c16b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43856999-a0cd-43be-8bec-e9b0ed32c16b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43856999-a0cd-43be-8bec-e9b0ed32c16b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bcf4c213-c4c1-43c8-9246-91a981346ba1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bcf4c213-c4c1-43c8-9246-91a981346ba1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bcf4c213-c4c1-43c8-9246-91a981346ba1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bcf4c213-c4c1-43c8-9246-91a981346ba1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"bcf4c213-c4c1-43c8-9246-91a981346ba1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"1bfd1738-1d25-4b1b-9a7e-c281587e8702"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b5a6e459-beb4-45c8-ac86-ab6924300dae","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"0c94bc49-9b7a-4fd9-a74d-f03808049b3e","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"0c94bc49-9b7a-4fd9-a74d-f03808049b3e","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1e710641-bd6f-4d6f-b034-19ba09e43a1c"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1e710641-bd6f-4d6f-b034-19ba09e43a1c"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1e710641-bd6f-4d6f-b034-19ba09e43a1c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1e710641-bd6f-4d6f-b034-19ba09e43a1c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1e710641-bd6f-4d6f-b034-19ba09e43a1c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1e710641-bd6f-4d6f-b034-19ba09e43a1c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1e710641-bd6f-4d6f-b034-19ba09e43a1c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1e710641-bd6f-4d6f-b034-19ba09e43a1c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"1bfd1738-1d25-4b1b-9a7e-c281587e8702","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1e710641-bd6f-4d6f-b034-19ba09e43a1c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6a6c43fb-6ada-40ba-8f39-0e1646555ca7"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6a6c43fb-6ada-40ba-8f39-0e1646555ca7"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6a6c43fb-6ada-40ba-8f39-0e1646555ca7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6a6c43fb-6ada-40ba-8f39-0e1646555ca7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6a6c43fb-6ada-40ba-8f39-0e1646555ca7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6a6c43fb-6ada-40ba-8f39-0e1646555ca7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6a6c43fb-6ada-40ba-8f39-0e1646555ca7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6a6c43fb-6ada-40ba-8f39-0e1646555ca7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6a6c43fb-6ada-40ba-8f39-0e1646555ca7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:44Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-ns-zvxhj","reconcileID":"4fcfa9c6-4688-4ee6-be7d-6acd83f481a3"} {"level":"info","ts":"2026-07-15T04:52:44Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-ns-zvxhj","reconcileID":"3183ebb0-0959-4c28-b80a-4aa73a483e2b"} {"level":"info","ts":"2026-07-15T04:52:45Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-ns-zvxhj","reconcileID":"26d3d241-893a-4677-b510-c9e562546736"} {"level":"info","ts":"2026-07-15T04:52:45Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-ns-x2tl5","reconcileID":"2d2b2b04-48bb-4189-8978-6f2be56b4073"} {"level":"info","ts":"2026-07-15T04:52:45Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-ns-x2tl5","reconcileID":"38be2b04-5633-4fab-8e74-aad680a11729"} {"level":"info","ts":"2026-07-15T04:52:45Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-ns-x2tl5","reconcileID":"20923dc3-6d76-4167-9a1c-eec1718b8c1b"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"ee095034-f41d-49c8-9850-a6e4d8847f2d"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"apply","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"ee095034-f41d-49c8-9850-a6e4d8847f2d"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"ee095034-f41d-49c8-9850-a6e4d8847f2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"ee095034-f41d-49c8-9850-a6e4d8847f2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.initialize"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"ee095034-f41d-49c8-9850-a6e4d8847f2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"ee095034-f41d-49c8-9850-a6e4d8847f2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"ee095034-f41d-49c8-9850-a6e4d8847f2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"ee095034-f41d-49c8-9850-a6e4d8847f2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageDefaultKueueResourcesAction"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"ee095034-f41d-49c8-9850-a6e4d8847f2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding"} {"level":"info","ts":"2026-07-15T04:52:47Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding","msg":"Successfully managed kueue admin role binding","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"ee095034-f41d-49c8-9850-a6e4d8847f2d","adminGroups":["rhods-admins"]} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"ee095034-f41d-49c8-9850-a6e4d8847f2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"ee095034-f41d-49c8-9850-a6e4d8847f2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"ee095034-f41d-49c8-9850-a6e4d8847f2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"ee095034-f41d-49c8-9850-a6e4d8847f2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.configureClusterQueueViewerRoleAction"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"ee095034-f41d-49c8-9850-a6e4d8847f2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"ee095034-f41d-49c8-9850-a6e4d8847f2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"21a4d085-f3c9-4000-bf51-e7fd7cee9a78"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"21a4d085-f3c9-4000-bf51-e7fd7cee9a78"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"21a4d085-f3c9-4000-bf51-e7fd7cee9a78","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"21a4d085-f3c9-4000-bf51-e7fd7cee9a78","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a56bf9f3-3835-47a4-be53-5f0ebe859d61"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"apply","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a56bf9f3-3835-47a4-be53-5f0ebe859d61"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a56bf9f3-3835-47a4-be53-5f0ebe859d61","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"21a4d085-f3c9-4000-bf51-e7fd7cee9a78","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a56bf9f3-3835-47a4-be53-5f0ebe859d61","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.initialize"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a56bf9f3-3835-47a4-be53-5f0ebe859d61","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a56bf9f3-3835-47a4-be53-5f0ebe859d61","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a56bf9f3-3835-47a4-be53-5f0ebe859d61","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a56bf9f3-3835-47a4-be53-5f0ebe859d61","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageDefaultKueueResourcesAction"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"21a4d085-f3c9-4000-bf51-e7fd7cee9a78","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"21a4d085-f3c9-4000-bf51-e7fd7cee9a78","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a56bf9f3-3835-47a4-be53-5f0ebe859d61","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding"} {"level":"info","ts":"2026-07-15T04:52:47Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding","msg":"Successfully managed kueue admin role binding","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a56bf9f3-3835-47a4-be53-5f0ebe859d61","adminGroups":["rhods-admins"]} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a56bf9f3-3835-47a4-be53-5f0ebe859d61","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"21a4d085-f3c9-4000-bf51-e7fd7cee9a78","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a56bf9f3-3835-47a4-be53-5f0ebe859d61","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a56bf9f3-3835-47a4-be53-5f0ebe859d61","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a56bf9f3-3835-47a4-be53-5f0ebe859d61","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.configureClusterQueueViewerRoleAction"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a56bf9f3-3835-47a4-be53-5f0ebe859d61","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a56bf9f3-3835-47a4-be53-5f0ebe859d61","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"21a4d085-f3c9-4000-bf51-e7fd7cee9a78","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"06dbfeb4-3494-4413-8cb8-31024bd60458"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"06dbfeb4-3494-4413-8cb8-31024bd60458"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"06dbfeb4-3494-4413-8cb8-31024bd60458","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"06dbfeb4-3494-4413-8cb8-31024bd60458","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6d5d46aa-a8d6-4a11-8f75-954a8c273f21"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6d5d46aa-a8d6-4a11-8f75-954a8c273f21"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6d5d46aa-a8d6-4a11-8f75-954a8c273f21","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"06dbfeb4-3494-4413-8cb8-31024bd60458","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6d5d46aa-a8d6-4a11-8f75-954a8c273f21","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6d5d46aa-a8d6-4a11-8f75-954a8c273f21","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6d5d46aa-a8d6-4a11-8f75-954a8c273f21","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6d5d46aa-a8d6-4a11-8f75-954a8c273f21","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6d5d46aa-a8d6-4a11-8f75-954a8c273f21","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6d5d46aa-a8d6-4a11-8f75-954a8c273f21","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6d5d46aa-a8d6-4a11-8f75-954a8c273f21","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6d5d46aa-a8d6-4a11-8f75-954a8c273f21","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"06dbfeb4-3494-4413-8cb8-31024bd60458","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"06dbfeb4-3494-4413-8cb8-31024bd60458","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6d5d46aa-a8d6-4a11-8f75-954a8c273f21","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6d5d46aa-a8d6-4a11-8f75-954a8c273f21","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6d5d46aa-a8d6-4a11-8f75-954a8c273f21","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6d5d46aa-a8d6-4a11-8f75-954a8c273f21","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6d5d46aa-a8d6-4a11-8f75-954a8c273f21","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6d5d46aa-a8d6-4a11-8f75-954a8c273f21","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6d5d46aa-a8d6-4a11-8f75-954a8c273f21","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"0a1046e3-57af-45c7-8803-2622d0154af5"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"0a1046e3-57af-45c7-8803-2622d0154af5"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"0a1046e3-57af-45c7-8803-2622d0154af5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"0a1046e3-57af-45c7-8803-2622d0154af5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"0a1046e3-57af-45c7-8803-2622d0154af5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"0a1046e3-57af-45c7-8803-2622d0154af5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"reconcile","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"83c1ff7e-4548-4b59-96ae-0a85bf313be3"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"apply","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"83c1ff7e-4548-4b59-96ae-0a85bf313be3"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"83c1ff7e-4548-4b59-96ae-0a85bf313be3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/sanitycheck.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"83c1ff7e-4548-4b59-96ae-0a85bf313be3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ray.initialize"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"83c1ff7e-4548-4b59-96ae-0a85bf313be3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"83c1ff7e-4548-4b59-96ae-0a85bf313be3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"reconcile","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"6cb2bdd9-56d7-4b67-a52f-2b245d47f6c6"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"apply","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"6cb2bdd9-56d7-4b67-a52f-2b245d47f6c6"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"6cb2bdd9-56d7-4b67-a52f-2b245d47f6c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.initialize"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"6cb2bdd9-56d7-4b67-a52f-2b245d47f6c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.customizeManifests"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"6cb2bdd9-56d7-4b67-a52f-2b245d47f6c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"6cb2bdd9-56d7-4b67-a52f-2b245d47f6c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.configureDependencies"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"6cb2bdd9-56d7-4b67-a52f-2b245d47f6c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"6cb2bdd9-56d7-4b67-a52f-2b245d47f6c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"6cb2bdd9-56d7-4b67-a52f-2b245d47f6c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"83c1ff7e-4548-4b59-96ae-0a85bf313be3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"6cb2bdd9-56d7-4b67-a52f-2b245d47f6c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"6cb2bdd9-56d7-4b67-a52f-2b245d47f6c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.updateStatus"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"6cb2bdd9-56d7-4b67-a52f-2b245d47f6c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"6cb2bdd9-56d7-4b67-a52f-2b245d47f6c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"reconcile","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8c278bfd-8b70-4051-9f1e-2b1155d53569"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"apply","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8c278bfd-8b70-4051-9f1e-2b1155d53569"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8c278bfd-8b70-4051-9f1e-2b1155d53569","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8c278bfd-8b70-4051-9f1e-2b1155d53569","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.initialize"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8c278bfd-8b70-4051-9f1e-2b1155d53569","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8c278bfd-8b70-4051-9f1e-2b1155d53569","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkJobSetCRD"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8c278bfd-8b70-4051-9f1e-2b1155d53569","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8c278bfd-8b70-4051-9f1e-2b1155d53569","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8c278bfd-8b70-4051-9f1e-2b1155d53569","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"reconcile","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ece6d76e-4ac7-4908-b567-affe93b43f76"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"apply","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ece6d76e-4ac7-4908-b567-affe93b43f76"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ece6d76e-4ac7-4908-b567-affe93b43f76","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.initialize"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ece6d76e-4ac7-4908-b567-affe93b43f76","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ece6d76e-4ac7-4908-b567-affe93b43f76","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.configureDependencies"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ece6d76e-4ac7-4908-b567-affe93b43f76","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8c278bfd-8b70-4051-9f1e-2b1155d53569","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ece6d76e-4ac7-4908-b567-affe93b43f76","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ec719ee6-5e00-4965-ada2-24a9aa7d6138"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ec719ee6-5e00-4965-ada2-24a9aa7d6138"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ec719ee6-5e00-4965-ada2-24a9aa7d6138","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ec719ee6-5e00-4965-ada2-24a9aa7d6138","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ec719ee6-5e00-4965-ada2-24a9aa7d6138","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*SubscriptionAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"reconcile","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"2c488586-ebef-405e-b529-ff660ad29900"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"apply","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"2c488586-ebef-405e-b529-ff660ad29900"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"2c488586-ebef-405e-b529-ff660ad29900","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.initialize"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"2c488586-ebef-405e-b529-ff660ad29900","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"2c488586-ebef-405e-b529-ff660ad29900","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"2c488586-ebef-405e-b529-ff660ad29900","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"2c488586-ebef-405e-b529-ff660ad29900","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"0a1046e3-57af-45c7-8803-2622d0154af5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"0a1046e3-57af-45c7-8803-2622d0154af5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"0a1046e3-57af-45c7-8803-2622d0154af5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"reconcile","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"6c6d1b63-9014-4fae-975d-cef7da3b2e4c"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"apply","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"6c6d1b63-9014-4fae-975d-cef7da3b2e4c"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"6c6d1b63-9014-4fae-975d-cef7da3b2e4c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:52:47Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"6c6d1b63-9014-4fae-975d-cef7da3b2e4c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.initialize"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"f9fc44de-8b8f-40bf-930b-dcf94824cc8c"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"f9fc44de-8b8f-40bf-930b-dcf94824cc8c"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"f9fc44de-8b8f-40bf-930b-dcf94824cc8c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"f9fc44de-8b8f-40bf-930b-dcf94824cc8c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.(*componentHandler).NewComponentReconciler.checkSubscriptionDependencies.func26"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"f9fc44de-8b8f-40bf-930b-dcf94824cc8c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"f9fc44de-8b8f-40bf-930b-dcf94824cc8c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"reconcile","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"df450d5b-a8f5-4126-8d33-0c8019855695"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"apply","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"df450d5b-a8f5-4126-8d33-0c8019855695"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"df450d5b-a8f5-4126-8d33-0c8019855695","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainingoperator.initialize"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"df450d5b-a8f5-4126-8d33-0c8019855695","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"df450d5b-a8f5-4126-8d33-0c8019855695","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"6c6d1b63-9014-4fae-975d-cef7da3b2e4c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"6c6d1b63-9014-4fae-975d-cef7da3b2e4c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"6c6d1b63-9014-4fae-975d-cef7da3b2e4c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"06dbfeb4-3494-4413-8cb8-31024bd60458","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"c876692e-c3de-4f64-96d4-ed354fdccbc1"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"c876692e-c3de-4f64-96d4-ed354fdccbc1"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"c876692e-c3de-4f64-96d4-ed354fdccbc1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"c876692e-c3de-4f64-96d4-ed354fdccbc1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"df450d5b-a8f5-4126-8d33-0c8019855695","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"83c1ff7e-4548-4b59-96ae-0a85bf313be3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"83c1ff7e-4548-4b59-96ae-0a85bf313be3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"83c1ff7e-4548-4b59-96ae-0a85bf313be3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8c278bfd-8b70-4051-9f1e-2b1155d53569","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"8c278bfd-8b70-4051-9f1e-2b1155d53569","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"2c488586-ebef-405e-b529-ff660ad29900","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"2c488586-ebef-405e-b529-ff660ad29900","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"2c488586-ebef-405e-b529-ff660ad29900","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"f9fc44de-8b8f-40bf-930b-dcf94824cc8c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"f9fc44de-8b8f-40bf-930b-dcf94824cc8c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"f9fc44de-8b8f-40bf-930b-dcf94824cc8c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8cda85c4-e8b7-473f-b90a-1d24c1f02ebd","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8cda85c4-e8b7-473f-b90a-1d24c1f02ebd","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ec719ee6-5e00-4965-ada2-24a9aa7d6138","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ec719ee6-5e00-4965-ada2-24a9aa7d6138","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ec719ee6-5e00-4965-ada2-24a9aa7d6138","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ec719ee6-5e00-4965-ada2-24a9aa7d6138","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"c876692e-c3de-4f64-96d4-ed354fdccbc1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"c876692e-c3de-4f64-96d4-ed354fdccbc1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"c876692e-c3de-4f64-96d4-ed354fdccbc1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"c876692e-c3de-4f64-96d4-ed354fdccbc1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ec719ee6-5e00-4965-ada2-24a9aa7d6138","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ec719ee6-5e00-4965-ada2-24a9aa7d6138","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ec719ee6-5e00-4965-ada2-24a9aa7d6138","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"df450d5b-a8f5-4126-8d33-0c8019855695","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"df450d5b-a8f5-4126-8d33-0c8019855695","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"df450d5b-a8f5-4126-8d33-0c8019855695","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"delete","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"06dbfeb4-3494-4413-8cb8-31024bd60458","gvk":"components.platform.opendatahub.io/v1alpha1, Kind=Kueue","ns":"","name":"default-kueue"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"31d1ecaf-8c75-469c-977a-d797e542681f"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"apply","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"31d1ecaf-8c75-469c-977a-d797e542681f"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"31d1ecaf-8c75-469c-977a-d797e542681f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"31d1ecaf-8c75-469c-977a-d797e542681f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.initialize"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"31d1ecaf-8c75-469c-977a-d797e542681f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dependency.(*action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"31d1ecaf-8c75-469c-977a-d797e542681f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"31d1ecaf-8c75-469c-977a-d797e542681f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"31d1ecaf-8c75-469c-977a-d797e542681f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageDefaultKueueResourcesAction"} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"31d1ecaf-8c75-469c-977a-d797e542681f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding"} {"level":"info","ts":"2026-07-15T04:52:48Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding","msg":"Successfully managed kueue admin role binding","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"31d1ecaf-8c75-469c-977a-d797e542681f","adminGroups":["rhods-admins"]} {"level":"info","ts":"2026-07-15T04:52:48Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"31d1ecaf-8c75-469c-977a-d797e542681f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:49Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"31d1ecaf-8c75-469c-977a-d797e542681f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:49Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"31d1ecaf-8c75-469c-977a-d797e542681f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-15T04:52:49Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"31d1ecaf-8c75-469c-977a-d797e542681f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.configureClusterQueueViewerRoleAction"} {"level":"info","ts":"2026-07-15T04:52:49Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"31d1ecaf-8c75-469c-977a-d797e542681f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:49Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"31d1ecaf-8c75-469c-977a-d797e542681f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:49Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"ab3865e7-214e-4a47-aa0b-9162ccb24817"} {"level":"info","ts":"2026-07-15T04:52:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ec719ee6-5e00-4965-ada2-24a9aa7d6138","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-15T04:52:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ec719ee6-5e00-4965-ada2-24a9aa7d6138","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ec719ee6-5e00-4965-ada2-24a9aa7d6138","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:49Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ec719ee6-5e00-4965-ada2-24a9aa7d6138","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"06dbfeb4-3494-4413-8cb8-31024bd60458","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"54144c07-a3ee-4ed5-bf18-8420640ee0ed"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"54144c07-a3ee-4ed5-bf18-8420640ee0ed"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"54144c07-a3ee-4ed5-bf18-8420640ee0ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"54144c07-a3ee-4ed5-bf18-8420640ee0ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"54144c07-a3ee-4ed5-bf18-8420640ee0ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"54144c07-a3ee-4ed5-bf18-8420640ee0ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"54144c07-a3ee-4ed5-bf18-8420640ee0ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"54144c07-a3ee-4ed5-bf18-8420640ee0ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"54144c07-a3ee-4ed5-bf18-8420640ee0ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"54144c07-a3ee-4ed5-bf18-8420640ee0ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"54144c07-a3ee-4ed5-bf18-8420640ee0ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b6c6112a-5187-4172-b0a3-5824e6aeaec7"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b6c6112a-5187-4172-b0a3-5824e6aeaec7"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b6c6112a-5187-4172-b0a3-5824e6aeaec7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b6c6112a-5187-4172-b0a3-5824e6aeaec7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b6c6112a-5187-4172-b0a3-5824e6aeaec7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b6c6112a-5187-4172-b0a3-5824e6aeaec7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b6c6112a-5187-4172-b0a3-5824e6aeaec7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"54144c07-a3ee-4ed5-bf18-8420640ee0ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"54144c07-a3ee-4ed5-bf18-8420640ee0ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"54144c07-a3ee-4ed5-bf18-8420640ee0ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"54144c07-a3ee-4ed5-bf18-8420640ee0ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"54144c07-a3ee-4ed5-bf18-8420640ee0ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"54144c07-a3ee-4ed5-bf18-8420640ee0ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"54144c07-a3ee-4ed5-bf18-8420640ee0ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b6c6112a-5187-4172-b0a3-5824e6aeaec7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:50Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"87da9b06-9316-401a-89dd-1b77e856f6ed","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"87da9b06-9316-401a-89dd-1b77e856f6ed","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b6c6112a-5187-4172-b0a3-5824e6aeaec7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ece6d76e-4ac7-4908-b567-affe93b43f76","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ece6d76e-4ac7-4908-b567-affe93b43f76","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ece6d76e-4ac7-4908-b567-affe93b43f76","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/imagestreams.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ece6d76e-4ac7-4908-b567-affe93b43f76","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.updateStatus"} {"level":"info","ts":"2026-07-15T04:52:50Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ece6d76e-4ac7-4908-b567-affe93b43f76","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"c876692e-c3de-4f64-96d4-ed354fdccbc1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"c876692e-c3de-4f64-96d4-ed354fdccbc1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"c876692e-c3de-4f64-96d4-ed354fdccbc1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"c876692e-c3de-4f64-96d4-ed354fdccbc1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"c876692e-c3de-4f64-96d4-ed354fdccbc1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7fc11294-18e3-4b80-b94f-a5db5c74fe65"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7fc11294-18e3-4b80-b94f-a5db5c74fe65"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7fc11294-18e3-4b80-b94f-a5db5c74fe65","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7fc11294-18e3-4b80-b94f-a5db5c74fe65","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7fc11294-18e3-4b80-b94f-a5db5c74fe65","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7fc11294-18e3-4b80-b94f-a5db5c74fe65","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7fc11294-18e3-4b80-b94f-a5db5c74fe65","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7fc11294-18e3-4b80-b94f-a5db5c74fe65","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7fc11294-18e3-4b80-b94f-a5db5c74fe65","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:51Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ece6d76e-4ac7-4908-b567-affe93b43f76"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"ece6d76e-4ac7-4908-b567-affe93b43f76","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ad68c56e-7c5d-4fc5-884d-c5ebcbb88fc2"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ad68c56e-7c5d-4fc5-884d-c5ebcbb88fc2"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ad68c56e-7c5d-4fc5-884d-c5ebcbb88fc2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ad68c56e-7c5d-4fc5-884d-c5ebcbb88fc2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ad68c56e-7c5d-4fc5-884d-c5ebcbb88fc2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ad68c56e-7c5d-4fc5-884d-c5ebcbb88fc2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ad68c56e-7c5d-4fc5-884d-c5ebcbb88fc2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ad68c56e-7c5d-4fc5-884d-c5ebcbb88fc2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-15T04:52:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ad68c56e-7c5d-4fc5-884d-c5ebcbb88fc2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} ==================== OPERATOR POD LOG: rhods-operator-bc98955f6-mp7fj.log ==================== {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"Cluster config","Operator Namespace":"redhat-ods-operator","Application Namespace":"redhat-ods-applications","Release":{"name":"OpenShift AI Self-Managed","version":"3.5.0-ea.1"},"Cluster":{"type":"OpenShift","version":"4.21.24"}} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/convert"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"datasciencecluster.opendatahub.io/v1, Kind=DataScienceCluster"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"dscinitialization.opendatahub.io/v1, Kind=DSCInitialization"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v1"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v2"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-hardware-profile"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-prometheus-monitors"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-isvc"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-llmisvc"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-notebook"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-acceleratorprofile"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-hardwareprofile"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"service","name":"gateway"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"service","name":"monitoring"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"service","name":"setupcontroller"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"service","name":"auth"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"service","name":"certconfigmapgenerator"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"ogx"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"mlflowoperator"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"datasciencepipelines"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"sparkoperator"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"modelcontroller"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"trustyai"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"modelsasservice"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"trainer"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"trainingoperator"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"dashboard"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"feastoperator"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"kserve"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"kueue"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"workbenches"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"modelregistry"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"creating reconciler","type":"component","name":"ray"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"starting manager"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.metrics","msg":"Starting metrics server"} {"level":"info","ts":"2026-07-15T03:57:32Z","msg":"starting server","name":"health probe","addr":"[::]:8081"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.metrics","msg":"Serving metrics server","bindAddress":"0.0.0.0:8080","secure":false} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Starting webhook server"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.webhook","msg":"Serving webhook server","host":"","port":9443} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} {"level":"info","ts":"2026-07-15T03:57:32Z","logger":"setup","msg":"Attempting to acquire leader lease...","lock":"redhat-ods-operator/07ed84f7.opendatahub.io"} ==================== WORKLOAD POD LOG: redhat-ods-applications/dashboard-redirect-79f47cdbd-24fvn.log ==================== 2026/07/15 03:58:03 [notice] 1#1: using the "epoll" event method 2026/07/15 03:58:03 [notice] 1#1: nginx/1.26.3 2026/07/15 03:58:03 [notice] 1#1: built by gcc 11.5.0 20240719 (Red Hat 11.5.0-14) (GCC) 2026/07/15 03:58:03 [notice] 1#1: OS: Linux 5.14.0-570.126.1.el9_6.x86_64 2026/07/15 03:58:03 [notice] 1#1: getrlimit(RLIMIT_NOFILE): 1024:524288 2026/07/15 03:58:03 [notice] 1#1: start worker processes 2026/07/15 03:58:03 [notice] 1#1: start worker process 12 2026/07/15 03:58:03 [notice] 1#1: start worker process 13 ==================== WORKLOAD POD LOG: redhat-ods-applications/data-science-pipelines-operator-controller-manager-99b5876tr82d.log ==================== 2026-07-15T03:58:12Z INFO setup starting manager 2026-07-15T03:58:12Z INFO controller-runtime.metrics Starting metrics server 2026-07-15T03:58:12Z INFO starting server {"name": "health probe", "addr": "[::]:8081"} 2026-07-15T03:58:12Z INFO controller-runtime.metrics Serving metrics server {"bindAddress": ":8080", "secure": false} I0715 03:58:12.659465 1 leaderelection.go:258] "Attempting to acquire leader lease..." lock="redhat-ods-applications/f9eb95d5.opendatahub.io" I0715 03:58:12.669742 1 leaderelection.go:272] "Successfully acquired lease" lock="redhat-ods-applications/f9eb95d5.opendatahub.io" 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "datasciencepipelinesapplication", "controllerGroup": "datasciencepipelinesapplications.opendatahub.io", "controllerKind": "DataSciencePipelinesApplication", "source": "kind source: *v1.Secret"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "datasciencepipelinesapplication", "controllerGroup": "datasciencepipelinesapplications.opendatahub.io", "controllerKind": "DataSciencePipelinesApplication", "source": "kind source: *v1.Deployment"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "datasciencepipelinesapplication", "controllerGroup": "datasciencepipelinesapplications.opendatahub.io", "controllerKind": "DataSciencePipelinesApplication", "source": "kind source: *v1.DataSciencePipelinesApplication"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "datasciencepipelinesapplication", "controllerGroup": "datasciencepipelinesapplications.opendatahub.io", "controllerKind": "DataSciencePipelinesApplication", "source": "kind source: *v1.Secret"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "datasciencepipelinesapplication", "controllerGroup": "datasciencepipelinesapplications.opendatahub.io", "controllerKind": "DataSciencePipelinesApplication", "source": "kind source: *v1.ConfigMap"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "datasciencepipelinesapplication", "controllerGroup": "datasciencepipelinesapplications.opendatahub.io", "controllerKind": "DataSciencePipelinesApplication", "source": "kind source: *v1.Role"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "datasciencepipelinesapplication", "controllerGroup": "datasciencepipelinesapplications.opendatahub.io", "controllerKind": "DataSciencePipelinesApplication", "source": "kind source: *v1.RoleBinding"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "datasciencepipelinesapplication", "controllerGroup": "datasciencepipelinesapplications.opendatahub.io", "controllerKind": "DataSciencePipelinesApplication", "source": "kind source: *v1.Route"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "datasciencepipelinesapplication", "controllerGroup": "datasciencepipelinesapplications.opendatahub.io", "controllerKind": "DataSciencePipelinesApplication", "source": "kind source: *v1.ConfigMap"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "datasciencepipelinesapplication", "controllerGroup": "datasciencepipelinesapplications.opendatahub.io", "controllerKind": "DataSciencePipelinesApplication", "source": "kind source: *v1.Pod"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "datasciencepipelinesapplication", "controllerGroup": "datasciencepipelinesapplications.opendatahub.io", "controllerKind": "DataSciencePipelinesApplication", "source": "kind source: *v1.Service"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "datasciencepipelinesapplication", "controllerGroup": "datasciencepipelinesapplications.opendatahub.io", "controllerKind": "DataSciencePipelinesApplication", "source": "kind source: *v1.ServiceAccount"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "datasciencepipelinesapplication", "controllerGroup": "datasciencepipelinesapplications.opendatahub.io", "controllerKind": "DataSciencePipelinesApplication", "source": "kind source: *v1.PersistentVolumeClaim"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "datasciencepipelinesapplication", "controllerGroup": "datasciencepipelinesapplications.opendatahub.io", "controllerKind": "DataSciencePipelinesApplication", "source": "kind source: *v1.NetworkPolicy"} 2026-07-15T03:58:12Z INFO Starting Controller {"controller": "datasciencepipelinesapplication", "controllerGroup": "datasciencepipelinesapplications.opendatahub.io", "controllerKind": "DataSciencePipelinesApplication"} 2026-07-15T03:58:12Z INFO Starting workers {"controller": "datasciencepipelinesapplication", "controllerGroup": "datasciencepipelinesapplications.opendatahub.io", "controllerKind": "DataSciencePipelinesApplication", "worker count": 10} ==================== WORKLOAD POD LOG: redhat-ods-applications/feast-operator-controller-manager-86c6459f75-g5nwp.log ==================== 2026-07-15T03:58:19Z INFO setup Notebook CRD validated successfully {"CRD": "notebooks.kubeflow.org", "GVK": "kubeflow.org/v1, Kind=Notebook"} 2026-07-15T03:58:19Z INFO setup Notebook ConfigMap controller setup completed successfully 2026-07-15T03:58:19Z INFO setup starting manager 2026-07-15T03:58:19Z INFO controller-runtime.metrics Starting metrics server 2026-07-15T03:58:19Z INFO setup disabling http/2 2026-07-15T03:58:19Z INFO starting server {"name": "health probe", "addr": "[::]:8081"} I0715 03:58:19.484530 1 leaderelection.go:257] attempting to acquire leader lease redhat-ods-applications/66483dbd.feast.dev... 2026-07-15T03:58:19Z INFO controller-runtime.metrics Serving metrics server {"bindAddress": ":8443", "secure": true} I0715 03:58:35.564378 1 leaderelection.go:271] successfully acquired lease redhat-ods-applications/66483dbd.feast.dev 2026-07-15T03:58:35Z DEBUG events feast-operator-controller-manager-86c6459f75-g5nwp_335da848-2004-4839-9eca-b65130ee60dc became leader {"type": "Normal", "object": {"kind":"Lease","namespace":"redhat-ods-applications","name":"66483dbd.feast.dev","uid":"3b017f65-d197-4537-a59f-1311f219e33a","apiVersion":"coordination.k8s.io/v1","resourceVersion":"29051"}, "reason": "LeaderElection"} 2026-07-15T03:58:35Z INFO Starting EventSource {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "source": "kind source: *v1.FeatureStore"} 2026-07-15T03:58:35Z INFO Starting EventSource {"controller": "featurestore", "controllerGroup": "feast.dev", "controllerKind": "FeatureStore", "source": "kind source: *v1.Deployment"} 2026-07-15T03:58:35Z INFO Starting EventSource {"controller": "featurestore", "controllerGroup": "feast.dev", "controllerKind": "FeatureStore", "source": "kind source: *v1.RoleBinding"} 2026-07-15T03:58:35Z INFO Starting EventSource {"controller": "featurestore", "controllerGroup": "feast.dev", "controllerKind": "FeatureStore", "source": "kind source: *v1.PodDisruptionBudget"} 2026-07-15T03:58:35Z INFO Starting EventSource {"controller": "featurestore", "controllerGroup": "feast.dev", "controllerKind": "FeatureStore", "source": "kind source: *v1.ConfigMap"} 2026-07-15T03:58:35Z INFO Starting EventSource {"controller": "featurestore", "controllerGroup": "feast.dev", "controllerKind": "FeatureStore", "source": "kind source: *v1.FeatureStore"} 2026-07-15T03:58:35Z INFO Starting EventSource {"controller": "featurestore", "controllerGroup": "feast.dev", "controllerKind": "FeatureStore", "source": "kind source: *v1.Service"} 2026-07-15T03:58:35Z INFO Starting EventSource {"controller": "featurestore", "controllerGroup": "feast.dev", "controllerKind": "FeatureStore", "source": "kind source: *v1.ServiceAccount"} 2026-07-15T03:58:35Z INFO Starting EventSource {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "source": "kind source: *unstructured.Unstructured"} 2026-07-15T03:58:35Z INFO Starting EventSource {"controller": "featurestore", "controllerGroup": "feast.dev", "controllerKind": "FeatureStore", "source": "kind source: *v1.FeatureStore"} 2026-07-15T03:58:35Z INFO Starting EventSource {"controller": "featurestore", "controllerGroup": "feast.dev", "controllerKind": "FeatureStore", "source": "kind source: *v1.Route"} 2026-07-15T03:58:35Z INFO Starting EventSource {"controller": "featurestore", "controllerGroup": "feast.dev", "controllerKind": "FeatureStore", "source": "kind source: *unstructured.Unstructured"} 2026-07-15T03:58:35Z INFO Starting EventSource {"controller": "featurestore", "controllerGroup": "feast.dev", "controllerKind": "FeatureStore", "source": "kind source: *v1.Role"} 2026-07-15T03:58:35Z INFO Starting EventSource {"controller": "featurestore", "controllerGroup": "feast.dev", "controllerKind": "FeatureStore", "source": "kind source: *v2.HorizontalPodAutoscaler"} 2026-07-15T03:58:35Z INFO Starting EventSource {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "source": "kind source: *v1.ConfigMap"} 2026-07-15T03:58:35Z INFO Starting EventSource {"controller": "featurestore", "controllerGroup": "feast.dev", "controllerKind": "FeatureStore", "source": "kind source: *v1.CronJob"} 2026-07-15T03:58:35Z INFO Starting EventSource {"controller": "featurestore", "controllerGroup": "feast.dev", "controllerKind": "FeatureStore", "source": "kind source: *v1.PersistentVolumeClaim"} 2026-07-15T03:58:35Z INFO Starting Controller {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook"} 2026-07-15T03:58:35Z INFO Starting workers {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "worker count": 1} 2026-07-15T03:58:35Z INFO Starting Controller {"controller": "featurestore", "controllerGroup": "feast.dev", "controllerKind": "FeatureStore"} 2026-07-15T03:58:35Z INFO Starting workers {"controller": "featurestore", "controllerGroup": "feast.dev", "controllerKind": "FeatureStore", "worker count": 1} ==================== WORKLOAD POD LOG: redhat-ods-applications/kserve-controller-manager-7747874bf-62j4m.log ==================== {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"setup","msg":"Setting up client for manager"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"setup","msg":"Setting up manager"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"setup","msg":"Registering Components."} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"setup","msg":"Setting up controller schemes"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"setup","msg":"Setting up v1beta1 controller"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"v1beta1Controllers.InferenceService","msg":"The InferenceService controller won't watch serving.knative.dev/v1/Service resources because the CRD is not available."} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"v1beta1Controllers.InferenceService","msg":"The InferenceService controller won't watch opentelemetry-collector resources because the CRD is not available."} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"setup","msg":"Setting up v1beta1 TrainedModel controller"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"setup","msg":"Setting up InferenceGraph controller"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"v1alpha1Controllers.InferenceGraph","msg":"The InferenceGraph controller won't watch serving.knative.dev/v1/Service resources because the CRD is not available."} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"setup","msg":"setting up webhook server"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"setup","msg":"registering webhooks to the webhook server"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-pods"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"setup","msg":"registering serving runtime validator webhook to the webhook server"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-serving-kserve-io-v1alpha1-servingruntime"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called","GVK":"serving.kserve.io/v1alpha1, Kind=TrainedModel"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"serving.kserve.io/v1alpha1, Kind=TrainedModel","path":"/validate-serving-kserve-io-v1alpha1-trainedmodel"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-serving-kserve-io-v1alpha1-trainedmodel"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called","GVK":"serving.kserve.io/v1alpha1, Kind=InferenceGraph"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"serving.kserve.io/v1alpha1, Kind=InferenceGraph","path":"/validate-serving-kserve-io-v1alpha1-inferencegraph"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-serving-kserve-io-v1alpha1-inferencegraph"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"Registering a mutating webhook","GVK":"serving.kserve.io/v1beta1, Kind=InferenceService","path":"/mutate-serving-kserve-io-v1beta1-inferenceservice"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-serving-kserve-io-v1beta1-inferenceservice"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"serving.kserve.io/v1beta1, Kind=InferenceService","path":"/validate-serving-kserve-io-v1beta1-inferenceservice"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-serving-kserve-io-v1beta1-inferenceservice"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"setup","msg":"Starting the Cmd."} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.metrics","msg":"Starting metrics server"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"starting server","name":"health probe","addr":"[::]:8081"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.metrics","msg":"Serving metrics server","bindAddress":"127.0.0.1:8080","secure":false} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.webhook","msg":"Starting webhook server"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.webhook","msg":"Serving webhook server","host":"","port":9443} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","interval":10} I0715 03:58:45.267115 1 leaderelection.go:257] attempting to acquire leader lease redhat-ods-applications/kserve-controller-manager-leader-lock... I0715 03:58:45.275163 1 leaderelection.go:271] successfully acquired lease redhat-ods-applications/kserve-controller-manager-leader-lock {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","source":"kind source: *v1beta1.InferenceService"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","source":"kind source: *v1.Deployment"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","source":"kind source: *v1.Service"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","source":"kind source: *v1alpha1.ScaledObject"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","source":"kind source: *v1beta1.VirtualService"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","source":"kind source: *v1.Ingress"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","source":"kind source: *v1alpha1.ServingRuntime"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","source":"kind source: *v1.Pod"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting Controller","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"inferencegraph","controllerGroup":"serving.kserve.io","controllerKind":"InferenceGraph","source":"kind source: *v1alpha1.InferenceGraph"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"inferencegraph","controllerGroup":"serving.kserve.io","controllerKind":"InferenceGraph","source":"kind source: *v1.Deployment"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"inferencegraph","controllerGroup":"serving.kserve.io","controllerKind":"InferenceGraph","source":"kind source: *v1.Route"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting Controller","controller":"inferencegraph","controllerGroup":"serving.kserve.io","controllerKind":"InferenceGraph"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"trainedmodel","controllerGroup":"serving.kserve.io","controllerKind":"TrainedModel","source":"kind source: *v1alpha1.TrainedModel"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting Controller","controller":"trainedmodel","controllerGroup":"serving.kserve.io","controllerKind":"TrainedModel"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting workers","controller":"inferencegraph","controllerGroup":"serving.kserve.io","controllerKind":"InferenceGraph","worker count":1} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting workers","controller":"trainedmodel","controllerGroup":"serving.kserve.io","controllerKind":"TrainedModel","worker count":1} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting workers","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","worker count":1} ==================== WORKLOAD POD LOG: redhat-ods-applications/kubeflow-trainer-controller-manager-7dbc595499-l7pww.log ==================== {"level":"info","ts":"2026-07-15T03:58:17.440318112Z","logger":"setup","caller":"trainer-controller-manager/main.go:93","msg":"Loading configuration","configFile":"/controller_manager_config.yaml"} {"level":"info","ts":"2026-07-15T03:58:17.440956883Z","logger":"setup","caller":"trainer-controller-manager/main.go:107","msg":"Creating manager"} {"level":"info","ts":"2026-07-15T03:58:17.441631169Z","logger":"setup","caller":"trainer-controller-manager/main.go:116","msg":"Setting up certificate management"} {"level":"info","ts":"2026-07-15T03:58:17.441849417Z","logger":"setup","caller":"trainer-controller-manager/main.go:188","msg":"Probe endpoints are configured on healthz and readyz"} {"level":"info","ts":"2026-07-15T03:58:17.468252503Z","logger":"setup","caller":"trainer-controller-manager/main.go:141","msg":"Starting manager"} {"level":"info","ts":"2026-07-15T03:58:17.468337528Z","logger":"setup","caller":"trainer-controller-manager/main.go:149","msg":"Waiting for certificate generation to complete"} {"level":"info","ts":"2026-07-15T03:58:17.468367809Z","logger":"controller-runtime.metrics","caller":"server/server.go:208","msg":"Starting metrics server"} {"level":"info","ts":"2026-07-15T03:58:17.468409017Z","caller":"manager/server.go:83","msg":"starting server","name":"health probe","addr":"[::]:8081"} {"level":"Level(-2)","ts":"2026-07-15T03:58:17.472782576Z","logger":"controller-runtime.cache","caller":"cache/reflector.go:436","msg":"Caches populated","type":"*v1alpha1.ClusterTrainingRuntime","reflector":"pkg/mod/k8s.io/client-go@v0.34.1/tools/cache/reflector.go:290"} {"level":"Level(-2)","ts":"2026-07-15T03:58:17.510847809Z","logger":"controller-runtime.cache","caller":"cache/reflector.go:436","msg":"Caches populated","type":"*v1alpha1.TrainingRuntime","reflector":"pkg/mod/k8s.io/client-go@v0.34.1/tools/cache/reflector.go:290"} {"level":"Level(-2)","ts":"2026-07-15T03:58:17.535436925Z","logger":"controller-runtime.cache","caller":"cache/reflector.go:436","msg":"Caches populated","type":"*v1alpha1.TrainJob","reflector":"pkg/mod/k8s.io/client-go@v0.34.1/tools/cache/reflector.go:290"} {"level":"info","ts":"2026-07-15T03:58:17.569415311Z","logger":"cert-rotation","caller":"rotator/rotator.go:290","msg":"starting cert rotator controller"} I0715 03:58:17.569551 1 leaderelection.go:257] attempting to acquire leader lease redhat-ods-applications/trainer.kubeflow.org... {"level":"Level(-2)","ts":"2026-07-15T03:58:17.574751454Z","logger":"controller-runtime.cache","caller":"cache/reflector.go:436","msg":"Caches populated","type":"*v1.Secret","reflector":"pkg/mod/k8s.io/client-go@v0.34.1/tools/cache/reflector.go:290"} I0715 03:58:17.577530 1 leaderelection.go:271] successfully acquired lease redhat-ods-applications/trainer.kubeflow.org {"level":"debug","ts":"2026-07-15T03:58:17.577581811Z","logger":"events","caller":"recorder/recorder.go:104","msg":"kubeflow-trainer-controller-manager-7dbc595499-l7pww_cb83120e-e8f4-46be-956b-edd1fbcc228a became leader","type":"Normal","object":{"kind":"Lease","namespace":"redhat-ods-applications","name":"trainer.kubeflow.org","uid":"3055beb7-2685-4905-a2c3-c063e7a840da","apiVersion":"coordination.k8s.io/v1","resourceVersion":"28266"},"reason":"LeaderElection"} {"level":"Level(-2)","ts":"2026-07-15T03:58:17.584148762Z","logger":"controller-runtime.cache","caller":"cache/reflector.go:436","msg":"Caches populated","type":"admissionregistration.k8s.io/v1, Kind=ValidatingWebhookConfiguration","reflector":"pkg/mod/k8s.io/client-go@v0.34.1/tools/cache/reflector.go:290"} {"level":"info","ts":"2026-07-15T03:58:17.66298308Z","logger":"controller-runtime.metrics","caller":"server/server.go:247","msg":"Serving metrics server","bindAddress":":8443","secure":true} {"level":"info","ts":"2026-07-15T03:58:17.670312323Z","logger":"cert-rotation","caller":"rotator/rotator.go:334","msg":"refreshing CA and server certs"} {"level":"info","ts":"2026-07-15T03:58:17.67068729Z","logger":"cert-rotation","caller":"rotator/rotator.go:334","msg":"refreshing CA and server certs"} {"level":"info","ts":"2026-07-15T03:58:17.847979103Z","logger":"cert-rotation","caller":"rotator/rotator.go:340","msg":"server certs refreshed"} {"level":"info","ts":"2026-07-15T03:58:17.849749656Z","logger":"cert-rotation","caller":"rotator/rotator.go:361","msg":"no cert refresh needed"} {"level":"error","ts":"2026-07-15T03:58:17.850175823Z","logger":"cert-rotation","caller":"rotator/rotator.go:845","msg":"Webhook not found. Unable to update certificate.","name":"validator.trainer.kubeflow.org","gvk":"admissionregistration.k8s.io/v1, Kind=ValidatingWebhookConfiguration","error":"ValidatingWebhookConfiguration.admissionregistration.k8s.io \"validator.trainer.kubeflow.org\" not found","stacktrace":"github.com/open-policy-agent/cert-controller/pkg/rotator.(*ReconcileWH).ensureCerts\n\t/cachi2/output/deps/gomod/pkg/mod/github.com/open-policy-agent/cert-controller@v0.14.0/pkg/rotator/rotator.go:845\ngithub.com/open-policy-agent/cert-controller/pkg/rotator.(*ReconcileWH).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/github.com/open-policy-agent/cert-controller@v0.14.0/pkg/rotator/rotator.go:814\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"error","ts":"2026-07-15T03:58:17.86888072Z","logger":"cert-rotation","caller":"rotator/rotator.go:336","msg":"could not refresh CA and server certs","error":"Operation cannot be fulfilled on secrets \"kubeflow-trainer-webhook-cert\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"github.com/open-policy-agent/cert-controller/pkg/rotator.(*CertRotator).refreshCertIfNeeded.func1\n\t/cachi2/output/deps/gomod/pkg/mod/github.com/open-policy-agent/cert-controller@v0.14.0/pkg/rotator/rotator.go:336\nk8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtection\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.1/pkg/util/wait/wait.go:150\nk8s.io/apimachinery/pkg/util/wait.ExponentialBackoff\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.1/pkg/util/wait/backoff.go:477\ngithub.com/open-policy-agent/cert-controller/pkg/rotator.(*CertRotator).refreshCertIfNeeded\n\t/cachi2/output/deps/gomod/pkg/mod/github.com/open-policy-agent/cert-controller@v0.14.0/pkg/rotator/rotator.go:364\ngithub.com/open-policy-agent/cert-controller/pkg/rotator.(*CertRotator).Start\n\t/cachi2/output/deps/gomod/pkg/mod/github.com/open-policy-agent/cert-controller@v0.14.0/pkg/rotator/rotator.go:292\nsigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/manager/runnable_group.go:260"} {"level":"info","ts":"2026-07-15T03:58:17.880681437Z","logger":"cert-rotation","caller":"rotator/rotator.go:361","msg":"no cert refresh needed"} {"level":"info","ts":"2026-07-15T03:58:19.674446Z","logger":"cert-rotation","caller":"rotator/rotator.go:896","msg":"certs are ready in /tmp/k8s-webhook-server/serving-certs"} {"level":"info","ts":"2026-07-15T03:58:19.674502695Z","logger":"cert-rotation","caller":"rotator/rotator.go:916","msg":"CA certs are injected to webhooks"} {"level":"info","ts":"2026-07-15T03:58:19.67451714Z","logger":"setup","caller":"trainer-controller-manager/main.go:151","msg":"Certs ready"} {"level":"info","ts":"2026-07-15T03:58:19.674739142Z","caller":"controller/controller.go:353","msg":"Starting EventSource","controller":"trainingruntime_controller","source":"channel source: 0xc000194a80"} {"level":"info","ts":"2026-07-15T03:58:19.674791757Z","caller":"controller/controller.go:353","msg":"Starting EventSource","controller":"trainingruntime_controller","source":"kind source: *v1alpha1.TrainingRuntime"} {"level":"info","ts":"2026-07-15T03:58:19.67482059Z","caller":"controller/controller.go:353","msg":"Starting EventSource","controller":"clustertrainingruntime_controller","source":"channel source: 0xc000194c40"} {"level":"info","ts":"2026-07-15T03:58:19.674863575Z","caller":"controller/controller.go:353","msg":"Starting EventSource","controller":"clustertrainingruntime_controller","source":"kind source: *v1alpha1.ClusterTrainingRuntime"} {"level":"info","ts":"2026-07-15T03:58:19.67484601Z","caller":"controller/controller.go:286","msg":"Starting Controller","controller":"trainingruntime_controller"} {"level":"info","ts":"2026-07-15T03:58:19.674896704Z","caller":"controller/controller.go:289","msg":"Starting workers","controller":"trainingruntime_controller","worker count":1} {"level":"info","ts":"2026-07-15T03:58:19.674965083Z","caller":"controller/controller.go:286","msg":"Starting Controller","controller":"clustertrainingruntime_controller"} {"level":"info","ts":"2026-07-15T03:58:19.67498006Z","caller":"controller/controller.go:289","msg":"Starting workers","controller":"clustertrainingruntime_controller","worker count":1} {"level":"Level(-2)","ts":"2026-07-15T03:58:19.675169152Z","logger":"clustertrainingruntime-controller","caller":"controller/clustertrainingruntime_controller.go:75","msg":"Reconciling ClusterTrainingRuntime","clusterTrainingRuntime":{"name":"torch-distributed-cuda128-torch29-py312"}} {"level":"Level(-2)","ts":"2026-07-15T03:58:19.67525155Z","logger":"clustertrainingruntime-controller","caller":"controller/clustertrainingruntime_controller.go:75","msg":"Reconciling ClusterTrainingRuntime","clusterTrainingRuntime":{"name":"torch-distributed-cuda130-torch210-py312"}} {"level":"Level(-2)","ts":"2026-07-15T03:58:19.675296672Z","logger":"clustertrainingruntime-controller","caller":"controller/clustertrainingruntime_controller.go:75","msg":"Reconciling ClusterTrainingRuntime","clusterTrainingRuntime":{"name":"torch-distributed-rocm64-torch29-py312"}} {"level":"Level(-2)","ts":"2026-07-15T03:58:19.675352891Z","logger":"clustertrainingruntime-controller","caller":"controller/clustertrainingruntime_controller.go:75","msg":"Reconciling ClusterTrainingRuntime","clusterTrainingRuntime":{"name":"torch-distributed-rocm64-torch291-py312"}} {"level":"Level(-2)","ts":"2026-07-15T03:58:19.675395309Z","logger":"clustertrainingruntime-controller","caller":"controller/clustertrainingruntime_controller.go:75","msg":"Reconciling ClusterTrainingRuntime","clusterTrainingRuntime":{"name":"training-hub"}} {"level":"Level(-2)","ts":"2026-07-15T03:58:19.675443512Z","logger":"clustertrainingruntime-controller","caller":"controller/clustertrainingruntime_controller.go:75","msg":"Reconciling ClusterTrainingRuntime","clusterTrainingRuntime":{"name":"training-hub-cpu"}} {"level":"Level(-2)","ts":"2026-07-15T03:58:19.675486463Z","logger":"clustertrainingruntime-controller","caller":"controller/clustertrainingruntime_controller.go:75","msg":"Reconciling ClusterTrainingRuntime","clusterTrainingRuntime":{"name":"torch-distributed-cpu"}} {"level":"Level(-2)","ts":"2026-07-15T03:58:19.675528066Z","logger":"clustertrainingruntime-controller","caller":"controller/clustertrainingruntime_controller.go:75","msg":"Reconciling ClusterTrainingRuntime","clusterTrainingRuntime":{"name":"torch-distributed-rocm"}} {"level":"Level(-2)","ts":"2026-07-15T03:58:19.675571855Z","logger":"clustertrainingruntime-controller","caller":"controller/clustertrainingruntime_controller.go:75","msg":"Reconciling ClusterTrainingRuntime","clusterTrainingRuntime":{"name":"training-hub-rocm"}} {"level":"Level(-2)","ts":"2026-07-15T03:58:19.675605825Z","logger":"clustertrainingruntime-controller","caller":"controller/clustertrainingruntime_controller.go:75","msg":"Reconciling ClusterTrainingRuntime","clusterTrainingRuntime":{"name":"torch-distributed"}} {"level":"Level(-2)","ts":"2026-07-15T03:58:19.675634041Z","logger":"clustertrainingruntime-controller","caller":"controller/clustertrainingruntime_controller.go:75","msg":"Reconciling ClusterTrainingRuntime","clusterTrainingRuntime":{"name":"torch-distributed-cpu-torch210-py312"}} {"level":"info","ts":"2026-07-15T03:58:19.684820539Z","logger":"controller-runtime.builder","caller":"builder/webhook.go:258","msg":"Registering a validating webhook","GVK":"trainer.kubeflow.org/v1alpha1, Kind=ClusterTrainingRuntime","path":"/validate-trainer-kubeflow-org-v1alpha1-clustertrainingruntime"} {"level":"info","ts":"2026-07-15T03:58:19.684920119Z","logger":"controller-runtime.webhook","caller":"webhook/server.go:183","msg":"Registering webhook","path":"/validate-trainer-kubeflow-org-v1alpha1-clustertrainingruntime"} {"level":"info","ts":"2026-07-15T03:58:19.684929024Z","logger":"controller-runtime.webhook","caller":"webhook/server.go:191","msg":"Starting webhook server"} {"level":"info","ts":"2026-07-15T03:58:19.684971336Z","caller":"controller/controller.go:353","msg":"Starting EventSource","controller":"trainjob_controller","source":"kind source: *v1.Secret"} {"level":"info","ts":"2026-07-15T03:58:19.684995141Z","logger":"controller-runtime.builder","caller":"builder/webhook.go:258","msg":"Registering a validating webhook","GVK":"trainer.kubeflow.org/v1alpha1, Kind=TrainingRuntime","path":"/validate-trainer-kubeflow-org-v1alpha1-trainingruntime"} {"level":"info","ts":"2026-07-15T03:58:19.684994938Z","caller":"controller/controller.go:353","msg":"Starting EventSource","controller":"trainjob_controller","source":"kind source: *v1alpha2.JobSet"} {"level":"info","ts":"2026-07-15T03:58:19.685038738Z","logger":"controller-runtime.webhook","caller":"webhook/server.go:183","msg":"Registering webhook","path":"/validate-trainer-kubeflow-org-v1alpha1-trainingruntime"} {"level":"info","ts":"2026-07-15T03:58:19.685053172Z","caller":"controller/controller.go:353","msg":"Starting EventSource","controller":"trainjob_controller","source":"kind source: *v1alpha1.TrainJob"} {"level":"info","ts":"2026-07-15T03:58:19.685044412Z","caller":"controller/controller.go:353","msg":"Starting EventSource","controller":"trainjob_controller","source":"kind source: *v1.ConfigMap"} {"level":"info","ts":"2026-07-15T03:58:19.685117729Z","logger":"controller-runtime.builder","caller":"builder/webhook.go:258","msg":"Registering a validating webhook","GVK":"trainer.kubeflow.org/v1alpha1, Kind=TrainJob","path":"/validate-trainer-kubeflow-org-v1alpha1-trainjob"} {"level":"info","ts":"2026-07-15T03:58:19.685185134Z","logger":"controller-runtime.webhook","caller":"webhook/server.go:183","msg":"Registering webhook","path":"/validate-trainer-kubeflow-org-v1alpha1-trainjob"} {"level":"info","ts":"2026-07-15T03:58:19.685274382Z","logger":"controller-runtime.certwatcher","caller":"certwatcher/certwatcher.go:214","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-15T03:58:19.685444843Z","logger":"controller-runtime.webhook","caller":"webhook/server.go:242","msg":"Serving webhook server","host":"","port":9443} {"level":"info","ts":"2026-07-15T03:58:19.685536389Z","logger":"controller-runtime.certwatcher","caller":"certwatcher/certwatcher.go:136","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} {"level":"Level(-2)","ts":"2026-07-15T03:58:19.688179731Z","logger":"controller-runtime.cache","caller":"cache/reflector.go:436","msg":"Caches populated","type":"*v1alpha2.JobSet","reflector":"pkg/mod/k8s.io/client-go@v0.34.1/tools/cache/reflector.go:290"} {"level":"Level(-2)","ts":"2026-07-15T03:58:19.844146154Z","logger":"controller-runtime.cache","caller":"cache/reflector.go:436","msg":"Caches populated","type":"*v1.Secret","reflector":"pkg/mod/k8s.io/client-go@v0.34.1/tools/cache/reflector.go:290"} {"level":"Level(-2)","ts":"2026-07-15T03:58:19.953800751Z","logger":"clustertrainingruntime-controller","caller":"controller/clustertrainingruntime_controller.go:75","msg":"Reconciling ClusterTrainingRuntime","clusterTrainingRuntime":{"name":"training-hub-th05-cuda128-torch29-py312"}} {"level":"Level(-2)","ts":"2026-07-15T03:58:19.958740796Z","logger":"controller-runtime.cache","caller":"cache/reflector.go:436","msg":"Caches populated","type":"*v1.ConfigMap","reflector":"pkg/mod/k8s.io/client-go@v0.34.1/tools/cache/reflector.go:290"} {"level":"info","ts":"2026-07-15T03:58:19.996569043Z","caller":"controller/controller.go:286","msg":"Starting Controller","controller":"trainjob_controller"} {"level":"info","ts":"2026-07-15T03:58:19.996614707Z","caller":"controller/controller.go:289","msg":"Starting workers","controller":"trainjob_controller","worker count":1} {"level":"Level(-2)","ts":"2026-07-15T03:58:20.143184524Z","logger":"clustertrainingruntime-controller","caller":"controller/clustertrainingruntime_controller.go:75","msg":"Reconciling ClusterTrainingRuntime","clusterTrainingRuntime":{"name":"training-hub-th06-cpu-torch210-py312"}} {"level":"Level(-2)","ts":"2026-07-15T03:58:20.237640963Z","logger":"clustertrainingruntime-controller","caller":"controller/clustertrainingruntime_controller.go:75","msg":"Reconciling ClusterTrainingRuntime","clusterTrainingRuntime":{"name":"training-hub-th06-cuda130-torch210-py312"}} {"level":"Level(-2)","ts":"2026-07-15T03:58:20.249571371Z","logger":"clustertrainingruntime-controller","caller":"controller/clustertrainingruntime_controller.go:75","msg":"Reconciling ClusterTrainingRuntime","clusterTrainingRuntime":{"name":"training-hub-th06-rocm64-torch291-py312"}} {"level":"info","ts":"2026-07-15T03:58:20.335867706Z","logger":"cert-rotation","caller":"rotator/rotator.go:361","msg":"no cert refresh needed"} {"level":"info","ts":"2026-07-15T03:58:20.3363151Z","logger":"cert-rotation","caller":"rotator/rotator.go:857","msg":"Ensuring CA cert","name":"validator.trainer.kubeflow.org","gvk":"admissionregistration.k8s.io/v1, Kind=ValidatingWebhookConfiguration","name":"validator.trainer.kubeflow.org","gvk":"admissionregistration.k8s.io/v1, Kind=ValidatingWebhookConfiguration"} {"level":"info","ts":"2026-07-15T03:58:20.346140192Z","logger":"cert-rotation","caller":"rotator/rotator.go:361","msg":"no cert refresh needed"} {"level":"info","ts":"2026-07-15T03:58:20.346438549Z","logger":"cert-rotation","caller":"rotator/rotator.go:857","msg":"Ensuring CA cert","name":"validator.trainer.kubeflow.org","gvk":"admissionregistration.k8s.io/v1, Kind=ValidatingWebhookConfiguration","name":"validator.trainer.kubeflow.org","gvk":"admissionregistration.k8s.io/v1, Kind=ValidatingWebhookConfiguration"} {"level":"info","ts":"2026-07-15T03:58:28.764461907Z","logger":"cert-rotation","caller":"rotator/rotator.go:361","msg":"no cert refresh needed"} {"level":"info","ts":"2026-07-15T03:58:28.764899611Z","logger":"cert-rotation","caller":"rotator/rotator.go:857","msg":"Ensuring CA cert","name":"validator.trainer.kubeflow.org","gvk":"admissionregistration.k8s.io/v1, Kind=ValidatingWebhookConfiguration","name":"validator.trainer.kubeflow.org","gvk":"admissionregistration.k8s.io/v1, Kind=ValidatingWebhookConfiguration"} {"level":"Level(-2)","ts":"2026-07-15T04:31:47.255991243Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"a4cba9ab-f92d-4494-ba2c-5545439b0c21","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:31:47.812539004Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:172","msg":"TrainJob create event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:31:47.812679788Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"11fe099b-06b6-4dfe-a468-5bf626df9942","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:31:47.870759048Z","logger":"controller-runtime.cache","caller":"cache/reflector.go:436","msg":"Caches populated","type":"*v1.NetworkPolicy","reflector":"pkg/mod/k8s.io/client-go@v0.34.1/tools/cache/reflector.go:290"} {"level":"info","ts":"2026-07-15T04:31:47.959523593Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:31:47.972517391Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"error","ts":"2026-07-15T04:31:47.978212263Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"11fe099b-06b6-4dfe-a468-5bf626df9942","error":"Operation cannot be fulfilled on trainjobs.trainer.kubeflow.org \"lifecycle-train-job-141919\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:31:47.978338102Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"7fd0f8dd-ed4d-45f5-8d53-8ac3d72a2c68","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:31:48.006362864Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:31:48.139241985Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"7fd0f8dd-ed4d-45f5-8d53-8ac3d72a2c68","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no pods found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919"} {"level":"Level(-2)","ts":"2026-07-15T04:31:48.139317902Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"7fd0f8dd-ed4d-45f5-8d53-8ac3d72a2c68","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:31:48.13943206Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"971315d9-8d11-4c0e-97b6-b767a27863a4","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:31:48.161983055Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:31:48.23133983Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"971315d9-8d11-4c0e-97b6-b767a27863a4","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no pods found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919"} {"level":"Level(-2)","ts":"2026-07-15T04:31:48.231373668Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"971315d9-8d11-4c0e-97b6-b767a27863a4","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:31:48.231470257Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"d43ec3de-dfe3-4329-a577-c31dfdd91c12","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:31:48.252521054Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"d43ec3de-dfe3-4329-a577-c31dfdd91c12","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no pods found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919"} {"level":"Level(-2)","ts":"2026-07-15T04:31:48.252555399Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"d43ec3de-dfe3-4329-a577-c31dfdd91c12","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:31:48.338699564Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"7339b3aa-2e6b-4087-b205-a4d2743dabf8","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:31:48.354354527Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:31:48.372560785Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"7339b3aa-2e6b-4087-b205-a4d2743dabf8","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919; found pods: [lifecycle-train-job-141919-node-0-0-2vgfx: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-15T04:31:48.372593965Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"7339b3aa-2e6b-4087-b205-a4d2743dabf8","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:31:48.372686792Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c0d4cc30-1005-4107-b494-645e9040add6","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:31:48.569428564Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c0d4cc30-1005-4107-b494-645e9040add6","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919; found pods: [lifecycle-train-job-141919-node-0-0-2vgfx: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-15T04:31:48.569465653Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c0d4cc30-1005-4107-b494-645e9040add6","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:31:48.812855675Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"6ac4207e-8940-4f36-9e0e-2c547df06543","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:31:48.828832516Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"d107fb08-dd52-4cb2-95fe-df66571a223c","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:31:57.914826555Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"94e6dcb2-561a-4a27-b36f-74e9a417f89a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:31:57.927657072Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:31:57.95062762Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"94e6dcb2-561a-4a27-b36f-74e9a417f89a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919; found pods: [lifecycle-train-job-141919-node-0-0-2vgfx: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-15T04:31:57.950664876Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"94e6dcb2-561a-4a27-b36f-74e9a417f89a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:31:57.950774411Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"e951e3d4-f1d5-4c80-9cf1-778a6ad5d418","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:31:58.047738314Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"e951e3d4-f1d5-4c80-9cf1-778a6ad5d418","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919; found pods: [lifecycle-train-job-141919-node-0-0-2vgfx: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-15T04:31:58.047775442Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"e951e3d4-f1d5-4c80-9cf1-778a6ad5d418","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:31:58.917835648Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"68ffdc7d-af5a-4b76-a16f-ec42c54034a6","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:31:58.928307534Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"58040c41-eda6-45f0-aa64-dd55fa9aa04d","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:31:58.929168543Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:31:58.951287358Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"68ffdc7d-af5a-4b76-a16f-ec42c54034a6","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:31:58.951321245Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"68ffdc7d-af5a-4b76-a16f-ec42c54034a6","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-15T04:31:58.951354889Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:31:58.951417008Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"63c3dc89-9104-4c6a-9782-d42686c1e31c","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:31:59.048964992Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:31:59.048973858Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"63c3dc89-9104-4c6a-9782-d42686c1e31c","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:31:59.048999333Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"63c3dc89-9104-4c6a-9782-d42686c1e31c","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:31:59.049067012Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"d1b3a41f-8a12-4842-9611-4fca002a4188","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:31:59.146760453Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"d1b3a41f-8a12-4842-9611-4fca002a4188","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:31:59.146791424Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"d1b3a41f-8a12-4842-9611-4fca002a4188","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:31:59.928724366Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"5fdd2810-37d9-4284-88a8-8c7b7f7ac593","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:31:59.9293646Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"ba4fc7bd-66b2-4440-b161-00b47bafecd0","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:31:59.942025839Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:31:59.957333842Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"5fdd2810-37d9-4284-88a8-8c7b7f7ac593","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:31:59.957369452Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"5fdd2810-37d9-4284-88a8-8c7b7f7ac593","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:31:59.957452939Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"88459935-01e6-4f64-ba7f-5338dd2f202c","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:31:59.976598746Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"88459935-01e6-4f64-ba7f-5338dd2f202c","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:31:59.976631063Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"88459935-01e6-4f64-ba7f-5338dd2f202c","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:32:00.942269297Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"fc61fded-63aa-4f25-aecf-11591db6fb94","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:32:18.140521142Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"1a219341-e1b1-4bcc-9b89-7ca6b0903c12","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:32:18.167421534Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"1a219341-e1b1-4bcc-9b89-7ca6b0903c12","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:32:18.167456738Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"1a219341-e1b1-4bcc-9b89-7ca6b0903c12","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-15T04:32:18.167521678Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:32:18.167599267Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c409be33-b414-4b7e-be69-91cd16893a37","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:32:18.262126707Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c409be33-b414-4b7e-be69-91cd16893a37","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:32:18.26216109Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c409be33-b414-4b7e-be69-91cd16893a37","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:32:19.168701124Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"b027fbee-d7cf-4625-87cc-536914235c14","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:32:34.695205001Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"17853487-6243-45aa-b7b4-7005a1bb1c9e","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:32:34.870029501Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c80f72a0-d1a7-46d1-8571-d29cb3a589a3","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:32:34.87468725Z","logger":"events","caller":"recorder/recorder.go:104","msg":"TrainJob resources reconciliation failed: jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated","type":"Warning","object":{"kind":"TrainJob","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","uid":"0ba2f804-d8f5-4fb3-a958-7cc3cb7041d8","apiVersion":"trainer.kubeflow.org/v1alpha1","resourceVersion":"68235"},"reason":"TrainJobResourcesCreationFailed"} {"level":"info","ts":"2026-07-15T04:32:34.92920346Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:178","msg":"TrainJob delete event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:32:34.989936666Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c80f72a0-d1a7-46d1-8571-d29cb3a589a3","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no pods found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919"} {"level":"Level(-2)","ts":"2026-07-15T04:32:34.989970812Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c80f72a0-d1a7-46d1-8571-d29cb3a589a3","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-15T04:32:34.99001111Z","caller":"controller/controller.go:472","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c80f72a0-d1a7-46d1-8571-d29cb3a589a3"} {"level":"error","ts":"2026-07-15T04:32:34.990023388Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c80f72a0-d1a7-46d1-8571-d29cb3a589a3","error":"jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated\nJobSet.jobset.x-k8s.io \"lifecycle-train-job-141919\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:32:35.930256059Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"2ccb4894-2d6e-441c-9416-c445cb66d27c","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:32:44.686681804Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"7a08b702-12fe-4c04-985e-daaf286d59ef","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:32:45.218369857Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:172","msg":"TrainJob create event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:32:45.218478654Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"25da0954-ddb5-48d4-92b7-38f41237ea2c","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:32:45.265101586Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"1e390688-0c3c-48f4-bfc3-32d937e1968b","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:32:45.265190387Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:32:45.289111245Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"error","ts":"2026-07-15T04:32:45.29212965Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"1e390688-0c3c-48f4-bfc3-32d937e1968b","error":"Operation cannot be fulfilled on trainjobs.trainer.kubeflow.org \"lifecycle-train-job-141919\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:32:45.292245128Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"3740a4c9-5efd-4b1a-ab71-ab2125e85fff","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:32:45.301229876Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"error","ts":"2026-07-15T04:32:45.315386788Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"3740a4c9-5efd-4b1a-ab71-ab2125e85fff","error":"Operation cannot be fulfilled on trainjobs.trainer.kubeflow.org \"lifecycle-train-job-141919\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:32:45.315480079Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c34742cd-bd0a-4001-9c63-839064ad7b6b","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:32:45.346811525Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:32:45.428285327Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c34742cd-bd0a-4001-9c63-839064ad7b6b","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919; found pods: [lifecycle-train-job-141919-node-0-0-v24bk: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-15T04:32:45.428322628Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c34742cd-bd0a-4001-9c63-839064ad7b6b","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:32:45.428414249Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"d2f9e710-626c-41fb-aa39-d4ef665d86b6","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:32:45.445034375Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:32:45.464769882Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"d2f9e710-626c-41fb-aa39-d4ef665d86b6","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919; found pods: [lifecycle-train-job-141919-node-0-0-v24bk: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-15T04:32:45.464804752Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"d2f9e710-626c-41fb-aa39-d4ef665d86b6","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:32:45.46489806Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"a66c0813-3ebc-4017-9247-119be4001ac0","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:32:45.550417575Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"a66c0813-3ebc-4017-9247-119be4001ac0","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919; found pods: [lifecycle-train-job-141919-node-0-0-v24bk: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-15T04:32:45.550454523Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"a66c0813-3ebc-4017-9247-119be4001ac0","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:32:46.218888288Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"3f0e846a-df60-4d9d-9eca-9d27ba29520c","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:32:46.236499505Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"fd3f1da3-e84b-494e-b131-c55314b82569","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:32:48.189715507Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c0c13b25-7eb4-47b5-b418-455f181f9eee","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:32:48.202471801Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:32:48.22240251Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c0c13b25-7eb4-47b5-b418-455f181f9eee","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:32:48.22244181Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c0c13b25-7eb4-47b5-b418-455f181f9eee","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-15T04:32:48.222527207Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:32:48.222536682Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c3c063d8-f576-4feb-951c-acbecb71d32d","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:32:48.317556693Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c3c063d8-f576-4feb-951c-acbecb71d32d","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:32:48.317591279Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c3c063d8-f576-4feb-951c-acbecb71d32d","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:32:48.31768993Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"f6a6d007-93d6-4cc3-bfe9-977752f36b95","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:32:48.336367679Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"f6a6d007-93d6-4cc3-bfe9-977752f36b95","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:32:48.336399563Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"f6a6d007-93d6-4cc3-bfe9-977752f36b95","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:32:49.203713189Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"4e603b91-241c-40a1-880a-ab34618ce92f","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:03.248884872Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"adb13d9d-fc70-4415-a8a0-0a63242dafe0","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:33:03.261435014Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:03.284444708Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"adb13d9d-fc70-4415-a8a0-0a63242dafe0","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:33:03.284483798Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:03.28448789Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"adb13d9d-fc70-4415-a8a0-0a63242dafe0","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:33:03.284616392Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"254a2076-2811-4dff-a797-46e7c8cbc95f","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:03.378333596Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"254a2076-2811-4dff-a797-46e7c8cbc95f","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:03.378368199Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"254a2076-2811-4dff-a797-46e7c8cbc95f","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:33:04.262642546Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"e1d342e1-ef01-4e5a-b953-81d13df5075a","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:12.020841344Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"e5258dd8-b63e-4b7a-b1ec-5d00eacf1c3a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:33:12.033953646Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:12.050790572Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"e5258dd8-b63e-4b7a-b1ec-5d00eacf1c3a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:12.050820153Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"e5258dd8-b63e-4b7a-b1ec-5d00eacf1c3a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-15T04:33:12.05088396Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:12.050918699Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"4d05252b-1620-4490-b2a4-0cdf1f2e9ecd","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:12.148865645Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"4d05252b-1620-4490-b2a4-0cdf1f2e9ecd","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:12.14889859Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"4d05252b-1620-4490-b2a4-0cdf1f2e9ecd","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:33:12.148976271Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"6f1ea76a-ec49-4873-9137-33e23b8e3703","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:12.248921609Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"6f1ea76a-ec49-4873-9137-33e23b8e3703","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:12.248955482Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"6f1ea76a-ec49-4873-9137-33e23b8e3703","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:33:13.029772567Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"747e974c-0896-4cd7-bb33-275e40fea72b","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:13.034226453Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"214cb5c5-e9fe-448e-a913-54c280a202ae","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:33:13.043152754Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:13.060816833Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"747e974c-0896-4cd7-bb33-275e40fea72b","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:13.060845932Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"747e974c-0896-4cd7-bb33-275e40fea72b","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-15T04:33:13.060904228Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:13.060917966Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"090a17c1-8cbc-439d-af63-9c92a3a1d0df","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:13.159789962Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"090a17c1-8cbc-439d-af63-9c92a3a1d0df","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:13.159822752Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"090a17c1-8cbc-439d-af63-9c92a3a1d0df","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:33:13.159907789Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"e4ce638c-9531-4f9c-a81d-3e4e4db6b248","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:13.177659563Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"e4ce638c-9531-4f9c-a81d-3e4e4db6b248","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:13.177692034Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"e4ce638c-9531-4f9c-a81d-3e4e4db6b248","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:33:14.044079663Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"e9e4f942-6f68-4cb2-a7d6-73f8e60c3f51","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:15.429365857Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"b56d8541-6aad-4774-a939-d91efc67053b","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:15.454053212Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"b56d8541-6aad-4774-a939-d91efc67053b","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:15.454108658Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"b56d8541-6aad-4774-a939-d91efc67053b","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-15T04:33:15.454192224Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:15.454274671Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"008ac6ba-f6e1-4576-b505-6bebe310c22e","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:15.549584776Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"008ac6ba-f6e1-4576-b505-6bebe310c22e","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:15.549618316Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"008ac6ba-f6e1-4576-b505-6bebe310c22e","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:33:16.455431401Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"8cc6fd06-cfb5-4a0f-8192-83fa04842155","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:40.268578261Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"ee05aa61-a136-49c1-b984-018497c295a7","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:40.699911007Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"fe5e68e9-81ce-4ccf-84b2-bb39f340afcf","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:33:40.704714989Z","logger":"events","caller":"recorder/recorder.go:104","msg":"TrainJob resources reconciliation failed: jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated","type":"Warning","object":{"kind":"TrainJob","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","uid":"9d3db7e9-471a-44f2-9b58-3d6a4bf6b442","apiVersion":"trainer.kubeflow.org/v1alpha1","resourceVersion":"69471"},"reason":"TrainJobResourcesCreationFailed"} {"level":"debug","ts":"2026-07-15T04:33:40.817191289Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"fe5e68e9-81ce-4ccf-84b2-bb39f340afcf","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no pods found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919"} {"level":"Level(-2)","ts":"2026-07-15T04:33:40.817226243Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"fe5e68e9-81ce-4ccf-84b2-bb39f340afcf","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-15T04:33:40.817262475Z","caller":"controller/controller.go:472","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"fe5e68e9-81ce-4ccf-84b2-bb39f340afcf"} {"level":"error","ts":"2026-07-15T04:33:40.817271385Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"fe5e68e9-81ce-4ccf-84b2-bb39f340afcf","error":"jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated\nJobSet.jobset.x-k8s.io \"lifecycle-train-job-141919\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:33:40.82254821Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"69192302-5f8a-408b-8d16-ffd09271d6cd","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:33:40.827234745Z","logger":"events","caller":"recorder/recorder.go:104","msg":"TrainJob resources reconciliation failed: jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated","type":"Warning","object":{"kind":"TrainJob","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","uid":"9d3db7e9-471a-44f2-9b58-3d6a4bf6b442","apiVersion":"trainer.kubeflow.org/v1alpha1","resourceVersion":"69471"},"reason":"TrainJobResourcesCreationFailed"} {"level":"debug","ts":"2026-07-15T04:33:40.917402958Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"69192302-5f8a-408b-8d16-ffd09271d6cd","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no pods found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919"} {"level":"Level(-2)","ts":"2026-07-15T04:33:40.917437861Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"69192302-5f8a-408b-8d16-ffd09271d6cd","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-15T04:33:40.917476315Z","caller":"controller/controller.go:472","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"69192302-5f8a-408b-8d16-ffd09271d6cd"} {"level":"error","ts":"2026-07-15T04:33:40.917487278Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"69192302-5f8a-408b-8d16-ffd09271d6cd","error":"jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated\nJobSet.jobset.x-k8s.io \"lifecycle-train-job-141919\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:33:40.927777166Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"f1bffb74-c44d-4db0-8697-5a3ae29a4a12","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:33:40.93285289Z","logger":"events","caller":"recorder/recorder.go:104","msg":"TrainJob resources reconciliation failed: jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated","type":"Warning","object":{"kind":"TrainJob","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","uid":"9d3db7e9-471a-44f2-9b58-3d6a4bf6b442","apiVersion":"trainer.kubeflow.org/v1alpha1","resourceVersion":"69471"},"reason":"TrainJobResourcesCreationFailed"} {"level":"debug","ts":"2026-07-15T04:33:40.948904597Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"f1bffb74-c44d-4db0-8697-5a3ae29a4a12","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no pods found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919"} {"level":"Level(-2)","ts":"2026-07-15T04:33:40.948931995Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"f1bffb74-c44d-4db0-8697-5a3ae29a4a12","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-15T04:33:40.948971598Z","caller":"controller/controller.go:472","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"f1bffb74-c44d-4db0-8697-5a3ae29a4a12"} {"level":"error","ts":"2026-07-15T04:33:40.94898311Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"f1bffb74-c44d-4db0-8697-5a3ae29a4a12","error":"jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated\nJobSet.jobset.x-k8s.io \"lifecycle-train-job-141919\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-15T04:33:40.965754248Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:178","msg":"TrainJob delete event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:41.965976087Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"d4b3f1a9-9301-43c7-8b15-ba320dadae54","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:50.524930112Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"820f8fb2-0776-4298-82e4-fd5794f63151","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:33:50.973268801Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:172","msg":"TrainJob create event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:50.97334443Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"bc4563a6-5c1e-4a47-bb5a-892ae0fdb820","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:33:51.013207889Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:51.013344605Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"72c1ab43-57e2-4387-b9fc-d7fa7e0d3aec","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:33:51.04275277Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"error","ts":"2026-07-15T04:33:51.046194414Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"72c1ab43-57e2-4387-b9fc-d7fa7e0d3aec","error":"Operation cannot be fulfilled on trainjobs.trainer.kubeflow.org \"lifecycle-train-job-141919\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:33:51.046271403Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"092431df-8829-45be-815b-a66cf093b2c4","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:33:51.054492492Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"error","ts":"2026-07-15T04:33:51.06831313Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"092431df-8829-45be-815b-a66cf093b2c4","error":"Operation cannot be fulfilled on trainjobs.trainer.kubeflow.org \"lifecycle-train-job-141919\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:33:51.068386213Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"fee1ef64-3eeb-419e-af34-6bb13f908f6a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:33:51.097365189Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:33:51.164973665Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"fee1ef64-3eeb-419e-af34-6bb13f908f6a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919; found pods: [lifecycle-train-job-141919-node-0-0-hv2kn: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-15T04:33:51.165006342Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"fee1ef64-3eeb-419e-af34-6bb13f908f6a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:33:51.165119009Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"5159bbba-1ca1-46c9-b6e5-dc473c88e52a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:33:51.17956603Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:33:51.272692728Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"5159bbba-1ca1-46c9-b6e5-dc473c88e52a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919; found pods: [lifecycle-train-job-141919-node-0-0-hv2kn: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-15T04:33:51.27273008Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"5159bbba-1ca1-46c9-b6e5-dc473c88e52a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:33:51.272826257Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"1063df3c-4869-4ad9-affd-ca63be6c9ece","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:33:51.366694117Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"1063df3c-4869-4ad9-affd-ca63be6c9ece","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919; found pods: [lifecycle-train-job-141919-node-0-0-hv2kn: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-15T04:33:51.366731522Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"1063df3c-4869-4ad9-affd-ca63be6c9ece","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:33:51.973533411Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"838871a4-ceeb-4c6c-a22e-130beb02dfe8","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:51.989362843Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"b6da9113-526d-4063-8ab2-6f7af563f231","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:53.654561328Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"128706e8-ac99-43b3-b174-8089ebaf5ef3","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:33:53.667549821Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:53.691815523Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"128706e8-ac99-43b3-b174-8089ebaf5ef3","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:53.691853744Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"128706e8-ac99-43b3-b174-8089ebaf5ef3","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:33:53.69193684Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"4ea3dd6a-4851-458b-a1a2-f669c2e8de56","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:33:53.691960332Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:53.785161508Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"4ea3dd6a-4851-458b-a1a2-f669c2e8de56","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:53.785194633Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"4ea3dd6a-4851-458b-a1a2-f669c2e8de56","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:33:53.785277523Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"2bfc12aa-4561-4f1f-8e80-b64ae6f13f61","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:53.804302889Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"2bfc12aa-4561-4f1f-8e80-b64ae6f13f61","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:33:53.804336945Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"2bfc12aa-4561-4f1f-8e80-b64ae6f13f61","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:33:54.668321484Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"959166ab-9008-4bad-83b4-754708887a53","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:02.509079703Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"8f3b7d98-032b-4392-91f3-d7532bdee7d2","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:08.251423024Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"d53190c4-95c3-4329-8e59-e823eb2738bb","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:34:08.266634386Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:34:08.288019118Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:08.288043493Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"d53190c4-95c3-4329-8e59-e823eb2738bb","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:08.288192922Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"d53190c4-95c3-4329-8e59-e823eb2738bb","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:08.288306684Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"bea73a4b-6527-434e-b942-9457b602037a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:08.382770552Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"bea73a4b-6527-434e-b942-9457b602037a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:08.38281586Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"bea73a4b-6527-434e-b942-9457b602037a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:09.119511595Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"70989a42-da59-4078-9475-d6503619aba0","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:09.267644105Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"939fa7ed-80d0-49d4-88ea-dccaa49a0767","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:34:09.675413118Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:172","msg":"TrainJob create event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:09.675495464Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"fa5e1b2b-78b1-4f24-aa33-60e240006555","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:34:09.721815679Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:09.721959875Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"5544f6bb-85c5-45d5-8b57-0c00661f93b8","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:34:09.752656912Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:09.752662745Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"6117476d-f09b-4b02-9238-07543f3fe161","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:34:09.773683341Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"error","ts":"2026-07-15T04:34:09.781029397Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"6117476d-f09b-4b02-9238-07543f3fe161","error":"Operation cannot be fulfilled on trainjobs.trainer.kubeflow.org \"test-train-job-113378\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:34:09.781136427Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"8e51999f-7fc9-4d84-b19b-397a05d13f00","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:34:09.785502959Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"error","ts":"2026-07-15T04:34:09.806052214Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"8e51999f-7fc9-4d84-b19b-397a05d13f00","error":"Operation cannot be fulfilled on trainjobs.trainer.kubeflow.org \"test-train-job-113378\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:34:09.806159897Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"65b2eaea-6553-4568-8b69-611785068178","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:34:09.835204996Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-15T04:34:09.881846614Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"65b2eaea-6553-4568-8b69-611785068178","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob trainer-v2-test-113378/test-train-job-113378; found pods: [test-train-job-113378-node-0-0-nm9w6: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-15T04:34:09.881885864Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"65b2eaea-6553-4568-8b69-611785068178","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:09.881981215Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"08e42626-755b-4c18-9840-654b51cf920a","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:34:09.896564938Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-15T04:34:09.919542789Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"08e42626-755b-4c18-9840-654b51cf920a","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob trainer-v2-test-113378/test-train-job-113378; found pods: [test-train-job-113378-node-0-0-nm9w6: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-15T04:34:09.919577783Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"08e42626-755b-4c18-9840-654b51cf920a","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:09.919666827Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"0c38793c-3b64-4ea7-af3c-bc8cb3cad575","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:34:09.931860261Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-15T04:34:09.977781202Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"0c38793c-3b64-4ea7-af3c-bc8cb3cad575","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob trainer-v2-test-113378/test-train-job-113378; found pods: [test-train-job-113378-node-0-0-nm9w6: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-15T04:34:09.977821747Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"0c38793c-3b64-4ea7-af3c-bc8cb3cad575","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:09.977915249Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"19a2d965-2249-455c-b8bb-258547c3ff53","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-15T04:34:10.000787448Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"19a2d965-2249-455c-b8bb-258547c3ff53","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob trainer-v2-test-113378/test-train-job-113378; found pods: [test-train-job-113378-node-0-0-nm9w6: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-15T04:34:10.0008253Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"19a2d965-2249-455c-b8bb-258547c3ff53","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:10.675778666Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"02f6beeb-21cc-4055-887c-8e5ceaa9dbe6","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:10.691646231Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"131288aa-41d6-4eed-8110-74ac256055b1","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:12.787397073Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"473d5c2a-98f1-4e17-9f8c-9ec186a9fd8d","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:34:12.801896022Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:12.821358845Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"473d5c2a-98f1-4e17-9f8c-9ec186a9fd8d","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:12.821390739Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"473d5c2a-98f1-4e17-9f8c-9ec186a9fd8d","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:12.821470845Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"7fe64a21-e85e-4f31-a3f1-4c13e63d70e5","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:34:12.82181435Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:12.916945666Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"7fe64a21-e85e-4f31-a3f1-4c13e63d70e5","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:12.916977443Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"7fe64a21-e85e-4f31-a3f1-4c13e63d70e5","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:12.917056516Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"b969e8e7-1523-40da-851b-1a7b43d32353","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:12.937748753Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"b969e8e7-1523-40da-851b-1a7b43d32353","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:12.937779287Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"b969e8e7-1523-40da-851b-1a7b43d32353","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:13.802674542Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"bb24f310-059b-4db5-8dbf-075ceb36dde5","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:17.023400922Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"11234230-0899-416b-8d64-87b4e6d4e7ba","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:34:17.037723213Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:17.055839887Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"11234230-0899-416b-8d64-87b4e6d4e7ba","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:17.055876043Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"11234230-0899-416b-8d64-87b4e6d4e7ba","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:17.055968871Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"58bdb5e4-3848-4fa3-ad17-cc06b6dc7935","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:34:17.055998425Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:17.154646529Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"58bdb5e4-3848-4fa3-ad17-cc06b6dc7935","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:17.154680505Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"58bdb5e4-3848-4fa3-ad17-cc06b6dc7935","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:17.154769255Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"b74d8411-5b9e-4567-9fba-a2b37a64c272","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:17.177935905Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"b74d8411-5b9e-4567-9fba-a2b37a64c272","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:17.177966351Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"b74d8411-5b9e-4567-9fba-a2b37a64c272","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:18.029687566Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"14ae969f-4213-4228-8575-cacc27347af8","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:18.038774266Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"be02c096-f361-42ac-b85d-9167cb32ac73","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:34:18.042907209Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:18.060151278Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"14ae969f-4213-4228-8575-cacc27347af8","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:18.060188222Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"14ae969f-4213-4228-8575-cacc27347af8","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:18.060258867Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"977933b7-6abc-433b-9b9f-32259fca3c69","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:34:18.060491839Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:18.158708825Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"977933b7-6abc-433b-9b9f-32259fca3c69","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:18.158748245Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"977933b7-6abc-433b-9b9f-32259fca3c69","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:18.158830024Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"2ecb163c-1fd7-4344-b64c-76dd3b4826da","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:18.262877056Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"2ecb163c-1fd7-4344-b64c-76dd3b4826da","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:18.262915338Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"2ecb163c-1fd7-4344-b64c-76dd3b4826da","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-15T04:34:18.263224772Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:18.263302774Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"5132221a-fe97-4447-87ed-891cf7d34bab","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:18.36059655Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"5132221a-fe97-4447-87ed-891cf7d34bab","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:18.360628885Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"5132221a-fe97-4447-87ed-891cf7d34bab","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:19.043964071Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"e994aedb-0cc9-4610-8d73-61598741aa22","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:19.658716845Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"18686ebc-f810-4fcf-b50b-6d733034ac0a","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:34:19.673701751Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:19.693233096Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"18686ebc-f810-4fcf-b50b-6d733034ac0a","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:19.693267118Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"18686ebc-f810-4fcf-b50b-6d733034ac0a","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:19.693378881Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"1b00208b-a04a-4d02-8a52-17fc5d78ef5e","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:34:19.693635848Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:19.789857068Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"1b00208b-a04a-4d02-8a52-17fc5d78ef5e","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:19.78989171Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"1b00208b-a04a-4d02-8a52-17fc5d78ef5e","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:19.789971612Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"39a0961a-5dd4-45aa-ae36-621b7b1f4918","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:19.889267049Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"39a0961a-5dd4-45aa-ae36-621b7b1f4918","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:19.889300906Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"39a0961a-5dd4-45aa-ae36-621b7b1f4918","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:20.674415541Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"4c752f59-f402-4f42-a54d-9c108cb544f1","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:21.165480351Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"9bd7853a-00a6-4737-a970-0d637dd4c24c","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:21.188278014Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"9bd7853a-00a6-4737-a970-0d637dd4c24c","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:21.188314301Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"9bd7853a-00a6-4737-a970-0d637dd4c24c","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-15T04:34:21.188358735Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:21.188422024Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"5141f3e8-e46f-4c7f-bcad-249d6097f7fa","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:21.290027863Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"5141f3e8-e46f-4c7f-bcad-249d6097f7fa","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:21.290063489Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"5141f3e8-e46f-4c7f-bcad-249d6097f7fa","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-15T04:34:21.290144324Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:21.290215004Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"7035a5b9-759c-434a-ac10-096938220ab4","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:21.389398187Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"7035a5b9-759c-434a-ac10-096938220ab4","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:21.389431547Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"7035a5b9-759c-434a-ac10-096938220ab4","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:22.188768767Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"0ba40fb1-27ca-4991-8d54-f31fa364dc18","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:28.020738873Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"b5df7f2f-567c-4ef7-b93d-8470ee142aa0","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:34:28.034211006Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:28.051922493Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"b5df7f2f-567c-4ef7-b93d-8470ee142aa0","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:28.051948437Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"b5df7f2f-567c-4ef7-b93d-8470ee142aa0","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:28.052024175Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"31db4225-0e6c-443f-b239-01415dc39ae3","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:34:28.052127139Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:28.150499871Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"31db4225-0e6c-443f-b239-01415dc39ae3","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:28.150536051Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"31db4225-0e6c-443f-b239-01415dc39ae3","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:28.150612291Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"ea5a5754-e74e-45a2-9dad-49c57448422b","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:28.171630525Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"ea5a5754-e74e-45a2-9dad-49c57448422b","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:28.171661573Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"ea5a5754-e74e-45a2-9dad-49c57448422b","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:29.029746214Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"c73058bc-5c4e-4f0b-9eea-4542f294a83b","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:29.034413145Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"a1b338de-bad1-4018-b4c7-351e33bd19cd","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:34:29.043461307Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:34:29.062764008Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:29.062867676Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"c73058bc-5c4e-4f0b-9eea-4542f294a83b","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:29.062895029Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"c73058bc-5c4e-4f0b-9eea-4542f294a83b","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:29.062972351Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"e72dbe30-976f-4948-ac0f-4cdf1af5c95a","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:29.160525274Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"e72dbe30-976f-4948-ac0f-4cdf1af5c95a","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:29.160556456Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"e72dbe30-976f-4948-ac0f-4cdf1af5c95a","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:30.044148689Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"3f5f31c1-934a-4561-9019-72433d604d39","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:39.882050784Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"7d8eeb36-008b-4f81-94a6-a20f80f43824","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:34:39.907968303Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:39.908011694Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"7d8eeb36-008b-4f81-94a6-a20f80f43824","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:39.908045968Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"7d8eeb36-008b-4f81-94a6-a20f80f43824","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:39.908152761Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"26f3ff95-e551-46dc-ab83-ec4df9904478","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:40.004766321Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"26f3ff95-e551-46dc-ab83-ec4df9904478","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:40.004800749Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"26f3ff95-e551-46dc-ab83-ec4df9904478","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:34:40.909026375Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"0599a494-584a-4e78-84ea-d3d5a803cb15","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:44.731651753Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"2a9181b6-138f-4d7d-b12b-a9afd99e6b95","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:34:44.7368552Z","logger":"events","caller":"recorder/recorder.go:104","msg":"TrainJob resources reconciliation failed: jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated","type":"Warning","object":{"kind":"TrainJob","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","uid":"c110e96e-a628-48c3-b578-9ac68a63a8a6","apiVersion":"trainer.kubeflow.org/v1alpha1","resourceVersion":"71017"},"reason":"TrainJobResourcesCreationFailed"} {"level":"debug","ts":"2026-07-15T04:34:44.755152797Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"2a9181b6-138f-4d7d-b12b-a9afd99e6b95","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no pods found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919"} {"level":"Level(-2)","ts":"2026-07-15T04:34:44.755183405Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"2a9181b6-138f-4d7d-b12b-a9afd99e6b95","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-15T04:34:44.755221428Z","caller":"controller/controller.go:472","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"2a9181b6-138f-4d7d-b12b-a9afd99e6b95"} {"level":"error","ts":"2026-07-15T04:34:44.755233263Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"2a9181b6-138f-4d7d-b12b-a9afd99e6b95","error":"jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated\nJobSet.jobset.x-k8s.io \"lifecycle-train-job-141919\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:34:44.760516128Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"a3f73f9c-efea-4c65-a05e-2a67548e40eb","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:34:44.765040346Z","logger":"events","caller":"recorder/recorder.go:104","msg":"TrainJob resources reconciliation failed: jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated","type":"Warning","object":{"kind":"TrainJob","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","uid":"c110e96e-a628-48c3-b578-9ac68a63a8a6","apiVersion":"trainer.kubeflow.org/v1alpha1","resourceVersion":"71017"},"reason":"TrainJobResourcesCreationFailed"} {"level":"debug","ts":"2026-07-15T04:34:44.781118658Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"a3f73f9c-efea-4c65-a05e-2a67548e40eb","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no pods found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919"} {"level":"Level(-2)","ts":"2026-07-15T04:34:44.781151081Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"a3f73f9c-efea-4c65-a05e-2a67548e40eb","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-15T04:34:44.781187889Z","caller":"controller/controller.go:472","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"a3f73f9c-efea-4c65-a05e-2a67548e40eb"} {"level":"error","ts":"2026-07-15T04:34:44.781199879Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"a3f73f9c-efea-4c65-a05e-2a67548e40eb","error":"jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated\nJobSet.jobset.x-k8s.io \"lifecycle-train-job-141919\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:34:44.791471002Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c41d8291-91be-4a1c-ae4b-e70fd94756a8","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:34:44.795916997Z","logger":"events","caller":"recorder/recorder.go:104","msg":"TrainJob resources reconciliation failed: jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated","type":"Warning","object":{"kind":"TrainJob","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","uid":"c110e96e-a628-48c3-b578-9ac68a63a8a6","apiVersion":"trainer.kubeflow.org/v1alpha1","resourceVersion":"71017"},"reason":"TrainJobResourcesCreationFailed"} {"level":"debug","ts":"2026-07-15T04:34:44.81133179Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c41d8291-91be-4a1c-ae4b-e70fd94756a8","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no pods found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919"} {"level":"Level(-2)","ts":"2026-07-15T04:34:44.811358186Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c41d8291-91be-4a1c-ae4b-e70fd94756a8","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-15T04:34:44.811387666Z","caller":"controller/controller.go:472","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c41d8291-91be-4a1c-ae4b-e70fd94756a8"} {"level":"error","ts":"2026-07-15T04:34:44.811396908Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c41d8291-91be-4a1c-ae4b-e70fd94756a8","error":"jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated\nJobSet.jobset.x-k8s.io \"lifecycle-train-job-141919\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:34:44.831668192Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"0f3506a4-2832-4a78-82c5-8eb2500829ea","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:34:44.836252931Z","logger":"events","caller":"recorder/recorder.go:104","msg":"TrainJob resources reconciliation failed: jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated","type":"Warning","object":{"kind":"TrainJob","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","uid":"c110e96e-a628-48c3-b578-9ac68a63a8a6","apiVersion":"trainer.kubeflow.org/v1alpha1","resourceVersion":"71017"},"reason":"TrainJobResourcesCreationFailed"} {"level":"debug","ts":"2026-07-15T04:34:44.850905682Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"0f3506a4-2832-4a78-82c5-8eb2500829ea","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no pods found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919"} {"level":"Level(-2)","ts":"2026-07-15T04:34:44.850932269Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"0f3506a4-2832-4a78-82c5-8eb2500829ea","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-15T04:34:44.850961322Z","caller":"controller/controller.go:472","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"0f3506a4-2832-4a78-82c5-8eb2500829ea"} {"level":"error","ts":"2026-07-15T04:34:44.850970121Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"0f3506a4-2832-4a78-82c5-8eb2500829ea","error":"jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated\nJobSet.jobset.x-k8s.io \"lifecycle-train-job-141919\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:34:44.891248321Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"34ee27f2-d766-474c-af41-d953c6c4c097","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:34:44.895773281Z","logger":"events","caller":"recorder/recorder.go:104","msg":"TrainJob resources reconciliation failed: jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated","type":"Warning","object":{"kind":"TrainJob","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","uid":"c110e96e-a628-48c3-b578-9ac68a63a8a6","apiVersion":"trainer.kubeflow.org/v1alpha1","resourceVersion":"71017"},"reason":"TrainJobResourcesCreationFailed"} {"level":"debug","ts":"2026-07-15T04:34:44.910982698Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"34ee27f2-d766-474c-af41-d953c6c4c097","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no pods found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919"} {"level":"Level(-2)","ts":"2026-07-15T04:34:44.911014599Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"34ee27f2-d766-474c-af41-d953c6c4c097","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-15T04:34:44.911043992Z","caller":"controller/controller.go:472","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"34ee27f2-d766-474c-af41-d953c6c4c097"} {"level":"error","ts":"2026-07-15T04:34:44.911051632Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"34ee27f2-d766-474c-af41-d953c6c4c097","error":"jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated\nJobSet.jobset.x-k8s.io \"lifecycle-train-job-141919\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:34:44.991420007Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"a50cee41-4ab7-4bbe-afaa-b1214aa472ed","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:34:44.996527387Z","logger":"events","caller":"recorder/recorder.go:104","msg":"TrainJob resources reconciliation failed: jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated","type":"Warning","object":{"kind":"TrainJob","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","uid":"c110e96e-a628-48c3-b578-9ac68a63a8a6","apiVersion":"trainer.kubeflow.org/v1alpha1","resourceVersion":"71017"},"reason":"TrainJobResourcesCreationFailed"} {"level":"debug","ts":"2026-07-15T04:34:45.012842239Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"a50cee41-4ab7-4bbe-afaa-b1214aa472ed","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no pods found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919"} {"level":"Level(-2)","ts":"2026-07-15T04:34:45.012872006Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"a50cee41-4ab7-4bbe-afaa-b1214aa472ed","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-15T04:34:45.012901844Z","caller":"controller/controller.go:472","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"a50cee41-4ab7-4bbe-afaa-b1214aa472ed"} {"level":"error","ts":"2026-07-15T04:34:45.012910732Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"a50cee41-4ab7-4bbe-afaa-b1214aa472ed","error":"jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated\nJobSet.jobset.x-k8s.io \"lifecycle-train-job-141919\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:34:45.173476386Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"1e1bdc50-fb0e-42c2-bdb7-c0c5996ea716","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-15T04:34:45.178559807Z","logger":"events","caller":"recorder/recorder.go:104","msg":"TrainJob resources reconciliation failed: jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated","type":"Warning","object":{"kind":"TrainJob","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","uid":"c110e96e-a628-48c3-b578-9ac68a63a8a6","apiVersion":"trainer.kubeflow.org/v1alpha1","resourceVersion":"71017"},"reason":"TrainJobResourcesCreationFailed"} {"level":"debug","ts":"2026-07-15T04:34:45.282966314Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"1e1bdc50-fb0e-42c2-bdb7-c0c5996ea716","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no pods found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919"} {"level":"Level(-2)","ts":"2026-07-15T04:34:45.283003279Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"1e1bdc50-fb0e-42c2-bdb7-c0c5996ea716","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-15T04:34:45.283037584Z","caller":"controller/controller.go:472","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"1e1bdc50-fb0e-42c2-bdb7-c0c5996ea716"} {"level":"error","ts":"2026-07-15T04:34:45.283047288Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"1e1bdc50-fb0e-42c2-bdb7-c0c5996ea716","error":"jobsets.jobset.x-k8s.io \"lifecycle-train-job-141919\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated\nJobSet.jobset.x-k8s.io \"lifecycle-train-job-141919\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-15T04:34:45.399252095Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:178","msg":"TrainJob delete event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:46.400358745Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"f0e64f79-3cba-4e63-8552-903255ef7c8f","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-15T04:34:55.793581355Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:178","msg":"TrainJob delete event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:34:56.666990446Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"a8c1f9a3-a444-4d7b-b8a9-f9709b8c6be0","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:06.680926685Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"0ea9e0ea-73bd-44eb-b052-48d736d6c84b","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:35:07.252389547Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:172","msg":"TrainJob create event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:07.252474108Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"68ddfefc-443a-4ff9-ad51-320328bb8c5c","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:07.296566691Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"200c1bc0-d41e-401d-b0da-7e5f0f08984e","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:35:07.296585712Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:35:07.316441975Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"error","ts":"2026-07-15T04:35:07.32289266Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"200c1bc0-d41e-401d-b0da-7e5f0f08984e","error":"Operation cannot be fulfilled on trainjobs.trainer.kubeflow.org \"test-train-job-113378\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:35:07.322974627Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"80e4021d-fdf7-422e-96b5-cfb688ed32d7","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:35:07.328632809Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"error","ts":"2026-07-15T04:35:07.346863129Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"80e4021d-fdf7-422e-96b5-cfb688ed32d7","error":"Operation cannot be fulfilled on trainjobs.trainer.kubeflow.org \"test-train-job-113378\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:35:07.346971711Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"830f0a34-dd3b-40ba-b2d6-fbf9da733fc3","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:35:07.374799592Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-15T04:35:07.43435119Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"830f0a34-dd3b-40ba-b2d6-fbf9da733fc3","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob trainer-v2-test-113378/test-train-job-113378; found pods: [test-train-job-113378-node-0-0-6tsks: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-15T04:35:07.434385913Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"830f0a34-dd3b-40ba-b2d6-fbf9da733fc3","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:35:07.434489528Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"894ae69a-8d77-4b60-a847-8e00a0f3091b","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:35:07.447144294Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-15T04:35:07.541777363Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"894ae69a-8d77-4b60-a847-8e00a0f3091b","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob trainer-v2-test-113378/test-train-job-113378; found pods: [test-train-job-113378-node-0-0-6tsks: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-15T04:35:07.541813826Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"894ae69a-8d77-4b60-a847-8e00a0f3091b","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:35:07.541912312Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"e401d403-8c7a-460a-95cc-76d49d771e08","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-15T04:35:07.642182079Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"e401d403-8c7a-460a-95cc-76d49d771e08","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob trainer-v2-test-113378/test-train-job-113378; found pods: [test-train-job-113378-node-0-0-6tsks: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-15T04:35:07.642217142Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"e401d403-8c7a-460a-95cc-76d49d771e08","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:35:08.253292743Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"f1365bdd-bc37-4eb7-a616-8ca04ee812e6","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:08.268270595Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"7673161f-d1d8-4446-a839-4e0ed3534f60","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:10.191112492Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"7f9e9519-b9ea-4309-87ae-815b0c0b397e","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:35:10.207200614Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:10.228102463Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"7f9e9519-b9ea-4309-87ae-815b0c0b397e","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:10.228138801Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"7f9e9519-b9ea-4309-87ae-815b0c0b397e","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:35:10.228221656Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"603afe04-e47f-495b-877f-f9029db80cba","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:35:10.228269066Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:10.322980339Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"603afe04-e47f-495b-877f-f9029db80cba","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:10.323013596Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"603afe04-e47f-495b-877f-f9029db80cba","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:35:10.323122369Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"a17ad7a3-fa8b-4493-8fc9-b7f9817eb2bf","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:10.424524948Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"a17ad7a3-fa8b-4493-8fc9-b7f9817eb2bf","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:10.424557857Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"a17ad7a3-fa8b-4493-8fc9-b7f9817eb2bf","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:35:11.208266927Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"6c9c6b10-49c4-4cc0-9905-9c5b11dbed72","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:25.470267432Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"3d65d125-65b3-43c6-8c54-941d59a25bfa","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:35:25.483310991Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:25.505974547Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"3d65d125-65b3-43c6-8c54-941d59a25bfa","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:25.506011831Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"3d65d125-65b3-43c6-8c54-941d59a25bfa","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:35:25.506143733Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"24e06573-4964-44c8-ac91-c6dd1e8f80cb","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:35:25.506145088Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:25.599697712Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"24e06573-4964-44c8-ac91-c6dd1e8f80cb","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:25.599729283Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"24e06573-4964-44c8-ac91-c6dd1e8f80cb","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:35:25.599813073Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"0a4a6369-0e47-48d2-aa7b-f2f128249547","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:25.700914637Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"0a4a6369-0e47-48d2-aa7b-f2f128249547","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:25.700951387Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"0a4a6369-0e47-48d2-aa7b-f2f128249547","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"info","ts":"2026-07-15T04:35:25.701110817Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:25.701177378Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"557b54cc-2ac4-42ff-91aa-abafc61b8b65","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:25.799297343Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"557b54cc-2ac4-42ff-91aa-abafc61b8b65","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:25.799329004Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"557b54cc-2ac4-42ff-91aa-abafc61b8b65","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:35:26.484368513Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"87a0b48d-d23f-41f1-a22d-93de99350b3b","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:34.021499988Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"2fa80515-5392-4a81-8f15-b8907594cb7c","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:35:34.03455207Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:34.053300342Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"2fa80515-5392-4a81-8f15-b8907594cb7c","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:34.053336869Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"2fa80515-5392-4a81-8f15-b8907594cb7c","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"info","ts":"2026-07-15T04:35:34.053409326Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:34.053423556Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"7b010c4b-2c99-458d-86d2-95a96dbdda63","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:34.151827816Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"7b010c4b-2c99-458d-86d2-95a96dbdda63","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:34.151862198Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"7b010c4b-2c99-458d-86d2-95a96dbdda63","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:35:34.151943379Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"3d02ff0a-63bc-4ae8-950b-7664dfb9bea4","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:34.252418553Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"3d02ff0a-63bc-4ae8-950b-7664dfb9bea4","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:34.252454752Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"3d02ff0a-63bc-4ae8-950b-7664dfb9bea4","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:35:35.030020059Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"a86b6826-9fb6-42b1-a380-4d68ecd8cd28","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:35.034725084Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"0c5a587a-3093-4f11-a7d4-a1b47c5c5fd8","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:35:35.043174072Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:35.060557797Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"a86b6826-9fb6-42b1-a380-4d68ecd8cd28","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:35.060591257Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"a86b6826-9fb6-42b1-a380-4d68ecd8cd28","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"info","ts":"2026-07-15T04:35:35.060639283Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:35.060658885Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"31f93e3b-3d78-4f96-ae65-93b1907dbc2a","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:35.158490634Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"31f93e3b-3d78-4f96-ae65-93b1907dbc2a","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:35.158523152Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"31f93e3b-3d78-4f96-ae65-93b1907dbc2a","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:35:35.158621808Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"bea82d97-6708-4efb-a96c-e1aad81e0a15","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:35.176172124Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"bea82d97-6708-4efb-a96c-e1aad81e0a15","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:35.176200988Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"bea82d97-6708-4efb-a96c-e1aad81e0a15","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:35:36.043418743Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"02ebb12b-ff24-420e-a9ad-69de8794ce17","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:37.435361022Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"9aa531cf-f37e-428e-8f11-e4b46039d5a7","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:37.458311431Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"9aa531cf-f37e-428e-8f11-e4b46039d5a7","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:37.458355405Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"9aa531cf-f37e-428e-8f11-e4b46039d5a7","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"info","ts":"2026-07-15T04:35:37.458420153Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:37.458502714Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"1477e02b-a1ae-4848-bfdd-dac1fb8d74d8","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:37.556245472Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"1477e02b-a1ae-4848-bfdd-dac1fb8d74d8","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:35:37.556277214Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"1477e02b-a1ae-4848-bfdd-dac1fb8d74d8","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:35:38.458918345Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"b1feb053-8489-4d9b-848e-982f58cd2cfb","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:02.473430263Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"67115ffd-19d1-469e-9cd7-4026e8e5150d","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:36:02.63745973Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:178","msg":"TrainJob delete event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:03.638549482Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"7eb197a0-6e1d-4378-8631-b27c081eb5f6","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:14.112633607Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"72fb66d1-8ea6-4d0c-9b1b-532d72f28f0c","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:36:14.710078485Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:172","msg":"TrainJob create event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:14.710208933Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"50c3965f-a027-49be-bd9b-de51e86e6d3a","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:36:14.753245508Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:14.753264629Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"a0aaa5ae-9c43-4cd9-9fa6-fed3836a31d7","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:36:14.781878238Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"error","ts":"2026-07-15T04:36:14.782204562Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"a0aaa5ae-9c43-4cd9-9fa6-fed3836a31d7","error":"Operation cannot be fulfilled on trainjobs.trainer.kubeflow.org \"test-train-job-113378\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:36:14.782290067Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"b6062f66-a6ce-49a6-8164-51e9270910ab","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:36:14.79586994Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"error","ts":"2026-07-15T04:36:14.806406237Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"b6062f66-a6ce-49a6-8164-51e9270910ab","error":"Operation cannot be fulfilled on trainjobs.trainer.kubeflow.org \"test-train-job-113378\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:36:14.806483729Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"f7b44088-0a32-4c5a-a5e0-8cf4be36bbfe","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:36:14.834114201Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-15T04:36:14.913760038Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"f7b44088-0a32-4c5a-a5e0-8cf4be36bbfe","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob trainer-v2-test-113378/test-train-job-113378; found pods: [test-train-job-113378-node-0-0-6n54l: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-15T04:36:14.91379738Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"f7b44088-0a32-4c5a-a5e0-8cf4be36bbfe","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:36:14.9138942Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"feac4ca6-a66c-4de7-875d-08c2b534421d","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:36:14.928535431Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-15T04:36:15.004762027Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"feac4ca6-a66c-4de7-875d-08c2b534421d","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob trainer-v2-test-113378/test-train-job-113378; found pods: [test-train-job-113378-node-0-0-6n54l: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-15T04:36:15.004798941Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"feac4ca6-a66c-4de7-875d-08c2b534421d","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:36:15.00488902Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"fda4c7f0-e131-4c11-aa81-66505735ea27","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-15T04:36:15.096720557Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"fda4c7f0-e131-4c11-aa81-66505735ea27","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob trainer-v2-test-113378/test-train-job-113378; found pods: [test-train-job-113378-node-0-0-6n54l: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-15T04:36:15.096759043Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"fda4c7f0-e131-4c11-aa81-66505735ea27","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:36:15.711295045Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"072b68d5-17cd-4902-ac1d-52fa85ce25cd","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:15.726522537Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"06f1205c-25c3-4b43-bb3f-b8e9cc381391","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:17.648977463Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"fbe1098e-7a7b-4be1-841c-45e36a4317b1","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:36:17.661872957Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:36:17.68190265Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:17.681956383Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"fbe1098e-7a7b-4be1-841c-45e36a4317b1","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:17.681980275Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"fbe1098e-7a7b-4be1-841c-45e36a4317b1","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:36:17.682054003Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"755f61fa-825b-4211-b19b-37f1e02c34cc","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:17.779993399Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"755f61fa-825b-4211-b19b-37f1e02c34cc","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:17.780031552Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"755f61fa-825b-4211-b19b-37f1e02c34cc","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:36:18.662227687Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"d46c137e-e96e-48e3-9cc2-ab721e391238","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:27.167393922Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"ccd425fe-b709-468c-920c-25a5558b25c9","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:32.879323783Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"37da23e7-81b9-4107-9ec2-369573b379f0","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:36:32.892377943Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:32.914616902Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"37da23e7-81b9-4107-9ec2-369573b379f0","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:32.914652407Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"37da23e7-81b9-4107-9ec2-369573b379f0","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:36:32.914731588Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"5b2a3ba2-a4b3-4c15-8ff6-73c7012bb16d","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:36:32.914821723Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:33.007434911Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"5b2a3ba2-a4b3-4c15-8ff6-73c7012bb16d","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:33.007465009Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"5b2a3ba2-a4b3-4c15-8ff6-73c7012bb16d","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:36:33.007543487Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"83a39947-efe7-4cdd-a15a-228af7f88d5c","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:33.028105647Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"83a39947-efe7-4cdd-a15a-228af7f88d5c","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:33.028135474Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"83a39947-efe7-4cdd-a15a-228af7f88d5c","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"info","ts":"2026-07-15T04:36:33.028367582Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:33.028438728Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"3871af4e-c820-44b0-a0b9-f0e08b525bf4","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:33.107311528Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"3871af4e-c820-44b0-a0b9-f0e08b525bf4","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:33.107344623Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"3871af4e-c820-44b0-a0b9-f0e08b525bf4","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:36:33.892644724Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"15b1b293-8282-482c-944e-3023d3644531","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:41.021416592Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"92e6e688-ee0b-411f-839e-ccc68d119137","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:36:41.034594855Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:41.051648031Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"92e6e688-ee0b-411f-839e-ccc68d119137","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:41.051679886Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"92e6e688-ee0b-411f-839e-ccc68d119137","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:36:41.051752143Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"d9c3c19a-f0b9-4b1f-8467-25eea2aac2be","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:36:41.051845813Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:41.15040194Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"d9c3c19a-f0b9-4b1f-8467-25eea2aac2be","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:41.150433157Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"d9c3c19a-f0b9-4b1f-8467-25eea2aac2be","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:36:41.150525435Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"59af2b9a-f58f-4ddb-8ac5-3a75e7164a95","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:41.169708591Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"59af2b9a-f58f-4ddb-8ac5-3a75e7164a95","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:41.169738538Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"59af2b9a-f58f-4ddb-8ac5-3a75e7164a95","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:36:42.030916056Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"482e4a54-5b8d-4469-a066-3cec31bc2349","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:42.035138389Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"d48b06c6-6f15-4ec4-9c11-6af38fd1934f","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:36:42.0463393Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:42.066519379Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"482e4a54-5b8d-4469-a066-3cec31bc2349","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:42.066543839Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"482e4a54-5b8d-4469-a066-3cec31bc2349","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"info","ts":"2026-07-15T04:36:42.06660989Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:42.066616477Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"0a11fdc9-c828-48b8-ade2-4331ee8c0147","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:42.162291626Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"0a11fdc9-c828-48b8-ade2-4331ee8c0147","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:42.162324274Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"0a11fdc9-c828-48b8-ade2-4331ee8c0147","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:36:42.162403416Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"fdc3b36d-7bd0-43ed-9441-ff17cdbfb54f","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:42.180439044Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"fdc3b36d-7bd0-43ed-9441-ff17cdbfb54f","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:42.180469215Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"fdc3b36d-7bd0-43ed-9441-ff17cdbfb54f","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:36:43.046589359Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"be49987d-7832-46ed-893c-ed1877d82202","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:44.914163822Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"2dea9441-df5c-47ce-a020-bfb7c8f34a3f","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-15T04:36:44.937778156Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:44.937886336Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"2dea9441-df5c-47ce-a020-bfb7c8f34a3f","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:44.937911955Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"2dea9441-df5c-47ce-a020-bfb7c8f34a3f","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:36:44.937983038Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"23f2ef2c-98c4-4975-a92d-a9e4049d61f1","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:45.038212628Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"23f2ef2c-98c4-4975-a92d-a9e4049d61f1","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:45.03824434Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"23f2ef2c-98c4-4975-a92d-a9e4049d61f1","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"info","ts":"2026-07-15T04:36:45.038435873Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:45.038525392Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"16add1a5-1982-4f92-8e37-fffc898ea663","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:45.136925515Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"16add1a5-1982-4f92-8e37-fffc898ea663","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:36:45.136958068Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"16add1a5-1982-4f92-8e37-fffc898ea663","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-15T04:36:45.938285244Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"5f43b050-aa97-41c6-ac2c-f75ca307366d","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:37:09.108634936Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"01a33c8d-2973-4a1e-b055-d711306c91ae","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-15T04:37:09.113420959Z","logger":"events","caller":"recorder/recorder.go:104","msg":"TrainJob resources reconciliation failed: jobsets.jobset.x-k8s.io \"test-train-job-113378\" is forbidden: unable to create new content in namespace trainer-v2-test-113378 because it is being terminated","type":"Warning","object":{"kind":"TrainJob","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","uid":"3060f69b-2ca9-44d5-a18f-0bc29630377a","apiVersion":"trainer.kubeflow.org/v1alpha1","resourceVersion":"74160"},"reason":"TrainJobResourcesCreationFailed"} {"level":"debug","ts":"2026-07-15T04:37:09.227505066Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"01a33c8d-2973-4a1e-b055-d711306c91ae","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no pods found for TrainJob trainer-v2-test-113378/test-train-job-113378"} {"level":"Level(-2)","ts":"2026-07-15T04:37:09.227542596Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"01a33c8d-2973-4a1e-b055-d711306c91ae","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"info","ts":"2026-07-15T04:37:09.227574514Z","caller":"controller/controller.go:472","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"01a33c8d-2973-4a1e-b055-d711306c91ae"} {"level":"error","ts":"2026-07-15T04:37:09.227587067Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"01a33c8d-2973-4a1e-b055-d711306c91ae","error":"jobsets.jobset.x-k8s.io \"test-train-job-113378\" is forbidden: unable to create new content in namespace trainer-v2-test-113378 because it is being terminated\nJobSet.jobset.x-k8s.io \"test-train-job-113378\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:37:09.232845416Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"cc65ea4e-4a23-4a33-a8d5-6fbe78709bdd","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-15T04:37:09.237554578Z","logger":"events","caller":"recorder/recorder.go:104","msg":"TrainJob resources reconciliation failed: jobsets.jobset.x-k8s.io \"test-train-job-113378\" is forbidden: unable to create new content in namespace trainer-v2-test-113378 because it is being terminated","type":"Warning","object":{"kind":"TrainJob","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","uid":"3060f69b-2ca9-44d5-a18f-0bc29630377a","apiVersion":"trainer.kubeflow.org/v1alpha1","resourceVersion":"74160"},"reason":"TrainJobResourcesCreationFailed"} {"level":"debug","ts":"2026-07-15T04:37:09.256392467Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"cc65ea4e-4a23-4a33-a8d5-6fbe78709bdd","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no pods found for TrainJob trainer-v2-test-113378/test-train-job-113378"} {"level":"Level(-2)","ts":"2026-07-15T04:37:09.256425861Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"cc65ea4e-4a23-4a33-a8d5-6fbe78709bdd","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"info","ts":"2026-07-15T04:37:09.256459374Z","caller":"controller/controller.go:472","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"cc65ea4e-4a23-4a33-a8d5-6fbe78709bdd"} {"level":"error","ts":"2026-07-15T04:37:09.256472885Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"cc65ea4e-4a23-4a33-a8d5-6fbe78709bdd","error":"jobsets.jobset.x-k8s.io \"test-train-job-113378\" is forbidden: unable to create new content in namespace trainer-v2-test-113378 because it is being terminated\nJobSet.jobset.x-k8s.io \"test-train-job-113378\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:37:09.26677747Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"49cc2344-888b-4a81-ac55-8ec7918e7f07","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-15T04:37:09.271227125Z","logger":"events","caller":"recorder/recorder.go:104","msg":"TrainJob resources reconciliation failed: jobsets.jobset.x-k8s.io \"test-train-job-113378\" is forbidden: unable to create new content in namespace trainer-v2-test-113378 because it is being terminated","type":"Warning","object":{"kind":"TrainJob","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","uid":"3060f69b-2ca9-44d5-a18f-0bc29630377a","apiVersion":"trainer.kubeflow.org/v1alpha1","resourceVersion":"74160"},"reason":"TrainJobResourcesCreationFailed"} {"level":"debug","ts":"2026-07-15T04:37:09.327963595Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"49cc2344-888b-4a81-ac55-8ec7918e7f07","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no pods found for TrainJob trainer-v2-test-113378/test-train-job-113378"} {"level":"Level(-2)","ts":"2026-07-15T04:37:09.327997819Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"49cc2344-888b-4a81-ac55-8ec7918e7f07","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"info","ts":"2026-07-15T04:37:09.328039667Z","caller":"controller/controller.go:472","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"49cc2344-888b-4a81-ac55-8ec7918e7f07"} {"level":"error","ts":"2026-07-15T04:37:09.328050691Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"49cc2344-888b-4a81-ac55-8ec7918e7f07","error":"jobsets.jobset.x-k8s.io \"test-train-job-113378\" is forbidden: unable to create new content in namespace trainer-v2-test-113378 because it is being terminated\nJobSet.jobset.x-k8s.io \"test-train-job-113378\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:37:09.348387978Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"2499d64e-c1e6-4ba6-a6ba-553fb286d09a","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-15T04:37:09.355511809Z","logger":"events","caller":"recorder/recorder.go:104","msg":"TrainJob resources reconciliation failed: jobsets.jobset.x-k8s.io \"test-train-job-113378\" is forbidden: unable to create new content in namespace trainer-v2-test-113378 because it is being terminated","type":"Warning","object":{"kind":"TrainJob","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","uid":"3060f69b-2ca9-44d5-a18f-0bc29630377a","apiVersion":"trainer.kubeflow.org/v1alpha1","resourceVersion":"74160"},"reason":"TrainJobResourcesCreationFailed"} {"level":"debug","ts":"2026-07-15T04:37:09.373035822Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"2499d64e-c1e6-4ba6-a6ba-553fb286d09a","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no pods found for TrainJob trainer-v2-test-113378/test-train-job-113378"} {"level":"Level(-2)","ts":"2026-07-15T04:37:09.37306818Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"2499d64e-c1e6-4ba6-a6ba-553fb286d09a","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"info","ts":"2026-07-15T04:37:09.373128215Z","caller":"controller/controller.go:472","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"2499d64e-c1e6-4ba6-a6ba-553fb286d09a"} {"level":"error","ts":"2026-07-15T04:37:09.373138358Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"2499d64e-c1e6-4ba6-a6ba-553fb286d09a","error":"jobsets.jobset.x-k8s.io \"test-train-job-113378\" is forbidden: unable to create new content in namespace trainer-v2-test-113378 because it is being terminated\nJobSet.jobset.x-k8s.io \"test-train-job-113378\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-15T04:37:09.413438601Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"1c96dc79-f06e-4a01-b2a5-50f3bf1ab2cd","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-15T04:37:09.418316493Z","logger":"events","caller":"recorder/recorder.go:104","msg":"TrainJob resources reconciliation failed: jobsets.jobset.x-k8s.io \"test-train-job-113378\" is forbidden: unable to create new content in namespace trainer-v2-test-113378 because it is being terminated","type":"Warning","object":{"kind":"TrainJob","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","uid":"3060f69b-2ca9-44d5-a18f-0bc29630377a","apiVersion":"trainer.kubeflow.org/v1alpha1","resourceVersion":"74160"},"reason":"TrainJobResourcesCreationFailed"} {"level":"debug","ts":"2026-07-15T04:37:09.524563702Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"1c96dc79-f06e-4a01-b2a5-50f3bf1ab2cd","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no pods found for TrainJob trainer-v2-test-113378/test-train-job-113378"} {"level":"Level(-2)","ts":"2026-07-15T04:37:09.524597644Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"1c96dc79-f06e-4a01-b2a5-50f3bf1ab2cd","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"info","ts":"2026-07-15T04:37:09.52463094Z","caller":"controller/controller.go:472","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"1c96dc79-f06e-4a01-b2a5-50f3bf1ab2cd"} {"level":"error","ts":"2026-07-15T04:37:09.524639703Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"1c96dc79-f06e-4a01-b2a5-50f3bf1ab2cd","error":"jobsets.jobset.x-k8s.io \"test-train-job-113378\" is forbidden: unable to create new content in namespace trainer-v2-test-113378 because it is being terminated\nJobSet.jobset.x-k8s.io \"test-train-job-113378\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-15T04:37:09.536944162Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:178","msg":"TrainJob delete event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-15T04:37:10.537234696Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"6154916d-fc49-4321-abfe-6db42037803b","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} ==================== WORKLOAD POD LOG: redhat-ods-applications/kubeflow-training-operator-54f75bb57d-xvq4g.log ==================== 2026-07-15T04:12:36Z INFO setup Probe endpoints are configured on healthz and readyz 2026-07-15T04:12:36Z INFO setup starting manager 2026-07-15T04:12:36Z INFO setup Waiting for certificate generation to complete 2026-07-15T04:12:36Z INFO controller-runtime.metrics Starting metrics server 2026-07-15T04:12:36Z INFO starting server {"name": "health probe", "addr": "[::]:8081"} 2026-07-15T04:12:36Z INFO controller-runtime.metrics Serving metrics server {"bindAddress": ":8080", "secure": false} 2026-07-15T04:12:36Z INFO cert-rotation starting cert rotator controller 2026-07-15T04:12:36Z INFO Starting EventSource {"controller": "cert-rotator", "source": "kind source: *v1.Secret"} 2026-07-15T04:12:36Z INFO Starting EventSource {"controller": "cert-rotator", "source": "kind source: *unstructured.Unstructured"} 2026-07-15T04:12:36Z INFO Starting Controller {"controller": "cert-rotator"} 2026-07-15T04:12:36Z INFO cert-rotation refreshing CA and server certs 2026-07-15T04:12:36Z INFO Starting workers {"controller": "cert-rotator", "worker count": 1} 2026-07-15T04:12:36Z INFO cert-rotation refreshing CA and server certs 2026-07-15T04:12:37Z INFO cert-rotation server certs refreshed 2026-07-15T04:12:37Z ERROR cert-rotation could not refresh CA and server certs {"error": "Operation cannot be fulfilled on secrets \"kubeflow-training-operator-webhook-cert\": the object has been modified; please apply your changes to the latest version and try again"} 2026-07-15T04:12:37Z INFO cert-rotation no cert refresh needed 2026-07-15T04:12:37Z ERROR cert-rotation secret is not well-formed, cannot update webhook configurations {"error": "Cert secret is not well-formed, missing ca.crt", "errorVerbose": "Cert secret is not well-formed, missing ca.crt\ngithub.com/open-policy-agent/cert-controller/pkg/rotator.buildArtifactsFromSecret\n\t/cachi2/output/deps/gomod/pkg/mod/github.com/open-policy-agent/cert-controller@v0.12.0/pkg/rotator/rotator.go:508\ngithub.com/open-policy-agent/cert-controller/pkg/rotator.(*ReconcileWH).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/github.com/open-policy-agent/cert-controller@v0.12.0/pkg/rotator/rotator.go:784\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.1/pkg/internal/controller/controller.go:116\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.1/pkg/internal/controller/controller.go:303\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.1/pkg/internal/controller/controller.go:263\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.1/pkg/internal/controller/controller.go:224\nruntime.goexit\n\t/usr/lib/golang/src/runtime/asm_amd64.s:1693"} 2026-07-15T04:12:37Z INFO cert-rotation no cert refresh needed 2026-07-15T04:12:37Z INFO cert-rotation Ensuring CA cert {"name": "kubeflow-validator.training-operator.kubeflow.org", "gvk": "admissionregistration.k8s.io/v1, Kind=ValidatingWebhookConfiguration", "name": "kubeflow-validator.training-operator.kubeflow.org", "gvk": "admissionregistration.k8s.io/v1, Kind=ValidatingWebhookConfiguration"} 2026-07-15T04:12:37Z INFO cert-rotation no cert refresh needed 2026-07-15T04:12:37Z INFO cert-rotation Ensuring CA cert {"name": "kubeflow-validator.training-operator.kubeflow.org", "gvk": "admissionregistration.k8s.io/v1, Kind=ValidatingWebhookConfiguration", "name": "kubeflow-validator.training-operator.kubeflow.org", "gvk": "admissionregistration.k8s.io/v1, Kind=ValidatingWebhookConfiguration"} 2026-07-15T04:12:39Z INFO cert-rotation certs are ready in /tmp/k8s-webhook-server/serving-certs 2026-07-15T04:12:39Z INFO cert-rotation CA certs are injected to webhooks 2026-07-15T04:12:39Z INFO setup Certs ready 2026-07-15T04:12:39Z INFO setup registering controllers... 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "pytorchjob-controller", "source": "kind source: *v1.PyTorchJob"} 2026-07-15T04:12:39Z INFO Starting Controller {"controller": "pytorchjob-controller"} 2026-07-15T04:12:39Z INFO Starting workers {"controller": "pytorchjob-controller", "worker count": 1} 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "pytorchjob-controller", "source": "kind source: *v1.Pod"} 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "pytorchjob-controller", "source": "kind source: *v1.Service"} 2026-07-15T04:12:39Z INFO controller-runtime.builder skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called {"GVK": "kubeflow.org/v1, Kind=PyTorchJob"} 2026-07-15T04:12:39Z INFO controller-runtime.builder Registering a validating webhook {"GVK": "kubeflow.org/v1, Kind=PyTorchJob", "path": "/validate-kubeflow-org-v1-pytorchjob"} 2026-07-15T04:12:39Z INFO controller-runtime.webhook Registering webhook {"path": "/validate-kubeflow-org-v1-pytorchjob"} 2026-07-15T04:12:39Z INFO controller-runtime.webhook Starting webhook server 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "xgboostjob-controller", "source": "kind source: *v1.XGBoostJob"} 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "xgboostjob-controller", "source": "kind source: *v1.Pod"} 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "xgboostjob-controller", "source": "kind source: *v1.Service"} 2026-07-15T04:12:39Z INFO Starting Controller {"controller": "xgboostjob-controller"} 2026-07-15T04:12:39Z INFO controller-runtime.certwatcher Updated current TLS certificate 2026-07-15T04:12:39Z INFO controller-runtime.webhook Serving webhook server {"host": "", "port": 9443} 2026-07-15T04:12:39Z INFO controller-runtime.certwatcher Starting certificate watcher 2026-07-15T04:12:39Z INFO controller-runtime.builder skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called {"GVK": "kubeflow.org/v1, Kind=XGBoostJob"} 2026-07-15T04:12:39Z INFO controller-runtime.builder Registering a validating webhook {"GVK": "kubeflow.org/v1, Kind=XGBoostJob", "path": "/validate-kubeflow-org-v1-xgboostjob"} 2026-07-15T04:12:39Z INFO controller-runtime.webhook Registering webhook {"path": "/validate-kubeflow-org-v1-xgboostjob"} 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "mpijob-controller", "source": "kind source: *v1.MPIJob"} 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "mpijob-controller", "source": "kind source: *v1.Pod"} 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "mpijob-controller", "source": "kind source: *v1.ConfigMap"} 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "mpijob-controller", "source": "kind source: *v1.Role"} 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "mpijob-controller", "source": "kind source: *v1.RoleBinding"} 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "mpijob-controller", "source": "kind source: *v1.ServiceAccount"} 2026-07-15T04:12:39Z INFO Starting Controller {"controller": "mpijob-controller"} 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "paddlejob-controller", "source": "kind source: *v1.PaddleJob"} 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "paddlejob-controller", "source": "kind source: *v1.Pod"} 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "paddlejob-controller", "source": "kind source: *v1.Service"} 2026-07-15T04:12:39Z INFO Starting Controller {"controller": "paddlejob-controller"} 2026-07-15T04:12:39Z INFO controller-runtime.builder skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called {"GVK": "kubeflow.org/v1, Kind=PaddleJob"} 2026-07-15T04:12:39Z INFO controller-runtime.builder Registering a validating webhook {"GVK": "kubeflow.org/v1, Kind=PaddleJob", "path": "/validate-kubeflow-org-v1-paddlejob"} 2026-07-15T04:12:39Z INFO controller-runtime.webhook Registering webhook {"path": "/validate-kubeflow-org-v1-paddlejob"} 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "jaxjob-controller", "source": "kind source: *v1.JAXJob"} 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "jaxjob-controller", "source": "kind source: *v1.Pod"} 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "jaxjob-controller", "source": "kind source: *v1.Service"} 2026-07-15T04:12:39Z INFO Starting Controller {"controller": "jaxjob-controller"} 2026-07-15T04:12:39Z INFO controller-runtime.builder skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called {"GVK": "kubeflow.org/v1, Kind=JAXJob"} 2026-07-15T04:12:39Z INFO controller-runtime.builder Registering a validating webhook {"GVK": "kubeflow.org/v1, Kind=JAXJob", "path": "/validate-kubeflow-org-v1-jaxjob"} 2026-07-15T04:12:39Z INFO controller-runtime.webhook Registering webhook {"path": "/validate-kubeflow-org-v1-jaxjob"} 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "tfjob-controller", "source": "kind source: *v1.TFJob"} 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "tfjob-controller", "source": "kind source: *v1.Pod"} 2026-07-15T04:12:39Z INFO Starting EventSource {"controller": "tfjob-controller", "source": "kind source: *v1.Service"} 2026-07-15T04:12:39Z INFO Starting Controller {"controller": "tfjob-controller"} 2026-07-15T04:12:39Z INFO controller-runtime.builder skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called {"GVK": "kubeflow.org/v1, Kind=TFJob"} 2026-07-15T04:12:39Z INFO controller-runtime.builder Registering a validating webhook {"GVK": "kubeflow.org/v1, Kind=TFJob", "path": "/validate-kubeflow-org-v1-tfjob"} 2026-07-15T04:12:39Z INFO controller-runtime.webhook Registering webhook {"path": "/validate-kubeflow-org-v1-tfjob"} 2026-07-15T04:12:39Z INFO Starting workers {"controller": "xgboostjob-controller", "worker count": 1} 2026-07-15T04:12:39Z INFO Starting workers {"controller": "mpijob-controller", "worker count": 1} 2026-07-15T04:12:39Z INFO Starting workers {"controller": "paddlejob-controller", "worker count": 1} 2026-07-15T04:12:39Z INFO Starting workers {"controller": "jaxjob-controller", "worker count": 1} 2026-07-15T04:12:39Z INFO Starting workers {"controller": "tfjob-controller", "worker count": 1} 2026-07-15T04:12:53Z INFO cert-rotation no cert refresh needed 2026-07-15T04:12:53Z INFO cert-rotation Ensuring CA cert {"name": "kubeflow-validator.training-operator.kubeflow.org", "gvk": "admissionregistration.k8s.io/v1, Kind=ValidatingWebhookConfiguration", "name": "kubeflow-validator.training-operator.kubeflow.org", "gvk": "admissionregistration.k8s.io/v1, Kind=ValidatingWebhookConfiguration"} ==================== WORKLOAD POD LOG: redhat-ods-applications/kuberay-operator-796bfd97f7-2t85q.log ==================== {"level":"info","ts":"2026-07-15T03:58:24.137Z","logger":"setup","msg":"Loaded feature gates","featureGates":{"RayClusterStatusConditions":true,"RayJobDeletionPolicy":false}} {"level":"info","ts":"2026-07-15T03:58:24.137Z","logger":"setup","msg":"Flag watchNamespace is not set. Watch custom resources in all namespaces."} {"level":"info","ts":"2026-07-15T03:58:24.137Z","logger":"setup","msg":"Setup manager"} {"level":"info","ts":"2026-07-15T03:58:24.439Z","logger":"setup","msg":"NetworkPolicy controller registered (annotation-based activation)"} {"level":"info","ts":"2026-07-15T03:58:24.538Z","logger":"controller-runtime.builder","msg":"Registering a mutating webhook","GVK":"ray.io/v1, Kind=RayCluster","path":"/mutate-ray-io-v1-raycluster"} {"level":"info","ts":"2026-07-15T03:58:24.538Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-ray-io-v1-raycluster"} {"level":"info","ts":"2026-07-15T03:58:24.538Z","logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"ray.io/v1, Kind=RayCluster","path":"/validate-ray-io-v1-raycluster"} {"level":"info","ts":"2026-07-15T03:58:24.538Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-ray-io-v1-raycluster"} {"level":"info","ts":"2026-07-15T03:58:24.538Z","logger":"setup","msg":"starting manager"} {"level":"info","ts":"2026-07-15T03:58:24.538Z","logger":"controller-runtime.metrics","msg":"Starting metrics server"} {"level":"info","ts":"2026-07-15T03:58:24.538Z","logger":"controller-runtime.metrics","msg":"Serving metrics server","bindAddress":":8080","secure":false} {"level":"info","ts":"2026-07-15T03:58:24.538Z","msg":"starting server","name":"health probe","addr":"[::]:8082"} {"level":"info","ts":"2026-07-15T03:58:24.538Z","logger":"controller-runtime.webhook","msg":"Starting webhook server"} {"level":"info","ts":"2026-07-15T03:58:24.539Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-15T03:58:24.539Z","logger":"controller-runtime.webhook","msg":"Serving webhook server","host":"","port":9443} {"level":"info","ts":"2026-07-15T03:58:24.539Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} {"level":"info","ts":"2026-07-15T03:58:25.032Z","msg":"attempting to acquire leader lease redhat-ods-applications/ray-operator-leader..."} {"level":"info","ts":"2026-07-15T03:58:25.039Z","msg":"successfully acquired lease redhat-ods-applications/ray-operator-leader"} {"level":"info","ts":"2026-07-15T03:58:25.039Z","logger":"controllers.RayCluster","msg":"Starting EventSource","source":"kind source: *v1.Service"} {"level":"info","ts":"2026-07-15T03:58:25.040Z","msg":"Starting EventSource","controller":"raycluster-mtls","controllerGroup":"ray.io","controllerKind":"RayCluster","source":"kind source: *v1.RayCluster"} {"level":"info","ts":"2026-07-15T03:58:25.039Z","logger":"controllers.RayCluster","msg":"Starting EventSource","source":"kind source: *v1.Pod"} {"level":"info","ts":"2026-07-15T03:58:25.039Z","logger":"controllers.RayService","msg":"Starting EventSource","source":"kind source: *v1.Service"} {"level":"info","ts":"2026-07-15T03:58:25.039Z","msg":"Starting EventSource","controller":"authentication","controllerGroup":"ray.io","controllerKind":"RayCluster","source":"kind source: *v1.Route"} {"level":"info","ts":"2026-07-15T03:58:25.039Z","msg":"Starting EventSource","controller":"authentication","controllerGroup":"ray.io","controllerKind":"RayCluster","source":"kind source: *v1.RayCluster"} {"level":"info","ts":"2026-07-15T03:58:25.039Z","logger":"controllers.RayService","msg":"Starting EventSource","source":"kind source: *v1.RayService"} {"level":"info","ts":"2026-07-15T03:58:25.040Z","msg":"Starting EventSource","controller":"networkpolicy","controllerGroup":"ray.io","controllerKind":"RayCluster","source":"kind source: *v1.NetworkPolicy"} {"level":"info","ts":"2026-07-15T03:58:25.040Z","msg":"Starting EventSource","controller":"authentication","controllerGroup":"ray.io","controllerKind":"RayCluster","source":"kind source: *v1.ServiceAccount"} {"level":"info","ts":"2026-07-15T03:58:25.040Z","logger":"controllers.RayJob","msg":"Starting EventSource","source":"kind source: *v1.Job"} {"level":"info","ts":"2026-07-15T03:58:25.040Z","logger":"controllers.RayService","msg":"Starting EventSource","source":"kind source: *v1.RayCluster"} {"level":"info","ts":"2026-07-15T03:58:25.040Z","msg":"Starting EventSource","controller":"authentication","controllerGroup":"ray.io","controllerKind":"RayCluster","source":"kind source: *v1.Service"} {"level":"info","ts":"2026-07-15T03:58:25.040Z","logger":"controllers.RayJob","msg":"Starting EventSource","source":"kind source: *v1.RayJob"} {"level":"info","ts":"2026-07-15T03:58:25.040Z","msg":"Starting EventSource","controller":"networkpolicy","controllerGroup":"ray.io","controllerKind":"RayCluster","source":"kind source: *v1.RayCluster"} {"level":"info","ts":"2026-07-15T03:58:25.040Z","logger":"controllers.RayJob","msg":"Starting EventSource","source":"kind source: *v1.Service"} {"level":"info","ts":"2026-07-15T03:58:25.040Z","logger":"controllers.RayJob","msg":"Starting EventSource","source":"kind source: *v1.RayCluster"} {"level":"info","ts":"2026-07-15T03:58:25.039Z","logger":"controllers.RayCluster","msg":"Starting EventSource","source":"kind source: *v1.RayCluster"} {"level":"info","ts":"2026-07-15T03:58:25.632Z","logger":"controllers.RayService","msg":"Starting Controller"} {"level":"info","ts":"2026-07-15T03:58:25.632Z","logger":"controllers.RayService","msg":"Starting workers","worker count":1} {"level":"info","ts":"2026-07-15T03:58:25.632Z","msg":"Starting Controller","controller":"raycluster-mtls","controllerGroup":"ray.io","controllerKind":"RayCluster"} {"level":"info","ts":"2026-07-15T03:58:25.632Z","msg":"Starting workers","controller":"raycluster-mtls","controllerGroup":"ray.io","controllerKind":"RayCluster","worker count":1} {"level":"info","ts":"2026-07-15T03:58:25.632Z","msg":"Starting Controller","controller":"authentication","controllerGroup":"ray.io","controllerKind":"RayCluster"} {"level":"info","ts":"2026-07-15T03:58:25.632Z","msg":"Starting workers","controller":"authentication","controllerGroup":"ray.io","controllerKind":"RayCluster","worker count":1} {"level":"info","ts":"2026-07-15T03:58:25.632Z","msg":"Starting Controller","controller":"networkpolicy","controllerGroup":"ray.io","controllerKind":"RayCluster"} {"level":"info","ts":"2026-07-15T03:58:25.632Z","msg":"Starting workers","controller":"networkpolicy","controllerGroup":"ray.io","controllerKind":"RayCluster","worker count":1} {"level":"info","ts":"2026-07-15T03:58:25.633Z","logger":"controllers.RayJob","msg":"Starting Controller"} {"level":"info","ts":"2026-07-15T03:58:25.633Z","logger":"controllers.RayJob","msg":"Starting workers","worker count":1} {"level":"info","ts":"2026-07-15T03:58:25.633Z","logger":"controllers.RayCluster","msg":"Starting Controller"} {"level":"info","ts":"2026-07-15T03:58:25.633Z","logger":"controllers.RayCluster","msg":"Starting workers","worker count":1} {"level":"info","ts":"2026-07-15T04:52:45.370Z","logger":"controllers.RayJob","msg":"RayJob","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"7cd8c984-5068-424e-a015-8f7b2be95db9","JobStatus":"","JobDeploymentStatus":"","SubmissionMode":"K8sJobMode"} {"level":"info","ts":"2026-07-15T04:52:45.370Z","logger":"controllers.RayJob","msg":"Add a finalizer","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"7cd8c984-5068-424e-a015-8f7b2be95db9","finalizer":"ray.io/rayjob-finalizer"} {"level":"info","ts":"2026-07-15T04:52:45.404Z","logger":"controllers.RayJob","msg":"JobDeploymentStatusNew","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"7cd8c984-5068-424e-a015-8f7b2be95db9"} {"level":"info","ts":"2026-07-15T04:52:45.404Z","logger":"controllers.RayJob","msg":"initRayJobStatusIfNeed","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"7cd8c984-5068-424e-a015-8f7b2be95db9","shouldUpdateStatus":true,"jobId":"","rayClusterName":"","jobStatus":""} {"level":"info","ts":"2026-07-15T04:52:45.404Z","logger":"controllers.RayJob","msg":"updateRayJobStatus","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"7cd8c984-5068-424e-a015-8f7b2be95db9","oldRayJobStatus":{"rayJobInfo":{},"rayClusterStatus":{"desiredCPU":"0","desiredMemory":"0","desiredGPU":"0","desiredTPU":"0","head":{}}},"newRayJobStatus":{"rayJobInfo":{},"jobId":"unknown-version-rayjob-mtkv2","rayClusterName":"unknown-version-rayjob-5mtb5","jobDeploymentStatus":"Initializing","startTime":"2026-07-15T04:52:45Z","succeeded":0,"failed":0,"rayClusterStatus":{"desiredCPU":"0","desiredMemory":"0","desiredGPU":"0","desiredTPU":"0","head":{}}}} {"level":"info","ts":"2026-07-15T04:52:45.404Z","logger":"controllers.RayJob","msg":"updateRayJobStatus","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"7cd8c984-5068-424e-a015-8f7b2be95db9","old JobStatus":"","new JobStatus":"","old JobDeploymentStatus":"","new JobDeploymentStatus":"Initializing"} {"level":"info","ts":"2026-07-15T04:52:45.437Z","logger":"controllers.RayJob","msg":"RayJob","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"230ccaba-2d4a-4628-854d-5bd7bf1ad712","JobStatus":"","JobDeploymentStatus":"","SubmissionMode":"K8sJobMode"} {"level":"info","ts":"2026-07-15T04:52:45.437Z","logger":"controllers.RayJob","msg":"JobDeploymentStatusNew","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"230ccaba-2d4a-4628-854d-5bd7bf1ad712"} {"level":"info","ts":"2026-07-15T04:52:45.437Z","logger":"controllers.RayJob","msg":"initRayJobStatusIfNeed","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"230ccaba-2d4a-4628-854d-5bd7bf1ad712","shouldUpdateStatus":true,"jobId":"","rayClusterName":"","jobStatus":""} {"level":"info","ts":"2026-07-15T04:52:45.437Z","logger":"controllers.RayJob","msg":"updateRayJobStatus","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"230ccaba-2d4a-4628-854d-5bd7bf1ad712","oldRayJobStatus":{"rayJobInfo":{},"rayClusterStatus":{"desiredCPU":"0","desiredMemory":"0","desiredGPU":"0","desiredTPU":"0","head":{}}},"newRayJobStatus":{"rayJobInfo":{},"jobId":"unknown-version-rayjob-k545s","rayClusterName":"unknown-version-rayjob-xrt6j","jobDeploymentStatus":"Initializing","startTime":"2026-07-15T04:52:45Z","succeeded":0,"failed":0,"rayClusterStatus":{"desiredCPU":"0","desiredMemory":"0","desiredGPU":"0","desiredTPU":"0","head":{}}}} {"level":"info","ts":"2026-07-15T04:52:45.437Z","logger":"controllers.RayJob","msg":"updateRayJobStatus","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"230ccaba-2d4a-4628-854d-5bd7bf1ad712","old JobStatus":"","new JobStatus":"","old JobDeploymentStatus":"","new JobDeploymentStatus":"Initializing"} {"level":"info","ts":"2026-07-15T04:52:45.454Z","logger":"controllers.RayJob","msg":"Failed to update RayJob status","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"230ccaba-2d4a-4628-854d-5bd7bf1ad712","error":"Operation cannot be fulfilled on rayjobs.ray.io \"unknown-version-rayjob\": the object has been modified; please apply your changes to the latest version and try again"} {"level":"info","ts":"2026-07-15T04:52:45.454Z","logger":"controllers.RayJob","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"230ccaba-2d4a-4628-854d-5bd7bf1ad712"} {"level":"error","ts":"2026-07-15T04:52:45.454Z","logger":"controllers.RayJob","msg":"Reconciler error","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"230ccaba-2d4a-4628-854d-5bd7bf1ad712","error":"Operation cannot be fulfilled on rayjobs.ray.io \"unknown-version-rayjob\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-15T04:52:45.454Z","logger":"controllers.RayJob","msg":"RayJob","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"2c6927e7-655b-4f66-af53-bdb568cf3546","JobStatus":"","JobDeploymentStatus":"Initializing","SubmissionMode":"K8sJobMode"} {"level":"info","ts":"2026-07-15T04:52:45.454Z","logger":"controllers.RayJob","msg":"try to find existing RayCluster instance","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"2c6927e7-655b-4f66-af53-bdb568cf3546","name":"unknown-version-rayjob-5mtb5"} {"level":"info","ts":"2026-07-15T04:52:45.454Z","logger":"controllers.RayJob","msg":"RayCluster not found","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"2c6927e7-655b-4f66-af53-bdb568cf3546","RayCluster":{"name":"unknown-version-rayjob-5mtb5","namespace":"test-ns-x2tl5"}} {"level":"info","ts":"2026-07-15T04:52:45.454Z","logger":"controllers.RayJob","msg":"RayCluster not found, creating RayCluster!","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"2c6927e7-655b-4f66-af53-bdb568cf3546","RayCluster":{"name":"unknown-version-rayjob-5mtb5","namespace":"test-ns-x2tl5"}} {"level":"info","ts":"2026-07-15T04:52:45.464Z","logger":"controllers.RayJob","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"2c6927e7-655b-4f66-af53-bdb568cf3546"} {"level":"error","ts":"2026-07-15T04:52:45.464Z","logger":"controllers.RayJob","msg":"Reconciler error","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"2c6927e7-655b-4f66-af53-bdb568cf3546","error":"rayclusters.ray.io \"unknown-version-rayjob-5mtb5\" is forbidden: unable to create new content in namespace test-ns-x2tl5 because it is being terminated","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-15T04:52:45.465Z","logger":"controllers.RayJob","msg":"RayJob","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"2d0e3c44-c83f-4b31-a794-7056c5e18684","JobStatus":"","JobDeploymentStatus":"Initializing","SubmissionMode":"K8sJobMode"} {"level":"info","ts":"2026-07-15T04:52:45.465Z","logger":"controllers.RayJob","msg":"try to find existing RayCluster instance","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"2d0e3c44-c83f-4b31-a794-7056c5e18684","name":"unknown-version-rayjob-5mtb5"} {"level":"info","ts":"2026-07-15T04:52:45.465Z","logger":"controllers.RayJob","msg":"RayCluster not found","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"2d0e3c44-c83f-4b31-a794-7056c5e18684","RayCluster":{"name":"unknown-version-rayjob-5mtb5","namespace":"test-ns-x2tl5"}} {"level":"info","ts":"2026-07-15T04:52:45.465Z","logger":"controllers.RayJob","msg":"RayCluster not found, creating RayCluster!","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"2d0e3c44-c83f-4b31-a794-7056c5e18684","RayCluster":{"name":"unknown-version-rayjob-5mtb5","namespace":"test-ns-x2tl5"}} {"level":"info","ts":"2026-07-15T04:52:45.469Z","logger":"controllers.RayJob","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"2d0e3c44-c83f-4b31-a794-7056c5e18684"} {"level":"error","ts":"2026-07-15T04:52:45.469Z","logger":"controllers.RayJob","msg":"Reconciler error","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"2d0e3c44-c83f-4b31-a794-7056c5e18684","error":"rayclusters.ray.io \"unknown-version-rayjob-5mtb5\" is forbidden: unable to create new content in namespace test-ns-x2tl5 because it is being terminated","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-15T04:52:45.475Z","logger":"controllers.RayJob","msg":"RayJob","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"30f57cc1-9001-4c9b-831d-bb6916340566","JobStatus":"","JobDeploymentStatus":"Initializing","SubmissionMode":"K8sJobMode"} {"level":"info","ts":"2026-07-15T04:52:45.475Z","logger":"controllers.RayJob","msg":"try to find existing RayCluster instance","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"30f57cc1-9001-4c9b-831d-bb6916340566","name":"unknown-version-rayjob-5mtb5"} {"level":"info","ts":"2026-07-15T04:52:45.475Z","logger":"controllers.RayJob","msg":"RayCluster not found","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"30f57cc1-9001-4c9b-831d-bb6916340566","RayCluster":{"name":"unknown-version-rayjob-5mtb5","namespace":"test-ns-x2tl5"}} {"level":"info","ts":"2026-07-15T04:52:45.475Z","logger":"controllers.RayJob","msg":"RayCluster not found, creating RayCluster!","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"30f57cc1-9001-4c9b-831d-bb6916340566","RayCluster":{"name":"unknown-version-rayjob-5mtb5","namespace":"test-ns-x2tl5"}} {"level":"info","ts":"2026-07-15T04:52:45.485Z","logger":"controllers.RayJob","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"30f57cc1-9001-4c9b-831d-bb6916340566"} {"level":"error","ts":"2026-07-15T04:52:45.485Z","logger":"controllers.RayJob","msg":"Reconciler error","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"30f57cc1-9001-4c9b-831d-bb6916340566","error":"rayclusters.ray.io \"unknown-version-rayjob-5mtb5\" is forbidden: unable to create new content in namespace test-ns-x2tl5 because it is being terminated","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-15T04:52:45.525Z","logger":"controllers.RayJob","msg":"RayJob","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"fc02aa09-7e35-48bc-bd5e-620c7b85ea7e","JobStatus":"","JobDeploymentStatus":"Initializing","SubmissionMode":"K8sJobMode"} {"level":"info","ts":"2026-07-15T04:52:45.525Z","logger":"controllers.RayJob","msg":"try to find existing RayCluster instance","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"fc02aa09-7e35-48bc-bd5e-620c7b85ea7e","name":"unknown-version-rayjob-5mtb5"} {"level":"info","ts":"2026-07-15T04:52:45.525Z","logger":"controllers.RayJob","msg":"RayCluster not found","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"fc02aa09-7e35-48bc-bd5e-620c7b85ea7e","RayCluster":{"name":"unknown-version-rayjob-5mtb5","namespace":"test-ns-x2tl5"}} {"level":"info","ts":"2026-07-15T04:52:45.525Z","logger":"controllers.RayJob","msg":"RayCluster not found, creating RayCluster!","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"fc02aa09-7e35-48bc-bd5e-620c7b85ea7e","RayCluster":{"name":"unknown-version-rayjob-5mtb5","namespace":"test-ns-x2tl5"}} {"level":"info","ts":"2026-07-15T04:52:45.533Z","logger":"controllers.RayJob","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"fc02aa09-7e35-48bc-bd5e-620c7b85ea7e"} {"level":"error","ts":"2026-07-15T04:52:45.533Z","logger":"controllers.RayJob","msg":"Reconciler error","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"fc02aa09-7e35-48bc-bd5e-620c7b85ea7e","error":"rayclusters.ray.io \"unknown-version-rayjob-5mtb5\" is forbidden: unable to create new content in namespace test-ns-x2tl5 because it is being terminated","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-15T04:52:45.614Z","logger":"controllers.RayJob","msg":"RayJob","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"77db8c96-0411-4896-829f-3c80e45d3289","JobStatus":"","JobDeploymentStatus":"Initializing","SubmissionMode":"K8sJobMode"} {"level":"info","ts":"2026-07-15T04:52:45.614Z","logger":"controllers.RayJob","msg":"try to find existing RayCluster instance","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"77db8c96-0411-4896-829f-3c80e45d3289","name":"unknown-version-rayjob-5mtb5"} {"level":"info","ts":"2026-07-15T04:52:45.614Z","logger":"controllers.RayJob","msg":"RayCluster not found","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"77db8c96-0411-4896-829f-3c80e45d3289","RayCluster":{"name":"unknown-version-rayjob-5mtb5","namespace":"test-ns-x2tl5"}} {"level":"info","ts":"2026-07-15T04:52:45.614Z","logger":"controllers.RayJob","msg":"RayCluster not found, creating RayCluster!","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"77db8c96-0411-4896-829f-3c80e45d3289","RayCluster":{"name":"unknown-version-rayjob-5mtb5","namespace":"test-ns-x2tl5"}} {"level":"info","ts":"2026-07-15T04:52:45.618Z","logger":"controllers.RayJob","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"77db8c96-0411-4896-829f-3c80e45d3289"} {"level":"error","ts":"2026-07-15T04:52:45.618Z","logger":"controllers.RayJob","msg":"Reconciler error","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"77db8c96-0411-4896-829f-3c80e45d3289","error":"rayclusters.ray.io \"unknown-version-rayjob-5mtb5\" is forbidden: unable to create new content in namespace test-ns-x2tl5 because it is being terminated","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-15T04:52:45.779Z","logger":"controllers.RayJob","msg":"RayJob","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"c8e95864-518a-4e40-859d-0c9e7d35b1e4","JobStatus":"","JobDeploymentStatus":"Initializing","SubmissionMode":"K8sJobMode"} {"level":"info","ts":"2026-07-15T04:52:45.779Z","logger":"controllers.RayJob","msg":"try to find existing RayCluster instance","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"c8e95864-518a-4e40-859d-0c9e7d35b1e4","name":"unknown-version-rayjob-5mtb5"} {"level":"info","ts":"2026-07-15T04:52:45.779Z","logger":"controllers.RayJob","msg":"RayCluster not found","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"c8e95864-518a-4e40-859d-0c9e7d35b1e4","RayCluster":{"name":"unknown-version-rayjob-5mtb5","namespace":"test-ns-x2tl5"}} {"level":"info","ts":"2026-07-15T04:52:45.779Z","logger":"controllers.RayJob","msg":"RayCluster not found, creating RayCluster!","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"c8e95864-518a-4e40-859d-0c9e7d35b1e4","RayCluster":{"name":"unknown-version-rayjob-5mtb5","namespace":"test-ns-x2tl5"}} {"level":"info","ts":"2026-07-15T04:52:45.782Z","logger":"controllers.RayJob","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"c8e95864-518a-4e40-859d-0c9e7d35b1e4"} {"level":"error","ts":"2026-07-15T04:52:45.782Z","logger":"controllers.RayJob","msg":"Reconciler error","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"c8e95864-518a-4e40-859d-0c9e7d35b1e4","error":"rayclusters.ray.io \"unknown-version-rayjob-5mtb5\" is forbidden: unable to create new content in namespace test-ns-x2tl5 because it is being terminated","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-15T04:52:46.103Z","logger":"controllers.RayJob","msg":"RayJob","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"5f7de7ba-fc42-4a97-a073-77ac1897cdd2","JobStatus":"","JobDeploymentStatus":"Initializing","SubmissionMode":"K8sJobMode"} {"level":"info","ts":"2026-07-15T04:52:46.103Z","logger":"controllers.RayJob","msg":"try to find existing RayCluster instance","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"5f7de7ba-fc42-4a97-a073-77ac1897cdd2","name":"unknown-version-rayjob-5mtb5"} {"level":"info","ts":"2026-07-15T04:52:46.103Z","logger":"controllers.RayJob","msg":"RayCluster not found","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"5f7de7ba-fc42-4a97-a073-77ac1897cdd2","RayCluster":{"name":"unknown-version-rayjob-5mtb5","namespace":"test-ns-x2tl5"}} {"level":"info","ts":"2026-07-15T04:52:46.103Z","logger":"controllers.RayJob","msg":"RayCluster not found, creating RayCluster!","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"5f7de7ba-fc42-4a97-a073-77ac1897cdd2","RayCluster":{"name":"unknown-version-rayjob-5mtb5","namespace":"test-ns-x2tl5"}} {"level":"info","ts":"2026-07-15T04:52:46.106Z","logger":"controllers.RayJob","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"5f7de7ba-fc42-4a97-a073-77ac1897cdd2"} {"level":"error","ts":"2026-07-15T04:52:46.106Z","logger":"controllers.RayJob","msg":"Reconciler error","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"5f7de7ba-fc42-4a97-a073-77ac1897cdd2","error":"rayclusters.ray.io \"unknown-version-rayjob-5mtb5\" is forbidden: unable to create new content in namespace test-ns-x2tl5 because it is being terminated","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-15T04:52:46.747Z","logger":"controllers.RayJob","msg":"RayJob","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"27f94710-f0f6-42b0-9062-e7655b536700","JobStatus":"","JobDeploymentStatus":"Initializing","SubmissionMode":"K8sJobMode"} {"level":"info","ts":"2026-07-15T04:52:46.747Z","logger":"controllers.RayJob","msg":"try to find existing RayCluster instance","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"27f94710-f0f6-42b0-9062-e7655b536700","name":"unknown-version-rayjob-5mtb5"} {"level":"info","ts":"2026-07-15T04:52:46.747Z","logger":"controllers.RayJob","msg":"RayCluster not found","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"27f94710-f0f6-42b0-9062-e7655b536700","RayCluster":{"name":"unknown-version-rayjob-5mtb5","namespace":"test-ns-x2tl5"}} {"level":"info","ts":"2026-07-15T04:52:46.747Z","logger":"controllers.RayJob","msg":"RayCluster not found, creating RayCluster!","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"27f94710-f0f6-42b0-9062-e7655b536700","RayCluster":{"name":"unknown-version-rayjob-5mtb5","namespace":"test-ns-x2tl5"}} {"level":"info","ts":"2026-07-15T04:52:46.750Z","logger":"controllers.RayJob","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"27f94710-f0f6-42b0-9062-e7655b536700"} {"level":"error","ts":"2026-07-15T04:52:46.751Z","logger":"controllers.RayJob","msg":"Reconciler error","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"27f94710-f0f6-42b0-9062-e7655b536700","error":"rayclusters.ray.io \"unknown-version-rayjob-5mtb5\" is forbidden: unable to create new content in namespace test-ns-x2tl5 because it is being terminated","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-15T04:52:48.031Z","logger":"controllers.RayJob","msg":"RayJob","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"5f4548ab-a83e-41da-857c-461ad61e8135","JobStatus":"","JobDeploymentStatus":"Initializing","SubmissionMode":"K8sJobMode"} {"level":"info","ts":"2026-07-15T04:52:48.031Z","logger":"controllers.RayJob","msg":"try to find existing RayCluster instance","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"5f4548ab-a83e-41da-857c-461ad61e8135","name":"unknown-version-rayjob-5mtb5"} {"level":"info","ts":"2026-07-15T04:52:48.031Z","logger":"controllers.RayJob","msg":"RayCluster not found","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"5f4548ab-a83e-41da-857c-461ad61e8135","RayCluster":{"name":"unknown-version-rayjob-5mtb5","namespace":"test-ns-x2tl5"}} {"level":"info","ts":"2026-07-15T04:52:48.031Z","logger":"controllers.RayJob","msg":"RayCluster not found, creating RayCluster!","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"5f4548ab-a83e-41da-857c-461ad61e8135","RayCluster":{"name":"unknown-version-rayjob-5mtb5","namespace":"test-ns-x2tl5"}} {"level":"info","ts":"2026-07-15T04:52:48.034Z","logger":"controllers.RayJob","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"5f4548ab-a83e-41da-857c-461ad61e8135"} {"level":"error","ts":"2026-07-15T04:52:48.034Z","logger":"controllers.RayJob","msg":"Reconciler error","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"5f4548ab-a83e-41da-857c-461ad61e8135","error":"rayclusters.ray.io \"unknown-version-rayjob-5mtb5\" is forbidden: unable to create new content in namespace test-ns-x2tl5 because it is being terminated","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-15T04:52:50.595Z","logger":"controllers.RayJob","msg":"RayJob","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"8530dc98-ab55-4fdd-abeb-e155a558a88a","JobStatus":"","JobDeploymentStatus":"Initializing","SubmissionMode":"K8sJobMode"} {"level":"info","ts":"2026-07-15T04:52:50.595Z","logger":"controllers.RayJob","msg":"try to find existing RayCluster instance","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"8530dc98-ab55-4fdd-abeb-e155a558a88a","name":"unknown-version-rayjob-5mtb5"} {"level":"info","ts":"2026-07-15T04:52:50.595Z","logger":"controllers.RayJob","msg":"RayCluster not found","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"8530dc98-ab55-4fdd-abeb-e155a558a88a","RayCluster":{"name":"unknown-version-rayjob-5mtb5","namespace":"test-ns-x2tl5"}} {"level":"info","ts":"2026-07-15T04:52:50.595Z","logger":"controllers.RayJob","msg":"RayCluster not found, creating RayCluster!","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"8530dc98-ab55-4fdd-abeb-e155a558a88a","RayCluster":{"name":"unknown-version-rayjob-5mtb5","namespace":"test-ns-x2tl5"}} {"level":"info","ts":"2026-07-15T04:52:50.603Z","logger":"controllers.RayJob","msg":"Warning: Reconciler returned both a non-zero result and a non-nil error. The result will always be ignored if the error is non-nil and the non-nil error causes requeuing with exponential backoff. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"8530dc98-ab55-4fdd-abeb-e155a558a88a"} {"level":"error","ts":"2026-07-15T04:52:50.603Z","logger":"controllers.RayJob","msg":"Reconciler error","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"8530dc98-ab55-4fdd-abeb-e155a558a88a","error":"rayclusters.ray.io \"unknown-version-rayjob-5mtb5\" is forbidden: unable to create new content in namespace test-ns-x2tl5 because it is being terminated","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-15T04:52:51.652Z","logger":"controllers.RayJob","msg":"RayJob is being deleted","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"078c4014-66e0-48ff-9ae4-c999f501ecc9","DeletionTimestamp":"2026-07-15 04:52:51 +0000 UTC"} {"level":"error","ts":"2026-07-15T04:52:51.652Z","logger":"controllers.RayJob","msg":"Failed to get RayCluster","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"078c4014-66e0-48ff-9ae4-c999f501ecc9","error":"RayCluster.ray.io \"unknown-version-rayjob-5mtb5\" not found","stacktrace":"github.com/ray-project/kuberay/ray-operator/controllers/ray.(*RayJobReconciler).Reconcile\n\t/workspace/controllers/ray/rayjob_controller.go:115\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-15T04:52:51.652Z","logger":"controllers.RayJob","msg":"Stop a ray job","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"078c4014-66e0-48ff-9ae4-c999f501ecc9","rayJob":"unknown-version-rayjob-mtkv2"} {"level":"error","ts":"2026-07-15T04:52:51.652Z","logger":"controllers.RayJob","msg":"Failed to stop job for RayJob","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"078c4014-66e0-48ff-9ae4-c999f501ecc9","error":"Post \"http:///api/jobs/unknown-version-rayjob-mtkv2/stop\": http: no Host in request URL","stacktrace":"github.com/ray-project/kuberay/ray-operator/controllers/ray.(*RayJobReconciler).Reconcile\n\t/workspace/controllers/ray/rayjob_controller.go:123\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.1/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-15T04:52:51.652Z","logger":"controllers.RayJob","msg":"Remove the finalizer no matter StopJob() succeeds or not.","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"078c4014-66e0-48ff-9ae4-c999f501ecc9","finalizer":"ray.io/rayjob-finalizer"} {"level":"info","ts":"2026-07-15T04:52:51.662Z","logger":"controllers.RayJob","msg":"RayJob resource not found. Ignoring since object must be deleted","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"b1145d89-e29a-4569-a771-785efac354f0"} {"level":"info","ts":"2026-07-15T04:52:54.663Z","logger":"controllers.RayJob","msg":"RayJob resource not found. Ignoring since object must be deleted","RayJob":{"name":"unknown-version-rayjob","namespace":"test-ns-x2tl5"},"reconcileID":"13be4256-0dc5-4379-b1b3-7399e302dcaa"} ==================== WORKLOAD POD LOG: redhat-ods-applications/llmisvc-controller-manager-78dcbbdc6c-ccb6f.log ==================== {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"setup","msg":"Setting up client for manager"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceService"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceService","path":"/validate-serving-kserve-io-v1alpha2-llminferenceservice"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-serving-kserve-io-v1alpha2-llminferenceservice"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/convert"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceService"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called","GVK":"serving.kserve.io/v1alpha1, Kind=LLMInferenceService"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"serving.kserve.io/v1alpha1, Kind=LLMInferenceService","path":"/validate-serving-kserve-io-v1alpha1-llminferenceservice"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-serving-kserve-io-v1alpha1-llminferenceservice"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"serving.kserve.io/v1alpha1, Kind=LLMInferenceService"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called","GVK":"serving.kserve.io/v1alpha1, Kind=LLMInferenceServiceConfig"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"serving.kserve.io/v1alpha1, Kind=LLMInferenceServiceConfig","path":"/validate-serving-kserve-io-v1alpha1-llminferenceserviceconfig"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-serving-kserve-io-v1alpha1-llminferenceserviceconfig"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"serving.kserve.io/v1alpha1, Kind=LLMInferenceServiceConfig"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig","path":"/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceService"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"skip registering a validating webhook, object does not implement admission.Validator or WithValidator wasn't called","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceService"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceService"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"skip registering a validating webhook, object does not implement admission.Validator or WithValidator wasn't called","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"setup","msg":"Setting up LLMInferenceService controller"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"setup","msg":"starting manager"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"starting server","name":"health probe","addr":"[::]:8081"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.metrics","msg":"Starting metrics server"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"setup","msg":"disabling http/2"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.webhook","msg":"Starting webhook server"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"setup","msg":"disabling http/2"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.webhook","msg":"Serving webhook server","host":"","port":9443} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","interval":10} I0715 03:58:45.843239 1 leaderelection.go:257] attempting to acquire leader lease redhat-ods-applications/llminferenceservice-kserve-controller-manager... I0715 03:58:45.851442 1 leaderelection.go:271] successfully acquired lease redhat-ods-applications/llminferenceservice-kserve-controller-manager {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1alpha2.LLMInferenceService"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.Ingress"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.Deployment"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.Secret"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.Service"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v2.HorizontalPodAutoscaler"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.DestinationRule"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.HTTPRoute"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.InferencePool"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1alpha2.InferencePool"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1alpha1.ScaledObject"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.LeaderWorkerSet"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.PodMonitor"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.ServiceMonitor"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1alpha2.LLMInferenceServiceConfig"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.ConfigMap"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.Pod"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.HTTPRoute"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.Gateway"} {"level":"info","ts":"2026-07-15T03:58:45Z","msg":"Starting Controller","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService"} {"level":"info","ts":"2026-07-15T03:58:45Z","logger":"setup","msg":"running storage version migration","timeout":3600,"pollInterval":30} {"level":"info","ts":"2026-07-15T03:58:47Z","msg":"Starting workers","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","worker count":1} {"level":"info","ts":"2026-07-15T03:58:48Z","logger":"setup","msg":"storage version migration completed"} {"level":"info","ts":"2026-07-15T03:58:50Z","logger":"controller-runtime.metrics","msg":"Serving metrics server","bindAddress":"127.0.0.1:8443","secure":true} {"level":"info","ts":"2026-07-15T03:59:17Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-decode-template","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-decode-template","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"d6a45f04-11b3-4eab-b637-09f50f3a39cb","name":"v3-5-0-ea-1-kserve-config-llm-decode-template","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:59:17Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-decode-worker-data-parallel","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-decode-worker-data-parallel","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"dfdcd268-afaf-40b4-b7de-9f41e35cfdbb","name":"v3-5-0-ea-1-kserve-config-llm-decode-worker-data-parallel","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:59:17Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-prefill-template","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-prefill-template","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"e0370a90-5aac-4b71-be1a-8dbb48c05e61","name":"v3-5-0-ea-1-kserve-config-llm-prefill-template","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:59:17Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-prefill-worker-data-parallel","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-prefill-worker-data-parallel","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"53cbae00-ce82-4ca4-84a7-4afc5bdfec2b","name":"v3-5-0-ea-1-kserve-config-llm-prefill-worker-data-parallel","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:59:17Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-router-route","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-router-route","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"946777cc-920d-4f8d-a293-29ac2f534d6f","name":"v3-5-0-ea-1-kserve-config-llm-router-route","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:59:17Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-scheduler","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-scheduler","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"e14e5372-810f-4dd4-a950-eef4f9b8f909","name":"v3-5-0-ea-1-kserve-config-llm-scheduler","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:59:17Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"3e3b2faa-b9ee-45e1-ad91-22ef5549f119","name":"v3-5-0-ea-1-kserve-config-llm-template","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:59:17Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template-amd-rocm","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template-amd-rocm","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"f52de297-70df-4802-8067-a37279b0c02a","name":"v3-5-0-ea-1-kserve-config-llm-template-amd-rocm","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:59:17Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-ppc64le","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-ppc64le","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"b69370b8-81f2-4e85-a2eb-71dbdeaa263f","name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-ppc64le","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:59:17Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-s390x","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-s390x","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"fbf0efbe-d84a-4ad8-bf7c-50f57c1dfad8","name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-s390x","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:59:17Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-x86","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-x86","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"b2c822cf-4cee-4e5a-86b3-48765a0fabc6","name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-x86","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:59:17Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template-intel-gaudi","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template-intel-gaudi","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"0162f059-3f24-4636-aa46-9abef265e4f4","name":"v3-5-0-ea-1-kserve-config-llm-template-intel-gaudi","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:59:17Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template-nvidia-cuda","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template-nvidia-cuda","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"d9a4b45d-2248-41fb-aee6-5636f0ec469c","name":"v3-5-0-ea-1-kserve-config-llm-template-nvidia-cuda","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T03:59:17Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-worker-data-parallel","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-worker-data-parallel","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"3c9345d1-33f1-4770-87d8-58cae45e894b","name":"v3-5-0-ea-1-kserve-config-llm-worker-data-parallel","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:10:07Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-decode-template","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-decode-template","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"8ef5f2ac-4f5a-4f18-9cea-6b468d8eaa00","name":"v3-5-0-ea-1-kserve-config-llm-decode-template","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:10:07Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-decode-worker-data-parallel","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-decode-worker-data-parallel","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"ef5d5e38-2323-43ee-8b34-ed00110a8000","name":"v3-5-0-ea-1-kserve-config-llm-decode-worker-data-parallel","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:10:07Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-prefill-template","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-prefill-template","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"10b5d06a-52a0-4eec-ac2a-935e84988041","name":"v3-5-0-ea-1-kserve-config-llm-prefill-template","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:10:07Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-prefill-worker-data-parallel","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-prefill-worker-data-parallel","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"113d2ccc-4dc5-4b0b-8512-49912a3fda6a","name":"v3-5-0-ea-1-kserve-config-llm-prefill-worker-data-parallel","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:10:07Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-router-route","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-router-route","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"d71a0ef6-c02e-4adc-9843-c3475a7f49c6","name":"v3-5-0-ea-1-kserve-config-llm-router-route","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:10:07Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-scheduler","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-scheduler","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"859a2e04-1f71-4b9d-9fb0-8a7c032c9fc3","name":"v3-5-0-ea-1-kserve-config-llm-scheduler","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:10:07Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"2fdc232c-3e28-45aa-a4d5-2b86c2512541","name":"v3-5-0-ea-1-kserve-config-llm-template","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:10:07Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template-amd-rocm","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template-amd-rocm","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"3f51dcf5-f778-47e2-b120-79910a1a629c","name":"v3-5-0-ea-1-kserve-config-llm-template-amd-rocm","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:10:07Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-ppc64le","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-ppc64le","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"972e9e3b-0780-4824-8810-0a7290d3fbe7","name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-ppc64le","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:10:07Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-s390x","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-s390x","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"79cb0759-bd95-4a19-b0cc-7069301d54a4","name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-s390x","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:10:07Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-x86","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-x86","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"3b562c07-050d-49be-b032-ef02be8d21b2","name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-x86","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:10:07Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template-intel-gaudi","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template-intel-gaudi","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"c7a4038e-1fe3-450a-95f1-04056da9992f","name":"v3-5-0-ea-1-kserve-config-llm-template-intel-gaudi","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:10:07Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template-nvidia-cuda","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template-nvidia-cuda","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"28a0ced3-1127-47db-8368-6f25cb528282","name":"v3-5-0-ea-1-kserve-config-llm-template-nvidia-cuda","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:10:07Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-worker-data-parallel","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-worker-data-parallel","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"97cb6be8-72f7-4d90-88cc-dabc8daf2a1a","name":"v3-5-0-ea-1-kserve-config-llm-worker-data-parallel","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:46Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-decode-template","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-decode-template","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"d13b2867-c749-420c-a9f6-7bf91b840276","name":"v3-5-0-ea-1-kserve-config-llm-decode-template","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:46Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-decode-worker-data-parallel","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-decode-worker-data-parallel","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"4b480fdd-eee7-4b5d-9efe-c87dcb796d4d","name":"v3-5-0-ea-1-kserve-config-llm-decode-worker-data-parallel","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:46Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-prefill-template","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-prefill-template","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"334a3061-38be-49af-80fe-544c23099a12","name":"v3-5-0-ea-1-kserve-config-llm-prefill-template","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:46Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-prefill-worker-data-parallel","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-prefill-worker-data-parallel","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"8fbb636d-b46a-442b-a687-1b60c29940aa","name":"v3-5-0-ea-1-kserve-config-llm-prefill-worker-data-parallel","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:46Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-router-route","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-router-route","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"6ccbb278-9297-4ecc-aa57-033e79bd1903","name":"v3-5-0-ea-1-kserve-config-llm-router-route","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:46Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-scheduler","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-scheduler","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"e3197db7-a3ae-4d0d-9b37-281a01943692","name":"v3-5-0-ea-1-kserve-config-llm-scheduler","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:46Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"94db486a-2d97-47f8-b5cc-617a620b6d12","name":"v3-5-0-ea-1-kserve-config-llm-template","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:46Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template-amd-rocm","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template-amd-rocm","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"f1c6dda3-aae2-499a-bfb0-4b4d12202c52","name":"v3-5-0-ea-1-kserve-config-llm-template-amd-rocm","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:46Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-ppc64le","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-ppc64le","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"a029728e-9eb6-4f90-91e1-816bc0323944","name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-ppc64le","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:46Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-s390x","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-s390x","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"b4fc5b33-4fd9-4428-a163-f8ae8bdf0ff9","name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-s390x","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:46Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-x86","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-x86","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"1b2d54f0-1602-4b3f-977f-1e18f69dcb13","name":"v3-5-0-ea-1-kserve-config-llm-template-ibm-spyre-x86","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:46Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template-intel-gaudi","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template-intel-gaudi","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"7b67623a-9df2-4903-a11f-c37195daaa78","name":"v3-5-0-ea-1-kserve-config-llm-template-intel-gaudi","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:46Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-template-nvidia-cuda","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-template-nvidia-cuda","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"99f90795-e65d-4ec8-af91-452237a49fd1","name":"v3-5-0-ea-1-kserve-config-llm-template-nvidia-cuda","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-15T04:44:46Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-1-kserve-config-llm-worker-data-parallel","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-1-kserve-config-llm-worker-data-parallel","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"ff212563-ada9-495f-9e4f-43886d09023e","name":"v3-5-0-ea-1-kserve-config-llm-worker-data-parallel","namespace":"redhat-ods-applications"} ==================== WORKLOAD POD LOG: redhat-ods-applications/model-registry-operator-controller-manager-769d94888-sb2vz.log ==================== 2026-07-15T04:24:40Z INFO setup cluster capabilities detected {"isOpenShift": true, "hasUserAPI": true, "hasConfigAPI": true, "hasAuthAPI": true} 2026-07-15T04:24:40Z INFO setup default registry config {"REGISTRIES_NAMESPACE": "rhoai-model-registries", "DEFAULT_DOMAIN": ""} 2026-07-15T04:24:40Z INFO setup parsed kubernetes templates {"templates": "; defined templates are: \"http-route.yaml.tmpl\", \"group.yaml.tmpl\", \"role-binding.yaml.tmpl\", \"kube-rbac-proxy-config.yaml.tmpl\", \"kube-rbac-proxy-network-policy.yaml.tmpl\", \"kube-rbac-proxy-role-binding.yaml.tmpl\", \"catalog-postgres-service.yaml.tmpl\", \"catalog-service.yaml.tmpl\", \"catalog-postgres-network-policy.yaml.tmpl\", \"postgres-deployment.yaml.tmpl\", \"postgres-pvc.yaml.tmpl\", \"postgres-service.yaml.tmpl\", \"role.yaml.tmpl\", \"serviceaccount.yaml.tmpl\", \"catalog-admin-role.yaml.tmpl\", \"catalog-default-configmap.yaml.tmpl\", \"catalog-kube-rbac-proxy-config.yaml.tmpl\", \"catalog-kube-rbac-proxy-https-route.yaml.tmpl\", \"catalog-kube-rbac-proxy-network-policy.yaml.tmpl\", \"catalog-kube-rbac-proxy-role-binding.yaml.tmpl\", \"catalog-deployment.yaml.tmpl\", \"catalog-postgres-pvc.yaml.tmpl\", \"catalog-role.yaml.tmpl\", \"catalog-serviceaccount.yaml.tmpl\", \"postgres-network-policy.yaml.tmpl\", \"catalog-postgres-deployment.yaml.tmpl\", \"catalog-mcp-configmap.yaml.tmpl\", \"deployment.yaml.tmpl\", \"service.yaml.tmpl\", \"kube-rbac-proxy-https-route.yaml.tmpl\", \"catalog-admin-rolebinding.yaml.tmpl\", \"catalog-configmap.yaml.tmpl\", \"catalog-postgres-secret.yaml.tmpl\", \"catalog-rolebinding.yaml.tmpl\""} 2026-07-15T04:24:40Z INFO setup model catalog config {"enabled": true, "db_enabled": true} 2026-07-15T04:24:40Z INFO controller-runtime.webhook Registering webhook {"path": "/mutate-modelregistry-opendatahub-io-modelregistry"} 2026-07-15T04:24:40Z INFO controller-runtime.webhook Registering webhook {"path": "/validate-modelregistry-opendatahub-io-modelregistry"} 2026-07-15T04:24:40Z INFO controller-runtime.webhook Registering webhook {"path": "/convert"} 2026-07-15T04:24:40Z INFO controller-runtime.builder Conversion webhook enabled {"GVK": "modelregistry.opendatahub.io/v1beta1, Kind=ModelRegistry"} 2026-07-15T04:24:40Z INFO storage-migration Starting storage migration monitor {"sourceVersion": "v1alpha1", "targetVersion": "v1beta1"} 2026-07-15T04:24:40Z INFO setup starting manager 2026-07-15T04:24:40Z INFO controller-runtime.metrics Starting metrics server 2026-07-15T04:24:40Z INFO starting server {"name": "health probe", "addr": "[::]:8081"} 2026-07-15T04:24:40Z INFO controller-runtime.webhook Starting webhook server I0715 04:24:40.653610 1 leaderelection.go:258] "Attempting to acquire leader lease..." lock="redhat-ods-applications/85f368d1.opendatahub.io" 2026-07-15T04:24:40Z INFO controller-runtime.certwatcher Updated current TLS certificate {"cert": "/etc/server-cert/tls.crt", "key": "/etc/server-cert/tls.key"} 2026-07-15T04:24:40Z INFO controller-runtime.certwatcher Updated current TLS certificate {"cert": "/tmp/k8s-webhook-server/serving-certs/tls.crt", "key": "/tmp/k8s-webhook-server/serving-certs/tls.key"} 2026-07-15T04:24:40Z INFO controller-runtime.metrics Serving metrics server {"bindAddress": ":8443", "secure": true} 2026-07-15T04:24:40Z INFO controller-runtime.webhook Serving webhook server {"host": "", "port": 9443} 2026-07-15T04:24:40Z INFO controller-runtime.certwatcher Starting certificate poll+watcher {"cert": "/tmp/k8s-webhook-server/serving-certs/tls.crt", "key": "/tmp/k8s-webhook-server/serving-certs/tls.key", "interval": "10s"} 2026-07-15T04:24:40Z INFO controller-runtime.certwatcher Starting certificate poll+watcher {"cert": "/etc/server-cert/tls.crt", "key": "/etc/server-cert/tls.key", "interval": "10s"} I0715 04:25:10.166984 1 leaderelection.go:272] "Successfully acquired lease" lock="redhat-ods-applications/85f368d1.opendatahub.io" 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "source": "kind source: *v1.ClusterRoleBinding"} 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "source": "kind source: *v1.NetworkPolicy"} 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "source": "kind source: *v1.RoleBinding"} 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "source": "kind source: *v1.Deployment"} 2026-07-15T04:25:10Z DEBUG events model-registry-operator-controller-manager-769d94888-sb2vz_eea8f219-d32c-4ff8-82d1-cb97a3ff6ba8 became leader {"type": "Normal", "object": {"kind":"Lease","namespace":"redhat-ods-applications","name":"85f368d1.opendatahub.io","uid":"1975f86d-0143-44a8-8f3c-e347b96e32a2","apiVersion":"coordination.k8s.io/v1","resourceVersion":"57935"}, "reason": "LeaderElection"} 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelcatalog", "source": "kind source: *v1.Deployment"} 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelcatalog", "source": "channel source: 0xc0002cf1f0"} 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelcatalog", "source": "kind source: *v1.PersistentVolumeClaim"} 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelcatalog", "source": "kind source: *v1.ClusterRoleBinding"} 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelcatalog", "source": "kind source: *v1.Role"} 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "source": "kind source: *v1.Role"} 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "source": "kind source: *v1.Route"} 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelcatalog", "source": "kind source: *v1.RoleBinding"} 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "source": "kind source: *v1beta1.ModelRegistry"} 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelcatalog", "source": "kind source: *unstructured.Unstructured"} 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelcatalog", "source": "kind source: *v1.ConfigMap"} 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "source": "kind source: *v1.Service"} 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelcatalog", "source": "kind source: *v1.NetworkPolicy"} 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelcatalog", "source": "kind source: *v1.ServiceAccount"} 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelcatalog", "source": "kind source: *v1.Service"} 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "source": "kind source: *v1.ServiceAccount"} 2026-07-15T04:25:10Z INFO Starting EventSource {"controller": "modelcatalog", "source": "kind source: *v1.Secret"} 2026-07-15T04:25:10Z INFO Starting Controller {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry"} 2026-07-15T04:25:10Z INFO Starting workers {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "worker count": 1} 2026-07-15T04:25:10Z INFO Starting Controller {"controller": "modelcatalog"} 2026-07-15T04:25:10Z INFO Starting workers {"controller": "modelcatalog", "worker count": 1} 2026-07-15T04:25:10Z INFO Reconciling catalog {"controller": "modelcatalog", "namespace": "rhoai-model-registries", "name": "model-catalog", "reconcileID": "189b96ee-85dd-46cb-a52d-14e047bd548a"} 2026-07-15T04:25:10Z INFO modelcatalog-controller Found admin groups from auth CR {"groups": ["rhods-admins"]} 2026-07-15T04:25:10Z DEBUG Postgres secret already exists, reconciling {"controller": "modelcatalog", "namespace": "rhoai-model-registries", "name": "model-catalog", "reconcileID": "189b96ee-85dd-46cb-a52d-14e047bd548a", "secret": "model-catalog-postgres"} 2026-07-15T04:25:10Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelcatalog", "namespace": "rhoai-model-registries", "name": "model-catalog", "reconcileID": "189b96ee-85dd-46cb-a52d-14e047bd548a"} 2026-07-15T04:25:11Z INFO storage-migration No storage version migration needed {"sourceVersion": "v1alpha1", "storedVersions": ["v1beta1"]} 2026-07-15T04:28:53Z INFO admission default {"object": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:kube-system:olminstall-cluster-admin", "requestID": "7c740466-177f-495e-8b91-7b9147aa5874", "name": "test-model-registry-662874"} 2026-07-15T04:28:53Z INFO modelregistry-resource default {"name": "test-model-registry-662874", "status.specDefaults": ""} 2026-07-15T04:28:53Z INFO admission validate create {"object": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:kube-system:olminstall-cluster-admin", "requestID": "1811eb59-4f78-4179-84c7-c15b899ac982", "name": "test-model-registry-662874"} 2026-07-15T04:28:53Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:28:53Z INFO Adding Finalizer for ModelRegistry {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "e5d32948-acba-4270-82ce-96602f37f20a"} 2026-07-15T04:28:53Z INFO admission default {"object": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:model-registry-operator-controller-manager", "requestID": "ba8b802a-6dfa-4a35-98ba-e22e2f3e39c4", "name": "test-model-registry-662874"} 2026-07-15T04:28:53Z INFO modelregistry-resource default {"name": "test-model-registry-662874", "status.specDefaults": ""} 2026-07-15T04:28:53Z INFO admission validate update {"object": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:model-registry-operator-controller-manager", "requestID": "c435870a-9110-4621-b79f-54e6c8db552b", "name": "test-model-registry-662874"} 2026-07-15T04:28:53Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:28:53Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-15T04:28:53Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-15T04:28:53Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:28:53Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "e5d32948-acba-4270-82ce-96602f37f20a", "kind": "/v1, Kind=ServiceAccount", "name": "test-model-registry-662874"} 2026-07-15T04:28:53Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "e5d32948-acba-4270-82ce-96602f37f20a", "kind": "/v1, Kind=Service", "name": "test-model-registry-662874"} 2026-07-15T04:28:53Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "e5d32948-acba-4270-82ce-96602f37f20a", "kind": "apps/v1, Kind=Deployment", "name": "test-model-registry-662874"} 2026-07-15T04:28:53Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "e5d32948-acba-4270-82ce-96602f37f20a", "kind": "rbac.authorization.k8s.io/v1, Kind=Role", "name": "registry-user-test-model-registry-662874"} 2026-07-15T04:28:54Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "e5d32948-acba-4270-82ce-96602f37f20a", "kind": "user.openshift.io/v1, Kind=Group", "name": "test-model-registry-662874-users"} 2026-07-15T04:28:54Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "e5d32948-acba-4270-82ce-96602f37f20a", "kind": "rbac.authorization.k8s.io/v1, Kind=RoleBinding", "name": "test-model-registry-662874-users"} 2026-07-15T04:28:54Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "e5d32948-acba-4270-82ce-96602f37f20a", "kind": "/v1, Kind=ConfigMap", "name": "test-model-registry-662874-kube-rbac-proxy-config"} 2026-07-15T04:28:54Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "e5d32948-acba-4270-82ce-96602f37f20a", "kind": "rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding", "name": "test-model-registry-662874-auth-delegator"} 2026-07-15T04:28:54Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "e5d32948-acba-4270-82ce-96602f37f20a", "kind": "route.openshift.io/v1, Kind=Route", "name": "test-model-registry-662874-https"} 2026-07-15T04:28:54Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "e5d32948-acba-4270-82ce-96602f37f20a", "kind": "networking.k8s.io/v1, Kind=NetworkPolicy", "name": "test-model-registry-662874-https-route"} 2026-07-15T04:28:54Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "e5d32948-acba-4270-82ce-96602f37f20a", "status": 1} 2026-07-15T04:28:54Z DEBUG events Created service for custom resource test-model-registry-662874 in namespace rhoai-model-registries {"type": "Normal", "object": "nil", "action": "ServiceCreated", "reason": "ServiceCreated"} 2026-07-15T04:28:54Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "e5d32948-acba-4270-82ce-96602f37f20a"} 2026-07-15T04:28:54Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-15T04:28:54Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:28:54Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "9efb86d6-0a1a-45b4-9a41-4996e70b2236", "status": 0} 2026-07-15T04:28:54Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-15T04:28:54Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "9efb86d6-0a1a-45b4-9a41-4996e70b2236"} 2026-07-15T04:28:54Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:28:54Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "0189ecc5-b8a0-4b90-9241-252ef9486e09", "status": 0} 2026-07-15T04:28:54Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "0189ecc5-b8a0-4b90-9241-252ef9486e09"} 2026-07-15T04:28:54Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:28:54Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "79a5a2b8-b0ce-440c-920a-82370670fd21", "status": 0} 2026-07-15T04:28:54Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "79a5a2b8-b0ce-440c-920a-82370670fd21"} 2026-07-15T04:28:54Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:28:54Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "3d887412-f79a-499b-b1e9-bb3b0349dcdf", "status": 0} 2026-07-15T04:28:54Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "3d887412-f79a-499b-b1e9-bb3b0349dcdf"} 2026-07-15T04:28:54Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:28:54Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "0a1a07a9-17a3-42b2-af91-b95d4ce02069", "status": 0} 2026-07-15T04:28:54Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "0a1a07a9-17a3-42b2-af91-b95d4ce02069"} 2026-07-15T04:28:54Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:28:54Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "90b19b7e-fe05-4fed-8338-862b61de6d8a", "status": 0} 2026-07-15T04:28:54Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "90b19b7e-fe05-4fed-8338-862b61de6d8a"} 2026-07-15T04:28:55Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:28:55Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "33b94a3c-3f1f-4c08-af4b-623c7f044c0d", "status": 0} 2026-07-15T04:28:55Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "33b94a3c-3f1f-4c08-af4b-623c7f044c0d"} 2026-07-15T04:28:55Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:28:55Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "7697adcc-16f3-4719-b842-4fc9415fe5c7", "status": 0} 2026-07-15T04:28:55Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "7697adcc-16f3-4719-b842-4fc9415fe5c7"} 2026-07-15T04:28:55Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:28:55Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-15T04:28:55Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "ecd62bbc-c65b-4a31-927e-4f4d743ca5fd", "status": 0} 2026-07-15T04:28:55Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "ecd62bbc-c65b-4a31-927e-4f4d743ca5fd"} 2026-07-15T04:28:58Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:28:58Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "a3e1d25d-6199-4760-9678-1d5b7c8e5392", "status": 0} 2026-07-15T04:28:58Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "a3e1d25d-6199-4760-9678-1d5b7c8e5392"} 2026-07-15T04:29:03Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:29:03Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "1cf73636-42aa-43d7-beaa-5906ea863253", "status": 0} 2026-07-15T04:29:03Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-15T04:29:03Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "1cf73636-42aa-43d7-beaa-5906ea863253"} 2026-07-15T04:29:03Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:29:03Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "477ae353-82f7-47b8-8218-a0c64bb15190", "status": 0} 2026-07-15T04:29:03Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "477ae353-82f7-47b8-8218-a0c64bb15190"} 2026-07-15T04:29:04Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:29:04Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "cab952a0-8f9e-4f9b-b056-4d8979287eb8", "status": 0} 2026-07-15T04:29:04Z INFO controller-runtime.cache Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-07-15T04:29:04Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "cab952a0-8f9e-4f9b-b056-4d8979287eb8"} 2026-07-15T04:29:04Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:29:04Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-15T04:29:04Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "78633f49-fd79-4da8-8b02-9265dadb1159", "status": 0} 2026-07-15T04:29:04Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "78633f49-fd79-4da8-8b02-9265dadb1159"} 2026-07-15T04:29:05Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:29:05Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "6aaab010-9330-423e-9650-082ea67d9b24", "status": 0} 2026-07-15T04:29:05Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "6aaab010-9330-423e-9650-082ea67d9b24"} 2026-07-15T04:29:06Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:29:06Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "51719f68-00b4-4a0b-8426-1901715a5d07", "status": 0} 2026-07-15T04:29:06Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "51719f68-00b4-4a0b-8426-1901715a5d07"} 2026-07-15T04:29:07Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:29:07Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "ac9cabdf-b251-4365-8312-505977844314", "status": 0} 2026-07-15T04:29:07Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "ac9cabdf-b251-4365-8312-505977844314"} 2026-07-15T04:29:08Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:29:08Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "831beeab-7f53-4d92-9a1f-43a73fc4af30", "status": 0} 2026-07-15T04:29:08Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "831beeab-7f53-4d92-9a1f-43a73fc4af30"} 2026-07-15T04:29:09Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:29:09Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "0e738e92-4daf-4b0f-8d51-5761d177f3b1", "status": 0} 2026-07-15T04:29:09Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-15T04:29:09Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "0e738e92-4daf-4b0f-8d51-5761d177f3b1"} 2026-07-15T04:29:09Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:29:09Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "909721bb-bb16-4fba-9be9-97a47fe9bc97", "status": 0} 2026-07-15T04:29:09Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "909721bb-bb16-4fba-9be9-97a47fe9bc97"} 2026-07-15T04:30:40Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-15T04:36:04Z INFO Performing Finalizer Operations for modelRegistry before delete CR {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "4e9baec7-0a43-4919-b985-07fa94ce3d35"} 2026-07-15T04:36:04Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-15T04:36:04Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-15T04:36:04Z DEBUG events Custom Resource test-model-registry-662874 is being deleted from the namespace rhoai-model-registries {"type": "Warning", "object": "nil", "action": "Deleting", "reason": "Deleting"} 2026-07-15T04:36:04Z INFO Removing Finalizer for modelRegistry after successfully perform the operations {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "4e9baec7-0a43-4919-b985-07fa94ce3d35"} 2026-07-15T04:36:04Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-15T04:36:04Z INFO admission default {"object": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:model-registry-operator-controller-manager", "requestID": "46e4a7c0-46a8-4489-8624-d73c40f9f0fd", "name": "test-model-registry-662874"} 2026-07-15T04:36:04Z INFO modelregistry-resource default {"name": "test-model-registry-662874", "status.specDefaults": "{\"kubeRBACProxy\":{\"domain\":\"apps.3c9a9014-bde8-4e38-b746-7a1dd8b61317.prod.konfluxeaas.com\",\"image\":\"registry.redhat.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:b7cafb9561936ea45769e77f0da365043d16e2a0b3d2c74921d31dd20133e696\",\"tlsCertificateSecret\":{\"key\":\"tls.crt\",\"name\":\"test-model-registry-662874-kube-rbac-proxy\"},\"tlsKeySecret\":{\"key\":\"tls.key\",\"name\":\"test-model-registry-662874-kube-rbac-proxy\"}},\"rest\":{\"image\":\"registry.redhat.io/rhoai/odh-model-registry-rhel9@sha256:20b320f3b9c07438fd5e62eca18e5ba85f1d73e7a58159db74426211004e71af\",\"resources\":{\"limits\":{\"memory\":\"256Mi\"},\"requests\":{\"cpu\":\"100m\",\"memory\":\"256Mi\"}}}}"} 2026-07-15T04:36:04Z INFO admission validate update {"object": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:model-registry-operator-controller-manager", "requestID": "8eb9e030-4839-494e-a38c-c23ca5bf3aa4", "name": "test-model-registry-662874"} 2026-07-15T04:36:04Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-15T04:36:04Z INFO Performing Finalizer Operations for modelRegistry before delete CR {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "e2412fbe-b4f4-47b3-bff5-6a071e50b9f0"} 2026-07-15T04:36:04Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-15T04:36:04Z DEBUG events Custom Resource test-model-registry-662874 is being deleted from the namespace rhoai-model-registries {"type": "Warning", "object": "nil", "action": "Deleting", "reason": "Deleting"} 2026-07-15T04:36:04Z INFO Removing Finalizer for modelRegistry after successfully perform the operations {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "e2412fbe-b4f4-47b3-bff5-6a071e50b9f0"} 2026-07-15T04:36:04Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "dd0fedd0-0046-429b-bc57-7375f8cc6e48"} 2026-07-15T04:36:04Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "f110616a-f4b4-4c3f-998f-404c8d94040b"} 2026-07-15T04:36:04Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "962b9aac-08b2-4076-8af8-1f905e3ff2b0"} 2026-07-15T04:36:46Z INFO controller-runtime.cache Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-07-15T04:44:59Z INFO controller-runtime.cache Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-07-15T04:52:51Z INFO controller-runtime.cache Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice ==================== WORKLOAD POD LOG: redhat-ods-applications/model-serving-api-67c44bccdf-2nkqw.log ==================== {"time":"2026-07-15T03:58:13.974539571Z","level":"INFO","msg":"metrics server starting","addr":":8080"} {"time":"2026-07-15T03:58:13.97467216Z","level":"INFO","msg":"server starting","addr":":8443","tls":true} ==================== WORKLOAD POD LOG: redhat-ods-applications/notebook-controller-deployment-6cb948c95d-dwzvq.log ==================== 2026-07-15T03:58:16Z INFO main Culling of idle Pods is Disabled. To enable it set the ENV Var 'ENABLE_CULLING=true' 2026-07-15T03:58:16Z INFO setup starting manager 2026-07-15T03:58:16Z INFO controller-runtime.metrics Starting metrics server 2026-07-15T03:58:16Z INFO controller-runtime.metrics Serving metrics server {"bindAddress": ":8080", "secure": false} 2026-07-15T03:58:16Z INFO starting server {"name": "health probe", "addr": "[::]:8081"} 2026-07-15T03:58:16Z INFO Starting EventSource {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "source": "kind source: *v1.Event"} 2026-07-15T03:58:16Z INFO Starting EventSource {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "source": "kind source: *v1beta1.Notebook"} 2026-07-15T03:58:16Z INFO Starting EventSource {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "source": "kind source: *v1.Pod"} 2026-07-15T03:58:16Z INFO Starting EventSource {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "source": "kind source: *v1.Service"} 2026-07-15T03:58:16Z INFO Starting EventSource {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "source": "kind source: *v1.StatefulSet"} 2026-07-15T03:58:16Z INFO Starting Controller {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook"} 2026-07-15T03:58:16Z INFO Starting workers {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "worker count": 1} ==================== WORKLOAD POD LOG: redhat-ods-applications/odh-model-controller-bc67559db-hjqkl.log ==================== 2026-07-15T03:58:12Z INFO setup Model registry inference service reconciliation enabled. 2026-07-15T03:58:12Z INFO setup Setting up LLMInferenceService controller 2026-07-15T03:58:12Z INFO setup Setting up Gateway controller for EnvoyFilter/AuthPolicy bootstrap {"envoyFilterCRD": true, "authPolicyCRD": true} 2026-07-15T03:58:12Z INFO controller-runtime.builder Registering a mutating webhook {"GVK": "/v1, Kind=Pod", "path": "/mutate--v1-pod"} 2026-07-15T03:58:12Z INFO controller-runtime.webhook Registering webhook {"path": "/mutate--v1-pod"} 2026-07-15T03:58:12Z INFO controller-runtime.builder skip registering a validating webhook, object does not implement admission.Validator or WithValidator wasn't called {"GVK": "/v1, Kind=Pod"} 2026-07-15T03:58:12Z INFO controller-runtime.builder skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called {"GVK": "nim.opendatahub.io/v1, Kind=Account"} 2026-07-15T03:58:12Z INFO controller-runtime.builder Registering a validating webhook {"GVK": "nim.opendatahub.io/v1, Kind=Account", "path": "/validate-nim-opendatahub-io-v1-account"} 2026-07-15T03:58:12Z INFO controller-runtime.webhook Registering webhook {"path": "/validate-nim-opendatahub-io-v1-account"} 2026-07-15T03:58:12Z INFO controller-runtime.builder Registering a mutating webhook {"GVK": "serving.kserve.io/v1beta1, Kind=InferenceService", "path": "/mutate-serving-kserve-io-v1beta1-inferenceservice"} 2026-07-15T03:58:12Z INFO controller-runtime.webhook Registering webhook {"path": "/mutate-serving-kserve-io-v1beta1-inferenceservice"} 2026-07-15T03:58:12Z INFO controller-runtime.builder Registering a validating webhook {"GVK": "serving.kserve.io/v1beta1, Kind=InferenceService", "path": "/validate-serving-kserve-io-v1beta1-inferenceservice"} 2026-07-15T03:58:12Z INFO controller-runtime.webhook Registering webhook {"path": "/validate-serving-kserve-io-v1beta1-inferenceservice"} 2026-07-15T03:58:12Z INFO controller-runtime.builder Registering a mutating webhook {"GVK": "serving.kserve.io/v1alpha1, Kind=InferenceGraph", "path": "/mutate-serving-kserve-io-v1alpha1-inferencegraph"} 2026-07-15T03:58:12Z INFO controller-runtime.webhook Registering webhook {"path": "/mutate-serving-kserve-io-v1alpha1-inferencegraph"} 2026-07-15T03:58:12Z INFO controller-runtime.builder Registering a validating webhook {"GVK": "serving.kserve.io/v1alpha1, Kind=InferenceGraph", "path": "/validate-serving-kserve-io-v1alpha1-inferencegraph"} 2026-07-15T03:58:12Z INFO controller-runtime.webhook Registering webhook {"path": "/validate-serving-kserve-io-v1alpha1-inferencegraph"} 2026-07-15T03:58:12Z INFO setup starting manager 2026-07-15T03:58:12Z INFO controller-runtime.metrics Starting metrics server 2026-07-15T03:58:12Z INFO starting server {"name": "health probe", "addr": "[::]:8081"} 2026-07-15T03:58:12Z INFO controller-runtime.metrics Serving metrics server {"bindAddress": ":8080", "secure": false} 2026-07-15T03:58:12Z INFO controller-runtime.webhook Starting webhook server 2026-07-15T03:58:12Z INFO setup disabling http/2 2026-07-15T03:58:12Z INFO controller-runtime.certwatcher Updated current TLS certificate 2026-07-15T03:58:12Z INFO controller-runtime.webhook Serving webhook server {"host": "", "port": 9443} 2026-07-15T03:58:12Z INFO controller-runtime.certwatcher Starting certificate poll+watcher {"interval": "10s"} I0715 03:58:12.731128 1 leaderelection.go:257] attempting to acquire leader lease redhat-ods-applications/odh-model-controller.opendatahub.io... I0715 03:58:12.743462 1 leaderelection.go:271] successfully acquired lease redhat-ods-applications/odh-model-controller.opendatahub.io 2026-07-15T03:58:12Z DEBUG events odh-model-controller-bc67559db-hjqkl_9bce8eae-8a72-4b5e-afb3-f72480af5020 became leader {"type": "Normal", "object": {"kind":"Lease","namespace":"redhat-ods-applications","name":"odh-model-controller.opendatahub.io","uid":"d5888b8b-b7f1-4257-b4d9-5c0b86954327","apiVersion":"coordination.k8s.io/v1","resourceVersion":"27877"}, "reason": "LeaderElection"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1beta1.InferenceService"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1alpha1.ServingRuntime"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.Namespace"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.Route"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.ServiceAccount"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.Service"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.ConfigMap"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.Secret"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.ClusterRoleBinding"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.NetworkPolicy"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.ServiceMonitor"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.PodMonitor"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.Role"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.RoleBinding"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1alpha1.TriggerAuthentication"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1alpha1.ServingRuntime"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.Secret"} 2026-07-15T03:58:12Z INFO Starting Controller {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "source": "kind source: *v1.ConfigMap"} 2026-07-15T03:58:12Z INFO Starting Controller {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "source": "kind source: *v1.Secret"} 2026-07-15T03:58:12Z INFO Starting Controller {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "servingruntime", "controllerGroup": "serving.kserve.io", "controllerKind": "ServingRuntime", "source": "kind source: *v1alpha1.ServingRuntime"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "servingruntime", "controllerGroup": "serving.kserve.io", "controllerKind": "ServingRuntime", "source": "kind source: *v1.RoleBinding"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1.Gateway"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1alpha3.EnvoyFilter"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1.AuthPolicy"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1alpha2.LLMInferenceService"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1alpha2.LLMInferenceServiceConfig"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1.Namespace"} 2026-07-15T03:58:12Z INFO Starting Controller {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "odh-nim-controller", "controllerGroup": "nim.opendatahub.io", "controllerKind": "Account", "source": "kind source: *v1.Account"} 2026-07-15T03:58:12Z INFO setup.MaaSRBACCleanup Starting MaaS RBAC cleanup 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "core-pod", "controllerGroup": "", "controllerKind": "Pod", "source": "kind source: *v1.Pod"} 2026-07-15T03:58:12Z INFO Starting Controller {"controller": "core-pod", "controllerGroup": "", "controllerKind": "Pod"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "odh-nim-controller", "controllerGroup": "nim.opendatahub.io", "controllerKind": "Account", "source": "kind source: *v1.ConfigMap"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "odh-nim-controller", "controllerGroup": "nim.opendatahub.io", "controllerKind": "Account", "source": "kind source: *v1.Secret"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "odh-nim-controller", "controllerGroup": "nim.opendatahub.io", "controllerKind": "Account", "source": "kind source: *v1.Template"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "odh-nim-controller", "controllerGroup": "nim.opendatahub.io", "controllerKind": "Account", "source": "kind source: *v1.Secret"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "odh-nim-controller", "controllerGroup": "nim.opendatahub.io", "controllerKind": "Account", "source": "kind source: *v1.ConfigMap"} 2026-07-15T03:58:12Z INFO Starting Controller {"controller": "odh-nim-controller", "controllerGroup": "nim.opendatahub.io", "controllerKind": "Account"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "servingruntime", "controllerGroup": "serving.kserve.io", "controllerKind": "ServingRuntime", "source": "kind source: *v1.Secret"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "servingruntime", "controllerGroup": "serving.kserve.io", "controllerKind": "ServingRuntime", "source": "kind source: *v1.Namespace"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "servingruntime", "controllerGroup": "serving.kserve.io", "controllerKind": "ServingRuntime", "source": "kind source: *v1.RoleBinding"} 2026-07-15T03:58:12Z INFO Starting Controller {"controller": "servingruntime", "controllerGroup": "serving.kserve.io", "controllerKind": "ServingRuntime"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "llminferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "LLMInferenceService", "source": "kind source: *v1alpha2.LLMInferenceService"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "llminferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "LLMInferenceService", "source": "kind source: *v1.AuthPolicy"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "llminferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "LLMInferenceService", "source": "kind source: *v1beta1.Kuadrant"} 2026-07-15T03:58:12Z INFO Starting EventSource {"controller": "llminferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "LLMInferenceService", "source": "kind source: *v1beta1.Authorino"} 2026-07-15T03:58:12Z INFO Starting Controller {"controller": "llminferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "LLMInferenceService"} 2026-07-15T03:58:12Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "InferenceService.serving.kserve.io", "error": "no matches for kind \"InferenceService\" in version \"serving.kserve.io/v1beta1\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:53 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:54 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:12Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "ServingRuntime.serving.kserve.io", "error": "no matches for kind \"ServingRuntime\" in version \"serving.kserve.io/v1alpha1\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:53 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:54 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:12Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "ServingRuntime.serving.kserve.io", "error": "no matches for kind \"ServingRuntime\" in version \"serving.kserve.io/v1alpha1\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:53 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:54 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:12Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "ServingRuntime.serving.kserve.io", "error": "no matches for kind \"ServingRuntime\" in version \"serving.kserve.io/v1alpha1\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:53 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:54 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:13Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "LLMInferenceService.serving.kserve.io", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:53 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:54 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:13Z INFO setup.MaaSRBACCleanup MaaS RBAC cleanup completed {"rolesRemoved": 0, "roleBindingsRemoved": 0} 2026-07-15T03:58:13Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "LLMInferenceServiceConfig.serving.kserve.io", "error": "no matches for kind \"LLMInferenceServiceConfig\" in version \"serving.kserve.io/v1alpha2\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:53 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:54 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:13Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "LLMInferenceService.serving.kserve.io", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:53 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:54 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "default", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "kuadrant-system", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-cloud-controller-manager", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-kueue-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-ovn-kubernetes", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-service-ca-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "redhat-ods-applications", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR setup Failed to list LLMInferenceService {"error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*LLMInferenceServiceReconciler).SetupWithManager.(*LLMInferenceServiceReconciler).globalResync.func5 /workspace/internal/controller/serving/llm/llm_inferenceservice_controller.go:204 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR setup Failed to list LLMInferenceService {"error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*LLMInferenceServiceReconciler).SetupWithManager.(*LLMInferenceServiceReconciler).globalResync.func6 /workspace/internal/controller/serving/llm/llm_inferenceservice_controller.go:204 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-cloud-credential-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-config", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-ingress-canary", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-insights", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-lws-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-service-ca", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "knative-serving", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-ingress", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-kube-apiserver", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-kube-scheduler-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-marketplace", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "knative-serving-ingress", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "open-cluster-management-agent-addon", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-apiserver", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-etcd", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-keda", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "kube-public", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z INFO Starting workers {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "worker count": 1} 2026-07-15T03:58:13Z INFO Starting workers {"controller": "core-pod", "controllerGroup": "", "controllerKind": "Pod", "worker count": 1} 2026-07-15T03:58:13Z INFO Starting workers {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "worker count": 1} 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-dns", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z INFO Starting workers {"controller": "odh-nim-controller", "controllerGroup": "nim.opendatahub.io", "controllerKind": "Account", "worker count": 1} 2026-07-15T03:58:13Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-network-operator"}, "namespace": "openshift-network-operator", "name": "openshift-service-ca.crt", "reconcileID": "6faf4ade-e9c7-49b0-b1e9-78557fc0bc49", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-network-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-kube-storage-version-migrator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-network-operator"}, "namespace": "openshift-network-operator", "name": "openshift-service-ca.crt", "reconcileID": "6faf4ade-e9c7-49b0-b1e9-78557fc0bc49", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-network-operator"} 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-network-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "kube-node-lease", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-authentication-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"redhat-ods-applications"}, "namespace": "redhat-ods-applications", "name": "openshift-service-ca.crt", "reconcileID": "ae39cbd3-950d-47a1-b3fa-e9fd9255ef61", "ConfigMap": "openshift-service-ca.crt", "namespace": "redhat-ods-applications", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:13Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"redhat-ods-applications"}, "namespace": "redhat-ods-applications", "name": "openshift-service-ca.crt", "reconcileID": "ae39cbd3-950d-47a1-b3fa-e9fd9255ef61", "ConfigMap": "openshift-service-ca.crt", "namespace": "redhat-ods-applications"} 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-cloud-network-config-controller", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-cluster-csi-drivers", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"kube-public"}, "namespace": "kube-public", "name": "openshift-service-ca.crt", "reconcileID": "abc123ff-ef9d-496b-bc86-73e3259b9647", "ConfigMap": "openshift-service-ca.crt", "namespace": "kube-public", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:13Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"kube-public"}, "namespace": "kube-public", "name": "openshift-service-ca.crt", "reconcileID": "abc123ff-ef9d-496b-bc86-73e3259b9647", "ConfigMap": "openshift-service-ca.crt", "namespace": "kube-public"} 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-infra", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-kube-apiserver-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:13Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-apiserver-operator"}, "namespace": "openshift-kube-apiserver-operator", "name": "openshift-service-ca.crt", "reconcileID": "29d66ae2-97af-4e4c-b5c1-87c6e329eff3", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-apiserver-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:13Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-apiserver-operator"}, "namespace": "openshift-kube-apiserver-operator", "name": "openshift-service-ca.crt", "reconcileID": "29d66ae2-97af-4e4c-b5c1-87c6e329eff3", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-apiserver-operator"} 2026-07-15T03:58:13Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-user-workload-monitoring", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:14Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-network-node-identity"}, "namespace": "openshift-network-node-identity", "name": "openshift-service-ca.crt", "reconcileID": "25b532d9-995b-46c0-ba24-7152e91855fe", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-network-node-identity", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:14Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "cert-manager-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:14Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-network-node-identity"}, "namespace": "openshift-network-node-identity", "name": "openshift-service-ca.crt", "reconcileID": "25b532d9-995b-46c0-ba24-7152e91855fe", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-network-node-identity"} 2026-07-15T03:58:14Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-cluster-machine-approver", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:14Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-config-managed", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:14Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "odh-trusted-ca-bundle", "reconcileID": "7228cfb3-72b2-4260-b29a-fd7ab1d8c198", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "rhoai-model-registries", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:14Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-config-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:14Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "odh-trusted-ca-bundle", "reconcileID": "7228cfb3-72b2-4260-b29a-fd7ab1d8c198", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "rhoai-model-registries"} 2026-07-15T03:58:14Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-kube-controller-manager", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:14Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-kube-controller-manager-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:14Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-multus", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:14Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "kyverno", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:14Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"knative-serving"}, "namespace": "knative-serving", "name": "openshift-service-ca.crt", "reconcileID": "9104360d-26e9-489d-8c02-f94a7389dfc2", "ConfigMap": "openshift-service-ca.crt", "namespace": "knative-serving", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:14Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"knative-serving"}, "namespace": "knative-serving", "name": "openshift-service-ca.crt", "reconcileID": "9104360d-26e9-489d-8c02-f94a7389dfc2", "ConfigMap": "openshift-service-ca.crt", "namespace": "knative-serving"} 2026-07-15T03:58:14Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-cluster-storage-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:14Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-console-user-settings", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:14Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-user-workload-monitoring"}, "namespace": "openshift-user-workload-monitoring", "name": "openshift-service-ca.crt", "reconcileID": "a1eceefc-2a8a-46a9-8ab7-d588344956f8", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-user-workload-monitoring", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:14Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-user-workload-monitoring"}, "namespace": "openshift-user-workload-monitoring", "name": "openshift-service-ca.crt", "reconcileID": "a1eceefc-2a8a-46a9-8ab7-d588344956f8", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-user-workload-monitoring"} 2026-07-15T03:58:14Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-image-registry", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:14Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-kube-scheduler", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:14Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-machine-config-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:14Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"odh-model-registries"}, "namespace": "odh-model-registries", "name": "odh-trusted-ca-bundle", "reconcileID": "5b66e5a8-6f3d-4252-9f65-3acefced8138", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "odh-model-registries", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:14Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"odh-model-registries"}, "namespace": "odh-model-registries", "name": "odh-trusted-ca-bundle", "reconcileID": "5b66e5a8-6f3d-4252-9f65-3acefced8138", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "odh-model-registries"} 2026-07-15T03:58:14Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "odh-model-registries", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:14Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-authentication", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:14Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-console-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:14Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"redhat-ods-operator"}, "namespace": "redhat-ods-operator", "name": "odh-trusted-ca-bundle", "reconcileID": "73a3b69b-075a-4239-b945-85e051e358d9", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "redhat-ods-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:14Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"redhat-ods-operator"}, "namespace": "redhat-ods-operator", "name": "odh-trusted-ca-bundle", "reconcileID": "73a3b69b-075a-4239-b945-85e051e358d9", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "redhat-ods-operator"} 2026-07-15T03:58:14Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-network-diagnostics", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:14Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-operators", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:14Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "cert-manager", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:14Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-apiserver-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:15Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"open-cluster-management-3c9a9014-bde8-4e38-b746-7a1dd8b61"}, "namespace": "open-cluster-management-3c9a9014-bde8-4e38-b746-7a1dd8b61", "name": "openshift-service-ca.crt", "reconcileID": "41e42128-0298-4008-8e2c-317893aab8b1", "ConfigMap": "openshift-service-ca.crt", "namespace": "open-cluster-management-3c9a9014-bde8-4e38-b746-7a1dd8b61", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:15Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-controller-manager-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:15Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"open-cluster-management-3c9a9014-bde8-4e38-b746-7a1dd8b61"}, "namespace": "open-cluster-management-3c9a9014-bde8-4e38-b746-7a1dd8b61", "name": "openshift-service-ca.crt", "reconcileID": "41e42128-0298-4008-8e2c-317893aab8b1", "ConfigMap": "openshift-service-ca.crt", "namespace": "open-cluster-management-3c9a9014-bde8-4e38-b746-7a1dd8b61"} 2026-07-15T03:58:15Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-jobset-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:15Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-infra"}, "namespace": "openshift-infra", "name": "openshift-service-ca.crt", "reconcileID": "b91ed8d6-2597-4c03-8f48-0b1c0e7f8313", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-infra", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:15Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-network-console", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:15Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-infra"}, "namespace": "openshift-infra", "name": "openshift-service-ca.crt", "reconcileID": "b91ed8d6-2597-4c03-8f48-0b1c0e7f8313", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-infra"} 2026-07-15T03:58:15Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-node", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:15Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"kyverno"}, "namespace": "kyverno", "name": "odh-trusted-ca-bundle", "reconcileID": "db29d259-4602-4e86-b34c-6c670d1813be", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "kyverno", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:15Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "open-cluster-management-3c9a9014-bde8-4e38-b746-7a1dd8b61", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:15Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"kyverno"}, "namespace": "kyverno", "name": "odh-trusted-ca-bundle", "reconcileID": "db29d259-4602-4e86-b34c-6c670d1813be", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "kyverno"} 2026-07-15T03:58:15Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-kube-storage-version-migrator-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:15Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-image-registry"}, "namespace": "openshift-image-registry", "name": "openshift-service-ca.crt", "reconcileID": "3de0ce38-1922-4dd2-9ef8-e4ee48088678", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-image-registry", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:15Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-image-registry"}, "namespace": "openshift-image-registry", "name": "openshift-service-ca.crt", "reconcileID": "3de0ce38-1922-4dd2-9ef8-e4ee48088678", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-image-registry"} 2026-07-15T03:58:15Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-monitoring", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:15Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "kube-system", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:15Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "openshift-service-ca.crt", "reconcileID": "05025b5c-ed20-46ad-90b9-f9cc30383d63", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-ingress", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:15Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "openshift-service-ca.crt", "reconcileID": "05025b5c-ed20-46ad-90b9-f9cc30383d63", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-ingress"} 2026-07-15T03:58:15Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-cluster-node-tuning-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:15Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-cluster-samples-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:15Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-config-operator"}, "namespace": "openshift-config-operator", "name": "openshift-service-ca.crt", "reconcileID": "af8e904b-87c4-468b-891b-8821101475d2", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-config-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:15Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-config-operator"}, "namespace": "openshift-config-operator", "name": "openshift-service-ca.crt", "reconcileID": "af8e904b-87c4-468b-891b-8821101475d2", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-config-operator"} 2026-07-15T03:58:15Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-cluster-version", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:15Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-ingress-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:15Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-apiserver"}, "namespace": "openshift-apiserver", "name": "openshift-service-ca.crt", "reconcileID": "a2219a40-bf13-49cb-8f57-3ff6e1f4bf0b", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-apiserver", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:15Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-apiserver"}, "namespace": "openshift-apiserver", "name": "openshift-service-ca.crt", "reconcileID": "a2219a40-bf13-49cb-8f57-3ff6e1f4bf0b", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-apiserver"} 2026-07-15T03:58:15Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-operator-lifecycle-manager", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:15Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-network-diagnostics"}, "namespace": "openshift-network-diagnostics", "name": "openshift-service-ca.crt", "reconcileID": "43398e3d-b9c8-4279-ab10-880a30f5ce5b", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-network-diagnostics", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:15Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "knative-eventing", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:15Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-network-diagnostics"}, "namespace": "openshift-network-diagnostics", "name": "openshift-service-ca.crt", "reconcileID": "43398e3d-b9c8-4279-ab10-880a30f5ce5b", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-network-diagnostics"} 2026-07-15T03:58:15Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-host-network", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:15Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "redhat-ods-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:15Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "rhods-notebooks", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:15Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-operator-lifecycle-manager"}, "namespace": "openshift-operator-lifecycle-manager", "name": "openshift-service-ca.crt", "reconcileID": "0a3b0c4c-3939-4d65-b045-d932041c890e", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-operator-lifecycle-manager", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:15Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-operator-lifecycle-manager"}, "namespace": "openshift-operator-lifecycle-manager", "name": "openshift-service-ca.crt", "reconcileID": "0a3b0c4c-3939-4d65-b045-d932041c890e", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-operator-lifecycle-manager"} 2026-07-15T03:58:15Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-console", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:15Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-controller-manager", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:15Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"knative-eventing"}, "namespace": "knative-eventing", "name": "openshift-service-ca.crt", "reconcileID": "6ee76035-c514-435b-b3bb-af7ab737ac48", "ConfigMap": "openshift-service-ca.crt", "namespace": "knative-eventing", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:15Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"knative-eventing"}, "namespace": "knative-eventing", "name": "openshift-service-ca.crt", "reconcileID": "6ee76035-c514-435b-b3bb-af7ab737ac48", "ConfigMap": "openshift-service-ca.crt", "namespace": "knative-eventing"} 2026-07-15T03:58:15Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-dns-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:16Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "rhoai-model-registries", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:16Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "opendatahub", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-version"}, "namespace": "openshift-cluster-version", "name": "openshift-service-ca.crt", "reconcileID": "e4b55794-e202-4065-9be0-ed0b7d83702a", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-version", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-version"}, "namespace": "openshift-cluster-version", "name": "openshift-service-ca.crt", "reconcileID": "e4b55794-e202-4065-9be0-ed0b7d83702a", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-version"} 2026-07-15T03:58:16Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-machine-api", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:16Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-network-node-identity", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:16Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-route-controller-manager", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:16Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"redhat-ods-applications"}, "namespace": "redhat-ods-applications", "name": "odh-trusted-ca-bundle", "reconcileID": "d09e429b-26f5-4c72-9fba-7228beb0e186", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "redhat-ods-applications"} 2026-07-15T03:58:16Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "redhat-ods-monitoring", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-machine-config-operator"}, "namespace": "openshift-machine-config-operator", "name": "openshift-service-ca.crt", "reconcileID": "dbe8e42e-c7aa-44ac-bda8-1afc03d8f9f1", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-machine-config-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-machine-config-operator"}, "namespace": "openshift-machine-config-operator", "name": "openshift-service-ca.crt", "reconcileID": "dbe8e42e-c7aa-44ac-bda8-1afc03d8f9f1", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-machine-config-operator"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-monitoring"}, "namespace": "openshift-monitoring", "name": "openshift-service-ca.crt", "reconcileID": "6c025e31-59ef-4b5c-af6f-35f344f37ecf", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-monitoring", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-monitoring"}, "namespace": "openshift-monitoring", "name": "openshift-service-ca.crt", "reconcileID": "6c025e31-59ef-4b5c-af6f-35f344f37ecf", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-monitoring"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"knative-serving-ingress"}, "namespace": "knative-serving-ingress", "name": "openshift-service-ca.crt", "reconcileID": "ac6698d4-6d33-4c93-b666-bff4786420a4", "ConfigMap": "openshift-service-ca.crt", "namespace": "knative-serving-ingress", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"knative-serving-ingress"}, "namespace": "knative-serving-ingress", "name": "openshift-service-ca.crt", "reconcileID": "ac6698d4-6d33-4c93-b666-bff4786420a4", "ConfigMap": "openshift-service-ca.crt", "namespace": "knative-serving-ingress"} 2026-07-15T03:58:16Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"knative-serving"}, "namespace": "knative-serving", "name": "odh-trusted-ca-bundle", "reconcileID": "ac85aa57-bd60-4496-8e87-b0dd19d70b99", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "knative-serving"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-service-ca"}, "namespace": "openshift-service-ca", "name": "openshift-service-ca.crt", "reconcileID": "c4dcc467-3850-4770-8802-2214c9b5726d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-service-ca", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-service-ca"}, "namespace": "openshift-service-ca", "name": "openshift-service-ca.crt", "reconcileID": "c4dcc467-3850-4770-8802-2214c9b5726d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-service-ca"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"open-cluster-management-agent-addon"}, "namespace": "open-cluster-management-agent-addon", "name": "openshift-service-ca.crt", "reconcileID": "d926abf9-6830-40fc-9fcc-34d79f3fcadb", "ConfigMap": "openshift-service-ca.crt", "namespace": "open-cluster-management-agent-addon", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"open-cluster-management-agent-addon"}, "namespace": "open-cluster-management-agent-addon", "name": "openshift-service-ca.crt", "reconcileID": "d926abf9-6830-40fc-9fcc-34d79f3fcadb", "ConfigMap": "openshift-service-ca.crt", "namespace": "open-cluster-management-agent-addon"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-apiserver-operator"}, "namespace": "openshift-apiserver-operator", "name": "openshift-service-ca.crt", "reconcileID": "17261f54-ca56-4a7c-b06e-c426cc84bafb", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-apiserver-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-apiserver-operator"}, "namespace": "openshift-apiserver-operator", "name": "openshift-service-ca.crt", "reconcileID": "17261f54-ca56-4a7c-b06e-c426cc84bafb", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-apiserver-operator"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-scheduler"}, "namespace": "openshift-kube-scheduler", "name": "openshift-service-ca.crt", "reconcileID": "1ef40120-ded7-424e-896b-432c54eef4d5", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-scheduler", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-scheduler"}, "namespace": "openshift-kube-scheduler", "name": "openshift-service-ca.crt", "reconcileID": "1ef40120-ded7-424e-896b-432c54eef4d5", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-scheduler"} 2026-07-15T03:58:16Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"kyverno"}, "namespace": "kyverno", "name": "openshift-service-ca.crt", "reconcileID": "9a8fb1a5-0ead-4c00-b884-eb78003ca7b1", "ConfigMap": "openshift-service-ca.crt", "namespace": "kyverno"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-node"}, "namespace": "openshift-node", "name": "openshift-service-ca.crt", "reconcileID": "24137939-35b5-4c42-8e14-f426d17a20d7", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-node", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-node"}, "namespace": "openshift-node", "name": "openshift-service-ca.crt", "reconcileID": "24137939-35b5-4c42-8e14-f426d17a20d7", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-node"} 2026-07-15T03:58:16Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"odh-model-registries"}, "namespace": "odh-model-registries", "name": "openshift-service-ca.crt", "reconcileID": "8136a476-0d42-44e5-b77f-ad23233759d5", "ConfigMap": "openshift-service-ca.crt", "namespace": "odh-model-registries"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cloud-credential-operator"}, "namespace": "openshift-cloud-credential-operator", "name": "openshift-service-ca.crt", "reconcileID": "7144c5b4-0bd4-48a6-94ac-1f9d177531a6", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cloud-credential-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cloud-credential-operator"}, "namespace": "openshift-cloud-credential-operator", "name": "openshift-service-ca.crt", "reconcileID": "7144c5b4-0bd4-48a6-94ac-1f9d177531a6", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cloud-credential-operator"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-storage-operator"}, "namespace": "openshift-cluster-storage-operator", "name": "openshift-service-ca.crt", "reconcileID": "adda218c-fec1-48f7-b658-4d16fdb79f1b", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-storage-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-storage-operator"}, "namespace": "openshift-cluster-storage-operator", "name": "openshift-service-ca.crt", "reconcileID": "adda218c-fec1-48f7-b658-4d16fdb79f1b", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-storage-operator"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-ingress-operator"}, "namespace": "openshift-ingress-operator", "name": "openshift-service-ca.crt", "reconcileID": "77834d4e-1243-4b8c-9e5a-3203645844cc", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-ingress-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-ingress-operator"}, "namespace": "openshift-ingress-operator", "name": "openshift-service-ca.crt", "reconcileID": "77834d4e-1243-4b8c-9e5a-3203645844cc", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-ingress-operator"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-controller-manager-operator"}, "namespace": "openshift-kube-controller-manager-operator", "name": "openshift-service-ca.crt", "reconcileID": "bd5fc6c3-ac7a-4ae6-a589-1da21bbb036d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-controller-manager-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-controller-manager-operator"}, "namespace": "openshift-kube-controller-manager-operator", "name": "openshift-service-ca.crt", "reconcileID": "bd5fc6c3-ac7a-4ae6-a589-1da21bbb036d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-controller-manager-operator"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-console-operator"}, "namespace": "openshift-console-operator", "name": "openshift-service-ca.crt", "reconcileID": "5206d3ba-239b-4ebc-96f2-621f6df8d064", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-console-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-console-operator"}, "namespace": "openshift-console-operator", "name": "openshift-service-ca.crt", "reconcileID": "5206d3ba-239b-4ebc-96f2-621f6df8d064", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-console-operator"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"redhat-ods-monitoring"}, "namespace": "redhat-ods-monitoring", "name": "odh-trusted-ca-bundle", "reconcileID": "ca12de48-8306-41c1-8258-f03dfff211d3", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "redhat-ods-monitoring", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"redhat-ods-monitoring"}, "namespace": "redhat-ods-monitoring", "name": "odh-trusted-ca-bundle", "reconcileID": "ca12de48-8306-41c1-8258-f03dfff211d3", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "redhat-ods-monitoring"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cert-manager"}, "namespace": "cert-manager", "name": "openshift-service-ca.crt", "reconcileID": "bd532bfb-bf7b-47a1-bdcf-f7707d5bffb4", "ConfigMap": "openshift-service-ca.crt", "namespace": "cert-manager", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cert-manager"}, "namespace": "cert-manager", "name": "openshift-service-ca.crt", "reconcileID": "bd532bfb-bf7b-47a1-bdcf-f7707d5bffb4", "ConfigMap": "openshift-service-ca.crt", "namespace": "cert-manager"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-jobset-operator"}, "namespace": "openshift-jobset-operator", "name": "openshift-service-ca.crt", "reconcileID": "4701abbb-2d0d-454e-a482-27cf83b6b72d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-jobset-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-jobset-operator"}, "namespace": "openshift-jobset-operator", "name": "openshift-service-ca.crt", "reconcileID": "4701abbb-2d0d-454e-a482-27cf83b6b72d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-jobset-operator"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-scheduler-operator"}, "namespace": "openshift-kube-scheduler-operator", "name": "openshift-service-ca.crt", "reconcileID": "ea22fb62-4683-4439-bcd3-5f9d51de617c", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-scheduler-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-scheduler-operator"}, "namespace": "openshift-kube-scheduler-operator", "name": "openshift-service-ca.crt", "reconcileID": "ea22fb62-4683-4439-bcd3-5f9d51de617c", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-scheduler-operator"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-service-ca-operator"}, "namespace": "openshift-service-ca-operator", "name": "openshift-service-ca.crt", "reconcileID": "08a2e3f6-63f4-45df-bd0c-2fc6c227f04d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-service-ca-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-service-ca-operator"}, "namespace": "openshift-service-ca-operator", "name": "openshift-service-ca.crt", "reconcileID": "08a2e3f6-63f4-45df-bd0c-2fc6c227f04d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-service-ca-operator"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-authentication-operator"}, "namespace": "openshift-authentication-operator", "name": "openshift-service-ca.crt", "reconcileID": "4e7d02ab-0f50-4080-ab63-aaf463b787d7", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-authentication-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-authentication-operator"}, "namespace": "openshift-authentication-operator", "name": "openshift-service-ca.crt", "reconcileID": "4e7d02ab-0f50-4080-ab63-aaf463b787d7", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-authentication-operator"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-apiserver"}, "namespace": "openshift-kube-apiserver", "name": "openshift-service-ca.crt", "reconcileID": "a6ba9d32-080c-4e37-b08f-28cf29d3156b", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-apiserver", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-apiserver"}, "namespace": "openshift-kube-apiserver", "name": "openshift-service-ca.crt", "reconcileID": "a6ba9d32-080c-4e37-b08f-28cf29d3156b", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-apiserver"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "odh-trusted-ca-bundle", "reconcileID": "eb0f7f3a-4600-4bf9-a68a-7ed12699736b", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "rhods-notebooks", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "odh-trusted-ca-bundle", "reconcileID": "eb0f7f3a-4600-4bf9-a68a-7ed12699736b", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "rhods-notebooks"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-keda"}, "namespace": "openshift-keda", "name": "openshift-service-ca.crt", "reconcileID": "a71be6ed-bd12-432c-a875-afce5388d194", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-keda", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-keda"}, "namespace": "openshift-keda", "name": "openshift-service-ca.crt", "reconcileID": "a71be6ed-bd12-432c-a875-afce5388d194", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-keda"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"kube-node-lease"}, "namespace": "kube-node-lease", "name": "openshift-service-ca.crt", "reconcileID": "377a7bc5-1318-485a-9798-8c553ceba172", "ConfigMap": "openshift-service-ca.crt", "namespace": "kube-node-lease", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"kube-node-lease"}, "namespace": "kube-node-lease", "name": "openshift-service-ca.crt", "reconcileID": "377a7bc5-1318-485a-9798-8c553ceba172", "ConfigMap": "openshift-service-ca.crt", "namespace": "kube-node-lease"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-console"}, "namespace": "openshift-console", "name": "openshift-service-ca.crt", "reconcileID": "b5948d74-3f93-4660-9fa7-bf2844e843a1", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-console", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-console"}, "namespace": "openshift-console", "name": "openshift-service-ca.crt", "reconcileID": "b5948d74-3f93-4660-9fa7-bf2844e843a1", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-console"} 2026-07-15T03:58:16Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cert-manager"}, "namespace": "cert-manager", "name": "odh-trusted-ca-bundle", "reconcileID": "6394d7b4-e0d6-4e9a-a11b-a1f3a3956427", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cert-manager"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-storage-version-migrator-operator"}, "namespace": "openshift-kube-storage-version-migrator-operator", "name": "openshift-service-ca.crt", "reconcileID": "6dfe9902-a3ed-4632-88c4-0219d1f5d63b", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-storage-version-migrator-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-storage-version-migrator-operator"}, "namespace": "openshift-kube-storage-version-migrator-operator", "name": "openshift-service-ca.crt", "reconcileID": "6dfe9902-a3ed-4632-88c4-0219d1f5d63b", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-storage-version-migrator-operator"} 2026-07-15T03:58:16Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"knative-serving-ingress"}, "namespace": "knative-serving-ingress", "name": "odh-trusted-ca-bundle", "reconcileID": "29c9cb70-7a34-42eb-827e-37d74e91471e", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "knative-serving-ingress"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"default"}, "namespace": "default", "name": "openshift-service-ca.crt", "reconcileID": "144e7aaf-1475-4088-ab8d-ad0dba6f1667", "ConfigMap": "openshift-service-ca.crt", "namespace": "default", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"default"}, "namespace": "default", "name": "openshift-service-ca.crt", "reconcileID": "144e7aaf-1475-4088-ab8d-ad0dba6f1667", "ConfigMap": "openshift-service-ca.crt", "namespace": "default"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cloud-network-config-controller"}, "namespace": "openshift-cloud-network-config-controller", "name": "openshift-service-ca.crt", "reconcileID": "2af09fe2-ae6b-4a61-ac6e-fa9b4823256d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cloud-network-config-controller", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cloud-network-config-controller"}, "namespace": "openshift-cloud-network-config-controller", "name": "openshift-service-ca.crt", "reconcileID": "2af09fe2-ae6b-4a61-ac6e-fa9b4823256d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cloud-network-config-controller"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-machine-api"}, "namespace": "openshift-machine-api", "name": "openshift-service-ca.crt", "reconcileID": "a12b1b83-763a-4a3f-b40d-d72f3b7d217d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-machine-api", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-machine-api"}, "namespace": "openshift-machine-api", "name": "openshift-service-ca.crt", "reconcileID": "a12b1b83-763a-4a3f-b40d-d72f3b7d217d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-machine-api"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"kube-system"}, "namespace": "kube-system", "name": "openshift-service-ca.crt", "reconcileID": "d56538be-29db-47c6-a940-8669d86b7b55", "ConfigMap": "openshift-service-ca.crt", "namespace": "kube-system", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"kube-system"}, "namespace": "kube-system", "name": "openshift-service-ca.crt", "reconcileID": "d56538be-29db-47c6-a940-8669d86b7b55", "ConfigMap": "openshift-service-ca.crt", "namespace": "kube-system"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-storage-version-migrator"}, "namespace": "openshift-kube-storage-version-migrator", "name": "openshift-service-ca.crt", "reconcileID": "45f04ed1-bf37-4706-9661-5e14375ccdd5", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-storage-version-migrator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-storage-version-migrator"}, "namespace": "openshift-kube-storage-version-migrator", "name": "openshift-service-ca.crt", "reconcileID": "45f04ed1-bf37-4706-9661-5e14375ccdd5", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-storage-version-migrator"} 2026-07-15T03:58:16Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "openshift-service-ca.crt", "reconcileID": "a6a6e928-e355-409c-a5a1-b0ac6b9e29ef", "ConfigMap": "openshift-service-ca.crt", "namespace": "rhoai-model-registries"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cert-manager-operator"}, "namespace": "cert-manager-operator", "name": "openshift-service-ca.crt", "reconcileID": "45a8724d-97d0-4e4a-ac50-8b8b77586e55", "ConfigMap": "openshift-service-ca.crt", "namespace": "cert-manager-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cert-manager-operator"}, "namespace": "cert-manager-operator", "name": "openshift-service-ca.crt", "reconcileID": "45a8724d-97d0-4e4a-ac50-8b8b77586e55", "ConfigMap": "openshift-service-ca.crt", "namespace": "cert-manager-operator"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-csi-drivers"}, "namespace": "openshift-cluster-csi-drivers", "name": "openshift-service-ca.crt", "reconcileID": "4c17952d-51f5-48f0-894c-d083c4ec4729", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-csi-drivers", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-csi-drivers"}, "namespace": "openshift-cluster-csi-drivers", "name": "openshift-service-ca.crt", "reconcileID": "4c17952d-51f5-48f0-894c-d083c4ec4729", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-csi-drivers"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-ovn-kubernetes"}, "namespace": "openshift-ovn-kubernetes", "name": "openshift-service-ca.crt", "reconcileID": "ade5913a-2d86-4944-9db3-9a5c729b45f8", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-ovn-kubernetes", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-ovn-kubernetes"}, "namespace": "openshift-ovn-kubernetes", "name": "openshift-service-ca.crt", "reconcileID": "ade5913a-2d86-4944-9db3-9a5c729b45f8", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-ovn-kubernetes"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-dns"}, "namespace": "openshift-dns", "name": "openshift-service-ca.crt", "reconcileID": "eb05dfc4-a597-4148-9317-895fd2440b5b", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-dns", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-dns"}, "namespace": "openshift-dns", "name": "openshift-service-ca.crt", "reconcileID": "eb05dfc4-a597-4148-9317-895fd2440b5b", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-dns"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"kuadrant-system"}, "namespace": "kuadrant-system", "name": "openshift-service-ca.crt", "reconcileID": "8c2ee8fd-d3db-4fd0-80aa-00e26d7d4b63", "ConfigMap": "openshift-service-ca.crt", "namespace": "kuadrant-system", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"kuadrant-system"}, "namespace": "kuadrant-system", "name": "openshift-service-ca.crt", "reconcileID": "8c2ee8fd-d3db-4fd0-80aa-00e26d7d4b63", "ConfigMap": "openshift-service-ca.crt", "namespace": "kuadrant-system"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-controller-manager-operator"}, "namespace": "openshift-controller-manager-operator", "name": "openshift-service-ca.crt", "reconcileID": "7f673d0d-e781-4218-b8d8-56f427e8a6cb", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-controller-manager-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-controller-manager-operator"}, "namespace": "openshift-controller-manager-operator", "name": "openshift-service-ca.crt", "reconcileID": "7f673d0d-e781-4218-b8d8-56f427e8a6cb", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-controller-manager-operator"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-etcd"}, "namespace": "openshift-etcd", "name": "openshift-service-ca.crt", "reconcileID": "4f24e298-5508-48ff-a40c-b10a2191ba19", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-etcd", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-etcd"}, "namespace": "openshift-etcd", "name": "openshift-service-ca.crt", "reconcileID": "4f24e298-5508-48ff-a40c-b10a2191ba19", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-etcd"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-samples-operator"}, "namespace": "openshift-cluster-samples-operator", "name": "openshift-service-ca.crt", "reconcileID": "59c232a6-e425-4ca4-a76a-dbdba519aa98", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-samples-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-samples-operator"}, "namespace": "openshift-cluster-samples-operator", "name": "openshift-service-ca.crt", "reconcileID": "59c232a6-e425-4ca4-a76a-dbdba519aa98", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-samples-operator"} 2026-07-15T03:58:16Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"open-cluster-management-agent-addon"}, "namespace": "open-cluster-management-agent-addon", "name": "odh-trusted-ca-bundle", "reconcileID": "5a6f61b1-8116-41f5-8782-1fe4040ea146", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "open-cluster-management-agent-addon"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-config-managed"}, "namespace": "openshift-config-managed", "name": "openshift-service-ca.crt", "reconcileID": "d6e30099-92fe-4d38-b56a-29ae7b3d67dc", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-config-managed", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-config-managed"}, "namespace": "openshift-config-managed", "name": "openshift-service-ca.crt", "reconcileID": "d6e30099-92fe-4d38-b56a-29ae7b3d67dc", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-config-managed"} 2026-07-15T03:58:16Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"kuadrant-system"}, "namespace": "kuadrant-system", "name": "odh-trusted-ca-bundle", "reconcileID": "a04dcbf5-f83b-48b1-b43c-d22a6bad17e3", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "kuadrant-system"} 2026-07-15T03:58:16Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"open-cluster-management-3c9a9014-bde8-4e38-b746-7a1dd8b61"}, "namespace": "open-cluster-management-3c9a9014-bde8-4e38-b746-7a1dd8b61", "name": "odh-trusted-ca-bundle", "reconcileID": "7773e919-dbce-4210-b676-0492f4e8d870", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "open-cluster-management-3c9a9014-bde8-4e38-b746-7a1dd8b61"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-insights"}, "namespace": "openshift-insights", "name": "openshift-service-ca.crt", "reconcileID": "38cf560c-56fe-4193-9fba-903ee955b81d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-insights", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-insights"}, "namespace": "openshift-insights", "name": "openshift-service-ca.crt", "reconcileID": "38cf560c-56fe-4193-9fba-903ee955b81d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-insights"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-ingress-canary"}, "namespace": "openshift-ingress-canary", "name": "openshift-service-ca.crt", "reconcileID": "0b603972-3432-4c53-a3e5-df474ee9c69d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-ingress-canary", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-ingress-canary"}, "namespace": "openshift-ingress-canary", "name": "openshift-service-ca.crt", "reconcileID": "0b603972-3432-4c53-a3e5-df474ee9c69d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-ingress-canary"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cloud-controller-manager"}, "namespace": "openshift-cloud-controller-manager", "name": "openshift-service-ca.crt", "reconcileID": "f4e343bb-5be6-437f-bfc5-469b8348c937", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cloud-controller-manager", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cloud-controller-manager"}, "namespace": "openshift-cloud-controller-manager", "name": "openshift-service-ca.crt", "reconcileID": "f4e343bb-5be6-437f-bfc5-469b8348c937", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cloud-controller-manager"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-config"}, "namespace": "openshift-config", "name": "openshift-service-ca.crt", "reconcileID": "c64449b2-fd81-4707-99c3-14477268a908", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-config", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:16Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-config"}, "namespace": "openshift-config", "name": "openshift-service-ca.crt", "reconcileID": "c64449b2-fd81-4707-99c3-14477268a908", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-config"} 2026-07-15T03:58:16Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-operators"}, "namespace": "openshift-operators", "name": "openshift-service-ca.crt", "reconcileID": "350ddd23-37e1-4376-8261-99883ef5edbb", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-operators", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:17Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-operators"}, "namespace": "openshift-operators", "name": "openshift-service-ca.crt", "reconcileID": "350ddd23-37e1-4376-8261-99883ef5edbb", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-operators"} 2026-07-15T03:58:17Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-route-controller-manager"}, "namespace": "openshift-route-controller-manager", "name": "openshift-service-ca.crt", "reconcileID": "6faf53db-174a-4a55-bdd3-d0583550ea1b", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-route-controller-manager", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:17Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-route-controller-manager"}, "namespace": "openshift-route-controller-manager", "name": "openshift-service-ca.crt", "reconcileID": "6faf53db-174a-4a55-bdd3-d0583550ea1b", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-route-controller-manager"} 2026-07-15T03:58:17Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-network-console"}, "namespace": "openshift-network-console", "name": "openshift-service-ca.crt", "reconcileID": "3742501f-4052-4626-beca-7ef8cb26e20d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-network-console", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:17Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-network-console"}, "namespace": "openshift-network-console", "name": "openshift-service-ca.crt", "reconcileID": "3742501f-4052-4626-beca-7ef8cb26e20d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-network-console"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "openshift-service-ca.crt", "reconcileID": "79d5d8a0-2645-49a1-9550-20bab8454cb3", "ConfigMap": "openshift-service-ca.crt", "namespace": "rhods-notebooks"} 2026-07-15T03:58:17Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-lws-operator"}, "namespace": "openshift-lws-operator", "name": "openshift-service-ca.crt", "reconcileID": "969ca3e7-0c70-461e-b659-e3cf72eb272b", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-lws-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:17Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-lws-operator"}, "namespace": "openshift-lws-operator", "name": "openshift-service-ca.crt", "reconcileID": "969ca3e7-0c70-461e-b659-e3cf72eb272b", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-lws-operator"} 2026-07-15T03:58:17Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kueue-operator"}, "namespace": "openshift-kueue-operator", "name": "openshift-service-ca.crt", "reconcileID": "a93b70b6-6c4d-4195-9689-10ce78f3cfee", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kueue-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:17Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kueue-operator"}, "namespace": "openshift-kueue-operator", "name": "openshift-service-ca.crt", "reconcileID": "a93b70b6-6c4d-4195-9689-10ce78f3cfee", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kueue-operator"} 2026-07-15T03:58:17Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-host-network"}, "namespace": "openshift-host-network", "name": "openshift-service-ca.crt", "reconcileID": "1ecc02c7-6ea7-44ef-ba8b-59bbda6b13ea", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-host-network", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:17Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-host-network"}, "namespace": "openshift-host-network", "name": "openshift-service-ca.crt", "reconcileID": "1ecc02c7-6ea7-44ef-ba8b-59bbda6b13ea", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-host-network"} 2026-07-15T03:58:17Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-controller-manager"}, "namespace": "openshift-kube-controller-manager", "name": "openshift-service-ca.crt", "reconcileID": "eba72609-e91c-4a12-bde3-9b87ff465d0b", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-controller-manager", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:17Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-controller-manager"}, "namespace": "openshift-kube-controller-manager", "name": "openshift-service-ca.crt", "reconcileID": "eba72609-e91c-4a12-bde3-9b87ff465d0b", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-controller-manager"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"knative-eventing"}, "namespace": "knative-eventing", "name": "odh-trusted-ca-bundle", "reconcileID": "4f6fd8c8-1653-46ac-aeda-ecec8c404e33", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "knative-eventing"} 2026-07-15T03:58:17Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-node-tuning-operator"}, "namespace": "openshift-cluster-node-tuning-operator", "name": "openshift-service-ca.crt", "reconcileID": "d97d6542-d3f5-44e1-9c40-f0082628f0d4", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-node-tuning-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:17Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-node-tuning-operator"}, "namespace": "openshift-cluster-node-tuning-operator", "name": "openshift-service-ca.crt", "reconcileID": "d97d6542-d3f5-44e1-9c40-f0082628f0d4", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-node-tuning-operator"} 2026-07-15T03:58:17Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift"}, "namespace": "openshift", "name": "openshift-service-ca.crt", "reconcileID": "a005004a-15ec-48b8-bba8-43e4d0de691a", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:17Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift"}, "namespace": "openshift", "name": "openshift-service-ca.crt", "reconcileID": "a005004a-15ec-48b8-bba8-43e4d0de691a", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift"} 2026-07-15T03:58:17Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-console-user-settings"}, "namespace": "openshift-console-user-settings", "name": "openshift-service-ca.crt", "reconcileID": "96a60753-a531-4cff-b942-e950ae7fda72", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-console-user-settings", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:17Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-console-user-settings"}, "namespace": "openshift-console-user-settings", "name": "openshift-service-ca.crt", "reconcileID": "96a60753-a531-4cff-b942-e950ae7fda72", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-console-user-settings"} 2026-07-15T03:58:17Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"opendatahub"}, "namespace": "opendatahub", "name": "odh-trusted-ca-bundle", "reconcileID": "07e5289e-55d8-4089-9e53-df2c4044ff17", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "opendatahub", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:17Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"opendatahub"}, "namespace": "opendatahub", "name": "odh-trusted-ca-bundle", "reconcileID": "07e5289e-55d8-4089-9e53-df2c4044ff17", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "opendatahub"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"redhat-ods-monitoring"}, "namespace": "redhat-ods-monitoring", "name": "openshift-service-ca.crt", "reconcileID": "5bc1f426-6ccb-47be-b19a-efa722e8f256", "ConfigMap": "openshift-service-ca.crt", "namespace": "redhat-ods-monitoring"} 2026-07-15T03:58:17Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-machine-approver"}, "namespace": "openshift-cluster-machine-approver", "name": "openshift-service-ca.crt", "reconcileID": "7b128b7c-d2a8-48c7-ab5d-97d8ba5c24e4", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-machine-approver", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:17Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-machine-approver"}, "namespace": "openshift-cluster-machine-approver", "name": "openshift-service-ca.crt", "reconcileID": "7b128b7c-d2a8-48c7-ab5d-97d8ba5c24e4", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-machine-approver"} 2026-07-15T03:58:17Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-marketplace"}, "namespace": "openshift-marketplace", "name": "openshift-service-ca.crt", "reconcileID": "c0483258-d432-4daf-a122-12768c2f79c6", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-marketplace", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:17Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-marketplace"}, "namespace": "openshift-marketplace", "name": "openshift-service-ca.crt", "reconcileID": "c0483258-d432-4daf-a122-12768c2f79c6", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-marketplace"} 2026-07-15T03:58:17Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-multus"}, "namespace": "openshift-multus", "name": "openshift-service-ca.crt", "reconcileID": "b6fd09cb-f374-4266-881b-45e407ba091a", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-multus", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:17Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-multus"}, "namespace": "openshift-multus", "name": "openshift-service-ca.crt", "reconcileID": "b6fd09cb-f374-4266-881b-45e407ba091a", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-multus"} 2026-07-15T03:58:17Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-authentication"}, "namespace": "openshift-authentication", "name": "openshift-service-ca.crt", "reconcileID": "e8cd8b6e-0ae3-4dab-87f3-8f4c3173ba70", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-authentication", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:17Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-authentication"}, "namespace": "openshift-authentication", "name": "openshift-service-ca.crt", "reconcileID": "e8cd8b6e-0ae3-4dab-87f3-8f4c3173ba70", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-authentication"} 2026-07-15T03:58:17Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-controller-manager"}, "namespace": "openshift-controller-manager", "name": "openshift-service-ca.crt", "reconcileID": "b15a20a0-f113-4c95-9aac-0935ef3227d7", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-controller-manager", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:17Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-controller-manager"}, "namespace": "openshift-controller-manager", "name": "openshift-service-ca.crt", "reconcileID": "b15a20a0-f113-4c95-9aac-0935ef3227d7", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-controller-manager"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"redhat-ods-operator"}, "namespace": "redhat-ods-operator", "name": "openshift-service-ca.crt", "reconcileID": "08e8c421-ce42-4924-aa7f-176131ade5c2", "ConfigMap": "openshift-service-ca.crt", "namespace": "redhat-ods-operator"} 2026-07-15T03:58:17Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-dns-operator"}, "namespace": "openshift-dns-operator", "name": "openshift-service-ca.crt", "reconcileID": "77b6766c-0784-4a20-bb4b-03998cb635d8", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-dns-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T03:58:17Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-dns-operator"}, "namespace": "openshift-dns-operator", "name": "openshift-service-ca.crt", "reconcileID": "77b6766c-0784-4a20-bb4b-03998cb635d8", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-dns-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cert-manager-operator"}, "namespace": "cert-manager-operator", "name": "odh-trusted-ca-bundle", "reconcileID": "9081a253-ce1e-417c-822e-e5242d937e17", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cert-manager-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"opendatahub"}, "namespace": "opendatahub", "name": "openshift-service-ca.crt", "reconcileID": "ed8994da-5a7c-4364-b727-f02fb015c3a1", "ConfigMap": "openshift-service-ca.crt", "namespace": "opendatahub"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-network-operator"}, "namespace": "openshift-network-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "0f6bf1aa-d9eb-4d4c-b78e-ed143d85e9a6", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-network-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"redhat-ods-applications"}, "namespace": "redhat-ods-applications", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b1a82f2a-e0a5-4d11-970c-12a67dfa7266", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "redhat-ods-applications"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"kube-public"}, "namespace": "kube-public", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "4f18f248-cf88-44eb-a260-776a80006650", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "kube-public"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-kube-apiserver-operator"}, "namespace": "openshift-kube-apiserver-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "962347b8-1189-4b32-ae6a-1c36d6fd260a", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-kube-apiserver-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-network-node-identity"}, "namespace": "openshift-network-node-identity", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "7afe1edf-8c54-4551-a04a-9e68a08cc403", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-network-node-identity"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "efee598d-b8a3-4ec7-b113-dc07288ea262", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "rhoai-model-registries"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"knative-serving"}, "namespace": "knative-serving", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "39b8bdde-0ec5-4026-8d70-d70e436624e9", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "knative-serving"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-user-workload-monitoring"}, "namespace": "openshift-user-workload-monitoring", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "e18c3321-cb86-4bd9-88f8-e523202548de", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-user-workload-monitoring"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"odh-model-registries"}, "namespace": "odh-model-registries", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "e52ef7e3-60ef-41da-a4a5-85d6b6d472b2", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "odh-model-registries"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"redhat-ods-operator"}, "namespace": "redhat-ods-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b478b042-56d1-45a7-b6e5-d277cf34a487", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "redhat-ods-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"open-cluster-management-3c9a9014-bde8-4e38-b746-7a1dd8b61"}, "namespace": "open-cluster-management-3c9a9014-bde8-4e38-b746-7a1dd8b61", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "7ef8f6b0-c369-40f0-a7f1-eb757f5a50f4", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "open-cluster-management-3c9a9014-bde8-4e38-b746-7a1dd8b61"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-infra"}, "namespace": "openshift-infra", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "d5190c59-a05e-4a12-b4d8-4424df7a95b3", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-infra"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"kyverno"}, "namespace": "kyverno", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "37ce82c8-c8ba-4e0f-836e-7e2a633af16f", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "kyverno"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-image-registry"}, "namespace": "openshift-image-registry", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "7219d12c-938c-4928-90c3-14163f25290d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-image-registry"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "8066c232-4f57-4e8c-883e-2fdf45f4de54", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-ingress"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-config-operator"}, "namespace": "openshift-config-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "60879c31-69da-4124-b645-fcf23f1c3783", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-config-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-apiserver"}, "namespace": "openshift-apiserver", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "5fcc2ec7-d89b-4bd6-b640-fd75d1f247c9", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-apiserver"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-network-diagnostics"}, "namespace": "openshift-network-diagnostics", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a631fbc3-a0f6-4303-b328-95a9edc854c9", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-network-diagnostics"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-operator-lifecycle-manager"}, "namespace": "openshift-operator-lifecycle-manager", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "4e637f6a-181e-4e01-87f9-53590525aa35", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-operator-lifecycle-manager"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"knative-eventing"}, "namespace": "knative-eventing", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "8f64b074-34a0-49d2-9421-6af54727bd09", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "knative-eventing"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-cluster-version"}, "namespace": "openshift-cluster-version", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "456d66a4-1a64-4833-8962-aa71ddb5e6fe", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-cluster-version"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-machine-config-operator"}, "namespace": "openshift-machine-config-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "2627bf04-4009-437a-b6fe-6bbdd1d62185", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-machine-config-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-monitoring"}, "namespace": "openshift-monitoring", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b926f01a-bbb6-4804-8246-231dc096c74a", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-monitoring"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"knative-serving-ingress"}, "namespace": "knative-serving-ingress", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "f50b91af-f213-47e0-96a9-f6ad4232257d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "knative-serving-ingress"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-service-ca"}, "namespace": "openshift-service-ca", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "fd3bb10d-2ada-4f6f-9699-059cfe7fcc34", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-service-ca"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"open-cluster-management-agent-addon"}, "namespace": "open-cluster-management-agent-addon", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "bfe56de8-bef8-4046-bdeb-15d654b9c233", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "open-cluster-management-agent-addon"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-apiserver-operator"}, "namespace": "openshift-apiserver-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "ddcef2bc-8d70-4393-aa59-8f6746dddcf0", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-apiserver-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-kube-scheduler"}, "namespace": "openshift-kube-scheduler", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "2bd4cbbb-4946-448b-bb09-ef16852a4d89", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-kube-scheduler"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-node"}, "namespace": "openshift-node", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "ef76238a-39fc-4e50-852c-03c0d2714985", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-node"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-cloud-credential-operator"}, "namespace": "openshift-cloud-credential-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "fd11a43d-b5de-406d-bf8b-85e40c3808e4", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-cloud-credential-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-cluster-storage-operator"}, "namespace": "openshift-cluster-storage-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "6f358ef9-d5c2-40e1-a0d4-0b447eea28ad", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-cluster-storage-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-ingress-operator"}, "namespace": "openshift-ingress-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "23c7908c-91e9-42ac-8bc6-6f3988133817", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-ingress-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-kube-controller-manager-operator"}, "namespace": "openshift-kube-controller-manager-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "01e785ac-9a62-421b-9e0d-ee3494c0c8e0", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-kube-controller-manager-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-console-operator"}, "namespace": "openshift-console-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b39973d5-6b7b-4f05-8260-61724135c6c0", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-console-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"redhat-ods-monitoring"}, "namespace": "redhat-ods-monitoring", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "30a51338-1164-490d-ab4e-9a7535b83846", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "redhat-ods-monitoring"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cert-manager"}, "namespace": "cert-manager", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "5e2de205-7779-42a6-8b5a-dfffd8cbb1e6", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cert-manager"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-jobset-operator"}, "namespace": "openshift-jobset-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "947596d8-62e0-4cba-8568-8be4a299701c", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-jobset-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-kube-scheduler-operator"}, "namespace": "openshift-kube-scheduler-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "10d1a269-4594-4704-ab53-4dce417b346c", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-kube-scheduler-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-service-ca-operator"}, "namespace": "openshift-service-ca-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "f9a080b8-201a-41be-bbd2-1bed0836bf50", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-service-ca-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-authentication-operator"}, "namespace": "openshift-authentication-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b213155a-143b-420e-bb5c-ee3de44d3af2", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-authentication-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-kube-apiserver"}, "namespace": "openshift-kube-apiserver", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "15681615-2bd3-4b91-afd1-0a0c3840ac55", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-kube-apiserver"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "f0dcb290-fa22-4718-aad5-fe0461e73f85", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "rhods-notebooks"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-keda"}, "namespace": "openshift-keda", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "ce0de1a0-a29a-4460-9ec7-6fb95b682fdf", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-keda"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"kube-node-lease"}, "namespace": "kube-node-lease", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "2bb115c5-dcd1-4579-9869-ab720f799296", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "kube-node-lease"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-console"}, "namespace": "openshift-console", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "5d266f89-f57e-473d-a005-a0a847f93dda", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-console"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-kube-storage-version-migrator-operator"}, "namespace": "openshift-kube-storage-version-migrator-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "c934ff2b-d2c5-4182-823b-b520bafab121", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-kube-storage-version-migrator-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"default"}, "namespace": "default", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a141268a-73cf-4df6-93d5-e4b3f63677ee", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "default"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-cloud-network-config-controller"}, "namespace": "openshift-cloud-network-config-controller", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "90017405-f46f-49b0-9996-faf9f993827f", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-cloud-network-config-controller"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-machine-api"}, "namespace": "openshift-machine-api", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "40d14c82-ae72-462c-a54d-bbea4715c32a", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-machine-api"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"kube-system"}, "namespace": "kube-system", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "869b5171-4b13-4440-ad2e-3faf946a73c6", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "kube-system"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-kube-storage-version-migrator"}, "namespace": "openshift-kube-storage-version-migrator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "40dc80df-c00c-435f-9081-8436862506b9", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-kube-storage-version-migrator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cert-manager-operator"}, "namespace": "cert-manager-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "3e991ac3-c31a-4d7e-9b8b-afdcb0e4172e", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cert-manager-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-cluster-csi-drivers"}, "namespace": "openshift-cluster-csi-drivers", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "0b7cc73c-f347-4047-87d9-543359c468c1", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-cluster-csi-drivers"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-ovn-kubernetes"}, "namespace": "openshift-ovn-kubernetes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b3a7b2a0-9bd9-4239-b35b-f8739cbf2ea4", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-ovn-kubernetes"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-dns"}, "namespace": "openshift-dns", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "3da07bfb-909d-4f76-9eb0-b82f03fa4d27", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-dns"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"kuadrant-system"}, "namespace": "kuadrant-system", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "5dfcebab-f0a3-4bac-95b9-420cec728cbb", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "kuadrant-system"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-controller-manager-operator"}, "namespace": "openshift-controller-manager-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "8c88dc4e-6a70-45b1-8ba6-29fecc49bf3c", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-controller-manager-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-etcd"}, "namespace": "openshift-etcd", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a3f30d94-5e16-4cdb-b639-0e15bc90c522", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-etcd"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-cluster-samples-operator"}, "namespace": "openshift-cluster-samples-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "e6066f7d-30e2-49a1-9f0a-ab6de193f2c9", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-cluster-samples-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-config-managed"}, "namespace": "openshift-config-managed", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "cef81b9a-f398-4523-93b2-5d026f2f96d2", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-config-managed"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-insights"}, "namespace": "openshift-insights", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "2341cf55-15fc-4313-8aca-159d9d487a36", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-insights"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-ingress-canary"}, "namespace": "openshift-ingress-canary", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "d855f2db-fc47-4532-8e64-58ee1f47498d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-ingress-canary"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-cloud-controller-manager"}, "namespace": "openshift-cloud-controller-manager", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "2ea84ce0-d6b9-4e2e-867d-b851cb899ba3", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-cloud-controller-manager"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-config"}, "namespace": "openshift-config", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "dd606bf5-3fb5-46f1-88b2-0e5df72248f7", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-config"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-operators"}, "namespace": "openshift-operators", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "5b4041a1-5e09-4e2f-a1a6-8def7286ed88", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-operators"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-route-controller-manager"}, "namespace": "openshift-route-controller-manager", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "f02b32f3-5e57-4ffb-96a7-ab3a585d06ad", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-route-controller-manager"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-network-console"}, "namespace": "openshift-network-console", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "dbf01446-c3e5-4ca2-a1e5-74f0c94df628", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-network-console"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-lws-operator"}, "namespace": "openshift-lws-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "36f2eb3e-0292-4c2f-8740-368bb56a8f38", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-lws-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-kueue-operator"}, "namespace": "openshift-kueue-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "42c54bbd-5efd-4d73-9cc9-51c0ed0d0e9d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-kueue-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-host-network"}, "namespace": "openshift-host-network", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "30611214-6d6f-4cc8-ab89-2b61956338f5", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-host-network"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-kube-controller-manager"}, "namespace": "openshift-kube-controller-manager", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "c6b060cd-32a2-40f2-b30c-9e37f300b22e", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-kube-controller-manager"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-cluster-node-tuning-operator"}, "namespace": "openshift-cluster-node-tuning-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b714f98f-c576-48da-9e1a-e20292c2ae3b", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-cluster-node-tuning-operator"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift"}, "namespace": "openshift", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "760ac8d0-2bca-4a79-b1b3-98eafe5d841b", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-console-user-settings"}, "namespace": "openshift-console-user-settings", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "d0672b9f-ced2-4e53-95a9-b16473524d18", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-console-user-settings"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"opendatahub"}, "namespace": "opendatahub", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a96b56fa-92cc-4359-a2e8-e3e47b547a36", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "opendatahub"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-cluster-machine-approver"}, "namespace": "openshift-cluster-machine-approver", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "44afe1fa-91a8-4ed6-a50e-95e600a7ce7a", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-cluster-machine-approver"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-marketplace"}, "namespace": "openshift-marketplace", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "14cd9d19-3a58-4b62-93fc-6e901eb0f14b", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-marketplace"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-multus"}, "namespace": "openshift-multus", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "f0e89175-cc8b-4db8-893b-7a759c5576ee", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-multus"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-authentication"}, "namespace": "openshift-authentication", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "f21d15c0-2c10-4651-81a0-38e46e24fb02", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-authentication"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-controller-manager"}, "namespace": "openshift-controller-manager", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "c58fe828-c4e2-410d-a6d2-875fc09e2970", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-controller-manager"} 2026-07-15T03:58:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-dns-operator"}, "namespace": "openshift-dns-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "77ac0021-4a4c-4418-bb38-3dd39389663a", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-dns-operator"} 2026-07-15T03:58:20Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "redhat-ods-applications", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Update /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:94 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnUpdate /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:125 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnUpdate /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:266 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1065 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:20Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "redhat-ods-applications", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Update /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:95 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnUpdate /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:125 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnUpdate /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:266 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1065 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:22Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "ServingRuntime.serving.kserve.io", "error": "no matches for kind \"ServingRuntime\" in version \"serving.kserve.io/v1alpha1\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:22Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "ServingRuntime.serving.kserve.io", "error": "no matches for kind \"ServingRuntime\" in version \"serving.kserve.io/v1alpha1\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:22Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "ServingRuntime.serving.kserve.io", "error": "no matches for kind \"ServingRuntime\" in version \"serving.kserve.io/v1alpha1\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:22Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "InferenceService.serving.kserve.io", "error": "no matches for kind \"InferenceService\" in version \"serving.kserve.io/v1beta1\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:22Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "LLMInferenceService.serving.kserve.io", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:22Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "LLMInferenceService.serving.kserve.io", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:22Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "LLMInferenceServiceConfig.serving.kserve.io", "error": "no matches for kind \"LLMInferenceServiceConfig\" in version \"serving.kserve.io/v1alpha2\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:32Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "InferenceService.serving.kserve.io", "error": "no matches for kind \"InferenceService\" in version \"serving.kserve.io/v1beta1\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:32Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "ServingRuntime.serving.kserve.io", "error": "no matches for kind \"ServingRuntime\" in version \"serving.kserve.io/v1alpha1\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:32Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "ServingRuntime.serving.kserve.io", "error": "no matches for kind \"ServingRuntime\" in version \"serving.kserve.io/v1alpha1\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:32Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "ServingRuntime.serving.kserve.io", "error": "no matches for kind \"ServingRuntime\" in version \"serving.kserve.io/v1alpha1\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:32Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "LLMInferenceServiceConfig.serving.kserve.io", "error": "no matches for kind \"LLMInferenceServiceConfig\" in version \"serving.kserve.io/v1alpha2\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:32Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "LLMInferenceService.serving.kserve.io", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:32Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "LLMInferenceService.serving.kserve.io", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-15T03:58:41Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "redhat-ods-applications", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Update /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:94 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnUpdate /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:125 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnUpdate /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:266 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1065 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:41Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "redhat-ods-applications", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:572 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Update /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:95 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnUpdate /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:125 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnUpdate /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:266 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1065 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-15T03:58:43Z INFO Starting workers {"controller": "servingruntime", "controllerGroup": "serving.kserve.io", "controllerKind": "ServingRuntime", "worker count": 1} 2026-07-15T03:58:43Z INFO No monitoring namespace detected, skipping monitoring reconciliation. {"ResourceName": "openshift-monitoring", "Namespace": "openshift-monitoring"} 2026-07-15T03:58:43Z INFO Multi Node reconciling. {"ResourceName": "openshift-monitoring", "Namespace": "openshift-monitoring"} 2026-07-15T03:58:43Z INFO Starting workers {"controller": "llminferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "LLMInferenceService", "worker count": 1} 2026-07-15T03:58:43Z INFO Starting workers {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "worker count": 1} 2026-07-15T03:58:43Z INFO Starting workers {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "worker count": 1} 2026-07-15T03:58:45Z ERROR fail to get ray ca cert secret {"ResourceName": "openshift-monitoring", "Namespace": "openshift-monitoring", "secret": "ray-ca-tls", "namespace": "redhat-ods-applications", "error": "Secret \"ray-ca-tls\" not found"} github.com/opendatahub-io/odh-model-controller/internal/controller/serving.(*ServingRuntimeReconciler).reconcileMultiNodeSR /workspace/internal/controller/serving/servingruntime_controller.go:289 github.com/opendatahub-io/odh-model-controller/internal/controller/serving.(*ServingRuntimeReconciler).Reconcile /workspace/internal/controller/serving/servingruntime_controller.go:270 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:116 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:303 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T03:58:45Z ERROR Reconciler error {"controller": "servingruntime", "controllerGroup": "serving.kserve.io", "controllerKind": "ServingRuntime", "ServingRuntime": {"name":"openshift-monitoring","namespace":"openshift-monitoring"}, "namespace": "openshift-monitoring", "name": "openshift-monitoring", "reconcileID": "e70e277e-cb40-4703-8f99-18bbd1361bf5", "error": "Secret \"ray-ca-tls\" not found"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T03:58:45Z INFO No monitoring namespace detected, skipping monitoring reconciliation. {"ResourceName": "ray-ca-tls", "Namespace": "redhat-ods-applications"} 2026-07-15T03:58:45Z INFO Multi Node reconciling. {"ResourceName": "ray-ca-tls", "Namespace": "redhat-ods-applications"} 2026-07-15T03:58:48Z INFO ray ca tls secret modified so ray tls cert need to be updated to sync ca.crt {"ResourceName": "ray-ca-tls", "Namespace": "redhat-ods-applications"} 2026-07-15T03:58:48Z INFO Multi Node reconciled successfully. {"ResourceName": "ray-ca-tls", "Namespace": "redhat-ods-applications"} 2026-07-15T03:58:48Z INFO No monitoring namespace detected, skipping monitoring reconciliation. {"ResourceName": "openshift-monitoring", "Namespace": "openshift-monitoring"} 2026-07-15T03:58:48Z INFO Multi Node reconciling. {"ResourceName": "openshift-monitoring", "Namespace": "openshift-monitoring"} 2026-07-15T03:58:49Z INFO Multi Node reconciled successfully. {"ResourceName": "openshift-monitoring", "Namespace": "openshift-monitoring"} 2026-07-15T04:13:21Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openldap"}, "namespace": "openldap", "name": "openshift-service-ca.crt", "reconcileID": "cf4abbb1-c9c3-41ff-b8fd-f5507334df7d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openldap"} 2026-07-15T04:13:21Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"openldap"}, "namespace": "openldap", "name": "odh-trusted-ca-bundle", "reconcileID": "a2f96d96-e0ea-4218-8441-90fde67fc8c8", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "openldap"} 2026-07-15T04:13:21Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openldap"}, "namespace": "openldap", "name": "openshift-service-ca.crt", "reconcileID": "9071efb6-59c7-42df-83cb-18bed58caad3", "ConfigMap": "openshift-service-ca.crt", "namespace": "openldap", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:13:21Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openldap"}, "namespace": "openldap", "name": "openshift-service-ca.crt", "reconcileID": "9071efb6-59c7-42df-83cb-18bed58caad3", "ConfigMap": "openshift-service-ca.crt", "namespace": "openldap"} 2026-07-15T04:13:21Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openldap"}, "namespace": "openldap", "name": "openshift-service-ca.crt", "reconcileID": "63c979e9-34da-415c-83a1-ed95a25aed3c", "ConfigMap": "openshift-service-ca.crt", "namespace": "openldap"} 2026-07-15T04:13:21Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openldap"}, "namespace": "openldap", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "5b3c1b1e-fa56-4bb0-a0d1-760866fc04e3", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openldap"} 2026-07-15T04:13:21Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"openldap"}, "namespace": "openldap", "name": "odh-trusted-ca-bundle", "reconcileID": "2948ca43-e648-403c-af16-fb6883d64046", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "openldap", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:13:21Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"openldap"}, "namespace": "openldap", "name": "odh-trusted-ca-bundle", "reconcileID": "2948ca43-e648-403c-af16-fb6883d64046", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "openldap"} 2026-07-15T04:13:21Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openldap"}, "namespace": "openldap", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "c8caefb6-7d02-469f-89a9-86069d022b27", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openldap"} 2026-07-15T04:19:03Z INFO No monitoring namespace detected, skipping monitoring reconciliation. {"ResourceName": "ray-ca-tls", "Namespace": "redhat-ods-applications"} 2026-07-15T04:19:03Z INFO Multi Node reconciling. {"ResourceName": "ray-ca-tls", "Namespace": "redhat-ods-applications"} 2026-07-15T04:19:04Z INFO ray ca tls secret modified so ray tls cert need to be updated to sync ca.crt {"ResourceName": "ray-ca-tls", "Namespace": "redhat-ods-applications"} 2026-07-15T04:19:04Z INFO Multi Node reconciled successfully. {"ResourceName": "ray-ca-tls", "Namespace": "redhat-ods-applications"} 2026-07-15T04:24:48Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "4b6eb928-dae3-47ed-9671-cb8585841801", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:24:48Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "812f4c1e-3899-4c3d-9e36-3f557596c05a", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:24:48Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "f2dc8a47-49c1-4091-be22-8b125af93fdf", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:24:48Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "f2dc8a47-49c1-4091-be22-8b125af93fdf", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:24:48Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "c56c5b24-5051-41a6-8b41-35ac9e7bd0fc", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:24:48Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "6de3a27b-e6ec-4ed2-a719-0787640c2996", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:24:48Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "2f842c74-9367-4d51-81c5-eace4424521c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:24:48Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "2f842c74-9367-4d51-81c5-eace4424521c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:24:48Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "38812b7c-d9a2-4e57-9f11-3e10d56bd8b5", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:24:59Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "48ba24c8-8057-49b0-bbcc-10232bb19d5d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:24:59Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "48ba24c8-8057-49b0-bbcc-10232bb19d5d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:24:59Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "48ba24c8-8057-49b0-bbcc-10232bb19d5d", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace cypress-user-perm-test-526006 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:24:59Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "ddd30d94-4e57-4471-b54b-ccb35ebb7dea", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:24:59Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "ddd30d94-4e57-4471-b54b-ccb35ebb7dea", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:24:59Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "a7aaffcf-d79e-435f-a3ec-6439e0aa0ae9", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:24:59Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "a7aaffcf-d79e-435f-a3ec-6439e0aa0ae9", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:24:59Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "8f984493-0d26-4e94-8bf7-c3be730d6617", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:24:59Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "8f984493-0d26-4e94-8bf7-c3be730d6617", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:01Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "9e915802-964f-4734-8625-b8c17573f4d0", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:01Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "2c92cc26-109b-4bc6-bf61-9b5b6c63305c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:01Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "84353341-7843-426a-9278-51dcf95000c1", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:25:01Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "84353341-7843-426a-9278-51dcf95000c1", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:01Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "2bed3643-423d-417e-a7a3-40b3866d66b2", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:01Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "fb4e344e-6943-417d-bd9f-ecc3e8f8a6d3", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:01Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "eaa6080b-e741-42e5-97fc-39f81c4f5814", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:25:01Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "eaa6080b-e741-42e5-97fc-39f81c4f5814", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:01Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "624394b8-71ec-4e3e-b270-3f34a98d458e", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:08Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "openshift-service-ca.crt", "reconcileID": "4f2a3ba4-9c35-4640-905b-50dd9b76745f", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:08Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-trusted-ca-bundle", "reconcileID": "c38ad309-2696-4c33-a842-4995facb1cc1", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:08Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "openshift-service-ca.crt", "reconcileID": "f9e7e80d-4839-43ff-a881-d1dd3b4bdf75", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-edit-test-project-609558", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:25:08Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "openshift-service-ca.crt", "reconcileID": "f9e7e80d-4839-43ff-a881-d1dd3b4bdf75", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:08Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "74e16b15-d024-4da3-89b4-caf37336cde3", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:08Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "openshift-service-ca.crt", "reconcileID": "8e16e2fe-33f8-4793-9c8b-4af42f415b19", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:08Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-trusted-ca-bundle", "reconcileID": "617c2f1f-d448-46b9-8cc7-e678e19468ea", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-edit-test-project-609558", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:25:08Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-trusted-ca-bundle", "reconcileID": "617c2f1f-d448-46b9-8cc7-e678e19468ea", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:08Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a4dc65cf-b778-4d9a-91ba-8c3b0cd42982", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:17Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "9f7aa6a7-65f1-408e-bd45-997df01f5740", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:17Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "9f7aa6a7-65f1-408e-bd45-997df01f5740", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-edit-test-project-609558", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:25:17Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "9f7aa6a7-65f1-408e-bd45-997df01f5740", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace cypress-edit-test-project-609558 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:25:17Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-trusted-ca-bundle", "reconcileID": "d59272b1-2ed0-4a7f-bb5b-c8661ff98949", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-trusted-ca-bundle", "reconcileID": "d59272b1-2ed0-4a7f-bb5b-c8661ff98949", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:17Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "openshift-service-ca.crt", "reconcileID": "1b847ae1-935e-414b-8fd0-e065ac69bca0", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "openshift-service-ca.crt", "reconcileID": "1b847ae1-935e-414b-8fd0-e065ac69bca0", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:17Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "cf015699-fe02-4c9f-8ea5-2ff9d0075e52", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:17Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "cf015699-fe02-4c9f-8ea5-2ff9d0075e52", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:19Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "openshift-service-ca.crt", "reconcileID": "645b673d-b69a-489d-85a0-c7a5a28fc9b7", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:19Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-trusted-ca-bundle", "reconcileID": "64fd1569-5c8c-460e-85bc-0a8f8ac8007d", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:19Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "openshift-service-ca.crt", "reconcileID": "1e7e124a-8b1d-4eb2-b673-76e7ab44227a", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-edit-test-project-609558", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:25:19Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "openshift-service-ca.crt", "reconcileID": "1e7e124a-8b1d-4eb2-b673-76e7ab44227a", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:19Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "04e23ce8-2bab-4534-83c0-a5802d60b05c", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:19Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "openshift-service-ca.crt", "reconcileID": "219d60b8-a141-449e-9e41-0cd8bbd8d044", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:19Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-trusted-ca-bundle", "reconcileID": "4b9ee828-bff4-4cd7-b94a-3d6287d967a2", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-edit-test-project-609558", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:25:19Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-trusted-ca-bundle", "reconcileID": "4b9ee828-bff4-4cd7-b94a-3d6287d967a2", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:19Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "c23c8f19-e7ba-4d1d-b5ce-d0ac4e166880", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:20Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "56a61a69-abdf-4e67-a8a1-3ee7f23afa2e", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:20Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "56a61a69-abdf-4e67-a8a1-3ee7f23afa2e", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:25:20Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "56a61a69-abdf-4e67-a8a1-3ee7f23afa2e", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace cypress-user-perm-test-526006 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:25:20Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "489d9379-94bf-486c-ae86-bcb2a78b390a", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:20Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "489d9379-94bf-486c-ae86-bcb2a78b390a", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:20Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "067f1d56-d9bb-48bf-9e15-0b8b8354917b", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:20Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "067f1d56-d9bb-48bf-9e15-0b8b8354917b", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:20Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "e3b3e524-ae74-4ec8-859e-3385092823b5", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:20Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "e3b3e524-ae74-4ec8-859e-3385092823b5", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:22Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "0b1d46a3-bde3-4b36-b265-93fab49cf84f", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:22Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "58b1bbda-500e-4ce5-b556-d8fee33b3f60", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:22Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "3aeaf287-b932-4c3e-b077-d743ded24d38", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:25:22Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "3aeaf287-b932-4c3e-b077-d743ded24d38", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:22Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "c104fb2a-1601-4ea8-b861-d062db90c70d", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:22Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "119c9dcd-cb0c-4088-a9be-888c422d2b93", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:22Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "0755503d-0cbb-43a5-b6bd-719df4faf206", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:25:22Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "0755503d-0cbb-43a5-b6bd-719df4faf206", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:22Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "2b8e7a45-c758-47f8-b808-3c8c60969e22", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:37Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "3e858262-5ed1-47b0-b532-73fdca692857", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:37Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "3e858262-5ed1-47b0-b532-73fdca692857", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-edit-test-project-609558", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:25:37Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "3e858262-5ed1-47b0-b532-73fdca692857", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace cypress-edit-test-project-609558 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:25:37Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-trusted-ca-bundle", "reconcileID": "d09bc39c-a4dc-466e-810c-e7ff81f1a465", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:37Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-trusted-ca-bundle", "reconcileID": "d09bc39c-a4dc-466e-810c-e7ff81f1a465", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:37Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "openshift-service-ca.crt", "reconcileID": "9ae81e94-ba4a-4414-84fc-fb3806bf24d2", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:37Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "openshift-service-ca.crt", "reconcileID": "9ae81e94-ba4a-4414-84fc-fb3806bf24d2", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:37Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "f8af4851-4422-47a2-8ca3-cdb85e8088c2", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:37Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "f8af4851-4422-47a2-8ca3-cdb85e8088c2", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:39Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "openshift-service-ca.crt", "reconcileID": "1d2c37dd-6e15-4864-8873-03f48bcdcfcf", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:39Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-trusted-ca-bundle", "reconcileID": "e046ad4b-1c29-4062-9233-aab2c3137c70", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:39Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "openshift-service-ca.crt", "reconcileID": "5f5ee24a-0226-4b01-88e8-7d18c3ce5f04", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-edit-test-project-609558", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:25:39Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "openshift-service-ca.crt", "reconcileID": "5f5ee24a-0226-4b01-88e8-7d18c3ce5f04", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:39Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "5f32abf4-c435-41a2-b7ce-74580d35e370", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:39Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "openshift-service-ca.crt", "reconcileID": "da2204c3-e829-433f-9a19-979a1c321d10", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:39Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-trusted-ca-bundle", "reconcileID": "4a8e0c98-637d-4e5d-a6ea-c3bc9073b40c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-edit-test-project-609558", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:25:39Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-trusted-ca-bundle", "reconcileID": "4a8e0c98-637d-4e5d-a6ea-c3bc9073b40c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:39Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b9ce939e-2acd-41a1-b474-fc61e4dabd67", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:49Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "4d05b81d-f308-490d-b6db-262e2845a71e", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:49Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "4d05b81d-f308-490d-b6db-262e2845a71e", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:25:49Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "4d05b81d-f308-490d-b6db-262e2845a71e", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace cypress-user-perm-test-526006 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:25:49Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "277bf621-4aa3-45d1-bb62-93432762f78a", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:49Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "277bf621-4aa3-45d1-bb62-93432762f78a", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:49Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "b9b77556-a2af-4261-a7c7-5fccf16100fe", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:49Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "b9b77556-a2af-4261-a7c7-5fccf16100fe", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:49Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "0674a352-66fc-4304-9797-44f84bb1bfa6", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:49Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "0674a352-66fc-4304-9797-44f84bb1bfa6", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:51Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "ebe3f382-7d4d-4bf3-8134-1408a8a2b8ed", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:51Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "0a0f5735-0cd7-4965-9ed1-dee1068a9e04", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "763cb3fc-d859-4057-ac9c-36b5f160f890", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:25:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "763cb3fc-d859-4057-ac9c-36b5f160f890", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "96f09281-b827-4b2e-b690-8c4960775a46", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:25:51Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "96f09281-b827-4b2e-b690-8c4960775a46", "error": "configmaps \"odh-kserve-custom-ca-bundle\" already exists"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:25:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "00891387-efdb-4481-8e0a-45d732073699", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:25:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "00891387-efdb-4481-8e0a-45d732073699", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:51Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "d6dccaa6-fc26-4fbc-90b0-d67ccf44cb24", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:51Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "92e5a002-dea8-47ed-8242-19451c6d50be", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:51Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "47478339-3256-4e22-a92d-6304ce92308c", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:25:55Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "77753a0c-fead-42cb-83b2-c56fcdfdbf73", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:55Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "77753a0c-fead-42cb-83b2-c56fcdfdbf73", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-edit-test-project-609558", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:25:55Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "77753a0c-fead-42cb-83b2-c56fcdfdbf73", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace cypress-edit-test-project-609558 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:25:55Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-trusted-ca-bundle", "reconcileID": "20b805ef-5ad7-4f25-b0e4-b8eaf19ac6f5", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:55Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-trusted-ca-bundle", "reconcileID": "20b805ef-5ad7-4f25-b0e4-b8eaf19ac6f5", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:55Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "openshift-service-ca.crt", "reconcileID": "1e52ec30-ea76-451d-b97e-81158d9f003b", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:55Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "openshift-service-ca.crt", "reconcileID": "1e52ec30-ea76-451d-b97e-81158d9f003b", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:55Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "95daf2ea-9d3b-4bfe-9c10-48642699e957", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:55Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-edit-test-project-609558"}, "namespace": "cypress-edit-test-project-609558", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "95daf2ea-9d3b-4bfe-9c10-48642699e957", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-edit-test-project-609558"} 2026-07-15T04:25:56Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "openshift-service-ca.crt", "reconcileID": "44ac49f0-f0ea-4b93-b115-2cb9b4cd5380", "ConfigMap": "openshift-service-ca.crt", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:25:56Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-trusted-ca-bundle", "reconcileID": "a0b9f4b4-beca-49a0-af1e-2addf072f08a", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:25:56Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "openshift-service-ca.crt", "reconcileID": "9f2140f1-1911-4634-9c43-95f515b505f8", "ConfigMap": "openshift-service-ca.crt", "namespace": "qe-cluster-storage-sc-dsp", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:25:56Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "openshift-service-ca.crt", "reconcileID": "9f2140f1-1911-4634-9c43-95f515b505f8", "ConfigMap": "openshift-service-ca.crt", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:25:56Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "8fda7051-34e5-4432-aab1-34f027007e81", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:25:56Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "openshift-service-ca.crt", "reconcileID": "1229dbed-7086-4031-86e1-c804b4a727e2", "ConfigMap": "openshift-service-ca.crt", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:25:56Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-trusted-ca-bundle", "reconcileID": "1bc95e35-bc16-4a85-aa63-3d14d5a9f44b", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:25:56Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-trusted-ca-bundle", "reconcileID": "1bc95e35-bc16-4a85-aa63-3d14d5a9f44b", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:25:56Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "ad28d4cd-be5a-4ee9-b165-c0a0ccbe7b4c", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:06Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "4df8ffb3-7def-449f-af2c-bb96de3f08f9", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:06Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "4df8ffb3-7def-449f-af2c-bb96de3f08f9", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:26:06Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "4df8ffb3-7def-449f-af2c-bb96de3f08f9", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace qe-cluster-storage-sc-dsp because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:26:06Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-trusted-ca-bundle", "reconcileID": "9fed28a8-80ab-4054-a07e-0a418c8349bb", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:06Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-trusted-ca-bundle", "reconcileID": "9fed28a8-80ab-4054-a07e-0a418c8349bb", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:06Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "openshift-service-ca.crt", "reconcileID": "aa9df105-7c5f-41a6-8b3d-1591fd196427", "ConfigMap": "openshift-service-ca.crt", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:06Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "openshift-service-ca.crt", "reconcileID": "aa9df105-7c5f-41a6-8b3d-1591fd196427", "ConfigMap": "openshift-service-ca.crt", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:06Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "1600e8de-6021-4540-946d-877d439eef89", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:06Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "1600e8de-6021-4540-946d-877d439eef89", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:08Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "openshift-service-ca.crt", "reconcileID": "a257a6cb-cabe-49ec-a10d-b14d03cc541f", "ConfigMap": "openshift-service-ca.crt", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:08Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-trusted-ca-bundle", "reconcileID": "1e227111-db4c-422c-8ea6-86c81ce6e43b", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:08Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "openshift-service-ca.crt", "reconcileID": "d1a1d9ae-9c42-478f-beb6-b2cdb800effb", "ConfigMap": "openshift-service-ca.crt", "namespace": "qe-cluster-storage-sc-dsp", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:26:08Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "openshift-service-ca.crt", "reconcileID": "d1a1d9ae-9c42-478f-beb6-b2cdb800effb", "ConfigMap": "openshift-service-ca.crt", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:08Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "3ead5e0a-934e-414e-9222-536b35b41828", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:08Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "openshift-service-ca.crt", "reconcileID": "d6caac91-4077-4147-a4da-7c77b2f4e67f", "ConfigMap": "openshift-service-ca.crt", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:08Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-trusted-ca-bundle", "reconcileID": "aab3aa58-fa2b-49ad-9e76-3786527c2433", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:26:08Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-trusted-ca-bundle", "reconcileID": "aab3aa58-fa2b-49ad-9e76-3786527c2433", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:08Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "aec0431f-b6a3-427d-909b-b6630ebb7e66", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:20Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "95b00e30-3fec-4907-a8f3-50c6ba5c978c", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:20Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "95b00e30-3fec-4907-a8f3-50c6ba5c978c", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:26:20Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "95b00e30-3fec-4907-a8f3-50c6ba5c978c", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace cypress-user-perm-test-526006 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:26:20Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "573c7a43-6a7b-4af1-9e73-1ea68a5f6080", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:20Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "573c7a43-6a7b-4af1-9e73-1ea68a5f6080", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:20Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "a75f761c-963c-4269-a035-3be5bfb1fbbb", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:20Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "a75f761c-963c-4269-a035-3be5bfb1fbbb", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:20Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "0b85ff87-e53a-4c65-9766-2b1835d0c03d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:20Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "0b85ff87-e53a-4c65-9766-2b1835d0c03d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:21Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "556dcfbd-f038-4bd1-aee1-702897adafeb", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:21Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "0e6de4b0-3ed5-4a3e-a656-8b729d254d41", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:21Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "267b5510-ed97-48f3-9cdf-5fc0c63e164a", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:26:21Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "267b5510-ed97-48f3-9cdf-5fc0c63e164a", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:21Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "c7874eee-17d3-45f4-ae76-0ff0dc13d101", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:21Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "ee540d36-3f08-4931-bd01-d76e738e3765", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:21Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "3d4b8ec6-7743-4944-a706-18be8f108c7c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:26:21Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "3d4b8ec6-7743-4944-a706-18be8f108c7c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:21Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "5de97f8d-c938-4365-9b7c-252f88cfeec6", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:26Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "dec8be14-ecfb-493f-ab1a-443d5d876062", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:26Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "dec8be14-ecfb-493f-ab1a-443d5d876062", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:26:26Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "dec8be14-ecfb-493f-ab1a-443d5d876062", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace qe-cluster-storage-sc-dsp because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:26:26Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-trusted-ca-bundle", "reconcileID": "18cef2f1-0f1c-4355-9ac2-ba498bf4a330", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:26Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-trusted-ca-bundle", "reconcileID": "18cef2f1-0f1c-4355-9ac2-ba498bf4a330", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:26Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "openshift-service-ca.crt", "reconcileID": "316fbdfe-a6b6-49b8-b52c-bfbac1c0df15", "ConfigMap": "openshift-service-ca.crt", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:26Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "openshift-service-ca.crt", "reconcileID": "316fbdfe-a6b6-49b8-b52c-bfbac1c0df15", "ConfigMap": "openshift-service-ca.crt", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:26Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "398f3da7-7056-4860-946e-4d97a32a9c59", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:26Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "398f3da7-7056-4860-946e-4d97a32a9c59", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:27Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "openshift-service-ca.crt", "reconcileID": "303530eb-9e63-4001-9a54-744cd728f0b2", "ConfigMap": "openshift-service-ca.crt", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:27Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-trusted-ca-bundle", "reconcileID": "5619ed29-493c-42ad-b7de-556a8bf72f22", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:27Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "openshift-service-ca.crt", "reconcileID": "6ddb825d-75b1-4f47-8f50-0e2015e73ef8", "ConfigMap": "openshift-service-ca.crt", "namespace": "qe-cluster-storage-sc-dsp", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:26:27Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "openshift-service-ca.crt", "reconcileID": "6ddb825d-75b1-4f47-8f50-0e2015e73ef8", "ConfigMap": "openshift-service-ca.crt", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:27Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a9a16151-0c90-471b-8681-9e34c3774e8a", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:27Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "openshift-service-ca.crt", "reconcileID": "e037e335-06c3-4e89-9f10-05cd4f30b503", "ConfigMap": "openshift-service-ca.crt", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:28Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-trusted-ca-bundle", "reconcileID": "9700aa74-2a5b-4089-b1f1-d6b0a7f5759b", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:26:28Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-trusted-ca-bundle", "reconcileID": "9700aa74-2a5b-4089-b1f1-d6b0a7f5759b", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:28Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "894426ff-d429-454f-bc54-8bf3786fdbe4", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:38Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "88ff060c-3b81-4b1c-ada8-1344bfb95a80", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:38Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "88ff060c-3b81-4b1c-ada8-1344bfb95a80", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:26:38Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "88ff060c-3b81-4b1c-ada8-1344bfb95a80", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace cypress-user-perm-test-526006 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:26:38Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "18328ffb-c76e-47aa-b6f5-d101ae7a9e22", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:38Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-trusted-ca-bundle", "reconcileID": "18328ffb-c76e-47aa-b6f5-d101ae7a9e22", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:38Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "376baefd-415e-4ab0-a5c0-ad3104ac454b", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:38Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "openshift-service-ca.crt", "reconcileID": "376baefd-415e-4ab0-a5c0-ad3104ac454b", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:38Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "04d938b6-85be-4409-8f35-9603b2f8b15f", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:38Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-user-perm-test-526006"}, "namespace": "cypress-user-perm-test-526006", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "04d938b6-85be-4409-8f35-9603b2f8b15f", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-user-perm-test-526006"} 2026-07-15T04:26:45Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "c8f4c945-cb62-43ee-85c3-b8cb4507b8a4", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:45Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "c8f4c945-cb62-43ee-85c3-b8cb4507b8a4", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:26:45Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "c8f4c945-cb62-43ee-85c3-b8cb4507b8a4", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace qe-cluster-storage-sc-dsp because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:26:45Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-trusted-ca-bundle", "reconcileID": "7fee26df-552e-4395-a9e4-eb98b2a99aa4", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:45Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-trusted-ca-bundle", "reconcileID": "7fee26df-552e-4395-a9e4-eb98b2a99aa4", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:45Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "openshift-service-ca.crt", "reconcileID": "fa1b4a43-aa2f-4aeb-ba2b-da0e2f5c41c0", "ConfigMap": "openshift-service-ca.crt", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:45Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "openshift-service-ca.crt", "reconcileID": "fa1b4a43-aa2f-4aeb-ba2b-da0e2f5c41c0", "ConfigMap": "openshift-service-ca.crt", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:45Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "2b80b265-d08c-4cd7-bc51-0f7ac4beb59b", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:26:45Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"qe-cluster-storage-sc-dsp"}, "namespace": "qe-cluster-storage-sc-dsp", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "2b80b265-d08c-4cd7-bc51-0f7ac4beb59b", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "qe-cluster-storage-sc-dsp"} 2026-07-15T04:28:39Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "openshift-service-ca.crt", "reconcileID": "d17be7ab-05b7-4657-9705-50cd64c61455", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:28:39Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-trusted-ca-bundle", "reconcileID": "54f1461a-1afe-47d4-80ba-bb09f922e64c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-cluster-storage-access-modes", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:28:39Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-trusted-ca-bundle", "reconcileID": "54f1461a-1afe-47d4-80ba-bb09f922e64c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:28:39Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "openshift-service-ca.crt", "reconcileID": "af641437-05e8-4d4a-a76d-1402326256cd", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:28:39Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "5da356cb-5b2d-4924-884a-40aea9cc2439", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:28:39Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "openshift-service-ca.crt", "reconcileID": "a910a2c0-955d-4d01-bdac-491dfd0d0bc6", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:28:39Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-trusted-ca-bundle", "reconcileID": "ec9a0788-f7ff-4aa5-b8e7-22c68e7694fa", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-cluster-storage-access-modes", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:28:39Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-trusted-ca-bundle", "reconcileID": "ec9a0788-f7ff-4aa5-b8e7-22c68e7694fa", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:28:39Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "ab0d347f-9a83-40d0-9f51-799ded1f3e5d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:28:50Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "5beca0a7-2026-4e37-8f7e-c2b3148a0e27", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:28:50Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "5beca0a7-2026-4e37-8f7e-c2b3148a0e27", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-cluster-storage-access-modes", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:28:50Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "5beca0a7-2026-4e37-8f7e-c2b3148a0e27", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace test-cluster-storage-access-modes because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:28:50Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-trusted-ca-bundle", "reconcileID": "7b36681e-b161-4bf7-b8aa-6aeb2b45a31b", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:28:50Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-trusted-ca-bundle", "reconcileID": "7b36681e-b161-4bf7-b8aa-6aeb2b45a31b", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:28:50Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "openshift-service-ca.crt", "reconcileID": "a3cae61a-ef37-4592-8ba6-06e974d2b661", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:28:50Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "openshift-service-ca.crt", "reconcileID": "a3cae61a-ef37-4592-8ba6-06e974d2b661", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:28:50Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "3c028a7f-2340-495c-8204-e950b2da0f67", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:28:50Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "3c028a7f-2340-495c-8204-e950b2da0f67", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:28:52Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "openshift-service-ca.crt", "reconcileID": "34d9946f-5ad4-4daf-a06a-39f0a6f4d458", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:28:52Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-trusted-ca-bundle", "reconcileID": "04d7618a-de0d-436f-bac6-c90c2c9e315c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:28:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "openshift-service-ca.crt", "reconcileID": "bf9143cc-a06f-43e8-8a2b-6b782cecedd2", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-cluster-storage-access-modes", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:28:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "openshift-service-ca.crt", "reconcileID": "bf9143cc-a06f-43e8-8a2b-6b782cecedd2", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:28:52Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "26f4e56b-5d09-450a-a349-021d1542ccbf", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:28:52Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "openshift-service-ca.crt", "reconcileID": "9d81f188-ccee-4e98-893b-8245504a2531", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:28:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-trusted-ca-bundle", "reconcileID": "fa299498-849e-4404-93ff-a1b1d51d4867", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-cluster-storage-access-modes", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:28:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-trusted-ca-bundle", "reconcileID": "fa299498-849e-4404-93ff-a1b1d51d4867", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:28:52Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a75bcc4e-22ac-4e51-aabe-e899de474351", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:11Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "4f75dd1e-4b86-4a32-b308-f2d8399654c8", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:11Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "4f75dd1e-4b86-4a32-b308-f2d8399654c8", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-cluster-storage-access-modes", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:29:11Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "4f75dd1e-4b86-4a32-b308-f2d8399654c8", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace test-cluster-storage-access-modes because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:29:11Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-trusted-ca-bundle", "reconcileID": "1747c12a-31ee-415d-8af0-ff15d903616c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:11Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-trusted-ca-bundle", "reconcileID": "1747c12a-31ee-415d-8af0-ff15d903616c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:11Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "openshift-service-ca.crt", "reconcileID": "087047c5-31fe-4232-ac0a-6077315163d6", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:11Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "openshift-service-ca.crt", "reconcileID": "087047c5-31fe-4232-ac0a-6077315163d6", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:11Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "12399926-8dea-4390-8d3f-52a3f97c915d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:11Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "12399926-8dea-4390-8d3f-52a3f97c915d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:13Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "openshift-service-ca.crt", "reconcileID": "d6972a16-716d-4c60-a8bd-01b41389dc7f", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:13Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-trusted-ca-bundle", "reconcileID": "bd2f8540-2f16-44d7-9eab-3fb6d0d77a8a", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:13Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "openshift-service-ca.crt", "reconcileID": "77bbed47-1966-4e71-8706-fbfc18a248dd", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-cluster-storage-access-modes", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:29:13Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "openshift-service-ca.crt", "reconcileID": "77bbed47-1966-4e71-8706-fbfc18a248dd", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:13Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "8c129048-7863-489f-85d4-580a543e77e4", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:13Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "openshift-service-ca.crt", "reconcileID": "b207f7b4-6eaf-403e-a35f-8d9cdfb47f26", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:13Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-trusted-ca-bundle", "reconcileID": "ff6ed84e-2a73-414f-aacf-cf1bc58dd648", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-cluster-storage-access-modes", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:29:13Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-trusted-ca-bundle", "reconcileID": "ff6ed84e-2a73-414f-aacf-cf1bc58dd648", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:13Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "afe30453-f07a-4490-9921-150255979d0c", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:20Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "openshift-service-ca.crt", "reconcileID": "c0d0d274-c812-4d5c-b9ae-f9a6b6ee596a", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-register-store-662874"} 2026-07-15T04:29:20Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-trusted-ca-bundle", "reconcileID": "18d4aa12-b464-411c-946b-9dbc8e632a9a", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-register-store-662874"} 2026-07-15T04:29:20Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "openshift-service-ca.crt", "reconcileID": "a506e4c2-3e46-470b-a2c6-8719f2d6720d", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-register-store-662874", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:29:20Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "openshift-service-ca.crt", "reconcileID": "a506e4c2-3e46-470b-a2c6-8719f2d6720d", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-register-store-662874"} 2026-07-15T04:29:20Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "2ee2d335-0aaa-4f4c-9891-0ba8fbc28135", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-register-store-662874"} 2026-07-15T04:29:20Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "openshift-service-ca.crt", "reconcileID": "a7b95f84-860f-48ef-bb1c-1a29238335cd", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-register-store-662874"} 2026-07-15T04:29:20Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-trusted-ca-bundle", "reconcileID": "c00d8db5-db7e-4e9f-8eb1-1076897813f0", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-register-store-662874", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:29:20Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-trusted-ca-bundle", "reconcileID": "c00d8db5-db7e-4e9f-8eb1-1076897813f0", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-register-store-662874"} 2026-07-15T04:29:20Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "cba3b3cf-632b-46e1-a142-0820c37d8a13", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-register-store-662874"} 2026-07-15T04:29:36Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "95ab8b62-b8d7-451a-98fb-23aa791983ba", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:36Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "95ab8b62-b8d7-451a-98fb-23aa791983ba", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-cluster-storage-access-modes", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:29:36Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "95ab8b62-b8d7-451a-98fb-23aa791983ba", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace test-cluster-storage-access-modes because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:29:36Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-trusted-ca-bundle", "reconcileID": "b544d550-f1cd-45f5-b9c5-7b7252275544", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:36Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-trusted-ca-bundle", "reconcileID": "b544d550-f1cd-45f5-b9c5-7b7252275544", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:36Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "openshift-service-ca.crt", "reconcileID": "be7d5bcb-21cf-4834-988d-a918c89143f2", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:36Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "openshift-service-ca.crt", "reconcileID": "be7d5bcb-21cf-4834-988d-a918c89143f2", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:36Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "9ce612f3-c564-4600-89ef-556b17ac16c5", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:36Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-cluster-storage-access-modes"}, "namespace": "test-cluster-storage-access-modes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "9ce612f3-c564-4600-89ef-556b17ac16c5", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-cluster-storage-access-modes"} 2026-07-15T04:29:42Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "accb49e3-37f7-4581-a0bb-0d05f895f763", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:29:42Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-trusted-ca-bundle", "reconcileID": "ec05c2b9-05f2-4108-9f03-0c8168691dcd", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:29:42Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "49de6b67-0a0e-41bc-b17e-8a9c4dae5ffd", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:29:42Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "49de6b67-0a0e-41bc-b17e-8a9c4dae5ffd", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:29:42Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "fe09163d-d644-4e05-a343-474bebfcb70b", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:29:42Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "37cfa35c-b30a-4e1b-a463-17ad4b3c0925", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:29:42Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-trusted-ca-bundle", "reconcileID": "3b166c85-0b46-4885-95a6-45f23d891128", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-test-connection-type-185825", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:29:42Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-trusted-ca-bundle", "reconcileID": "3b166c85-0b46-4885-95a6-45f23d891128", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:29:42Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "071c52d4-0450-46cb-8549-a130581fd82b", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:29:47Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "d32b757c-5d82-4fde-88f1-e274423228cb", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-register-store-662874"} 2026-07-15T04:29:47Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "d32b757c-5d82-4fde-88f1-e274423228cb", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-register-store-662874", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:29:47Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "d32b757c-5d82-4fde-88f1-e274423228cb", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace test-register-store-662874 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:29:47Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-trusted-ca-bundle", "reconcileID": "72a2c478-7537-47b9-88d2-b563a120f970", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-register-store-662874"} 2026-07-15T04:29:47Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-trusted-ca-bundle", "reconcileID": "72a2c478-7537-47b9-88d2-b563a120f970", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-register-store-662874"} 2026-07-15T04:29:47Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "openshift-service-ca.crt", "reconcileID": "a04f2d9b-7c97-4923-a6f5-18b4c9643b68", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-register-store-662874"} 2026-07-15T04:29:47Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "openshift-service-ca.crt", "reconcileID": "a04f2d9b-7c97-4923-a6f5-18b4c9643b68", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-register-store-662874"} 2026-07-15T04:29:47Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "09af9c67-4fcb-4095-b8f5-258b3dcd9609", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-register-store-662874"} 2026-07-15T04:29:47Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "09af9c67-4fcb-4095-b8f5-258b3dcd9609", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-register-store-662874"} 2026-07-15T04:29:49Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "openshift-service-ca.crt", "reconcileID": "0ccf4718-73f3-46b7-9eac-9146382c7d26", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-register-store-662874"} 2026-07-15T04:29:49Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-trusted-ca-bundle", "reconcileID": "5901e5e8-7974-450c-89ce-70b002778807", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-register-store-662874"} 2026-07-15T04:29:49Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "openshift-service-ca.crt", "reconcileID": "430b63fd-0b56-48fc-88d7-42c8431b0ad0", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-register-store-662874", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:29:49Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "openshift-service-ca.crt", "reconcileID": "430b63fd-0b56-48fc-88d7-42c8431b0ad0", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-register-store-662874"} 2026-07-15T04:29:49Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "95327546-37a1-412d-ba35-d750e72cb8e9", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-register-store-662874"} 2026-07-15T04:29:49Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "openshift-service-ca.crt", "reconcileID": "f23bfeca-9f70-4c49-aba0-48cd2ba268b6", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-register-store-662874"} 2026-07-15T04:29:49Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-trusted-ca-bundle", "reconcileID": "3bb93533-156d-488c-b966-c5d3422a8613", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-register-store-662874", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:29:49Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-trusted-ca-bundle", "reconcileID": "3bb93533-156d-488c-b966-c5d3422a8613", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-register-store-662874"} 2026-07-15T04:29:49Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "4223a695-4ec2-4333-8c6b-f547a4db6123", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-register-store-662874"} 2026-07-15T04:29:52Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "bddec041-1db6-4adc-9612-d707c2acfaec", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:29:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "bddec041-1db6-4adc-9612-d707c2acfaec", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:29:52Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "bddec041-1db6-4adc-9612-d707c2acfaec", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace cypress-test-connection-type-185825 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:29:52Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-trusted-ca-bundle", "reconcileID": "3c810c45-ea56-4207-a8b3-12b0cb181ab7", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:29:52Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-trusted-ca-bundle", "reconcileID": "3c810c45-ea56-4207-a8b3-12b0cb181ab7", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:29:52Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "34ed52cd-b2ff-4490-b84a-335a1b14454f", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:29:52Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "34ed52cd-b2ff-4490-b84a-335a1b14454f", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:29:52Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "77dc3b78-b672-41b4-b4f3-43012873e29c", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:29:52Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "77dc3b78-b672-41b4-b4f3-43012873e29c", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:29:54Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "92ef2646-32e1-4105-aa15-0aab335f277f", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:29:54Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-trusted-ca-bundle", "reconcileID": "bcd7b4e5-e0d7-4bb7-9546-5125aa77f962", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:29:54Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "f5505d53-ae7c-43e8-9da6-293f43c95536", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:29:54Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "f5505d53-ae7c-43e8-9da6-293f43c95536", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:29:54Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "515b02ae-2d9e-4e53-8ba0-fcb71dd78ae6", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:29:54Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "5d536f3f-8899-4cb1-88ac-88ac2554202a", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:29:54Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-trusted-ca-bundle", "reconcileID": "df0bbd1f-b630-4cb0-96ac-05829cf07e4e", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-test-connection-type-185825", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:29:54Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-trusted-ca-bundle", "reconcileID": "df0bbd1f-b630-4cb0-96ac-05829cf07e4e", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:29:54Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "af060c2d-8d0b-4bcd-8cf5-8573ffede989", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:12Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "7b04b097-40f5-435a-b158-5442fbd0a0d1", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:12Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "7b04b097-40f5-435a-b158-5442fbd0a0d1", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:30:12Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "7b04b097-40f5-435a-b158-5442fbd0a0d1", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace cypress-test-connection-type-185825 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:30:12Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-trusted-ca-bundle", "reconcileID": "26bde0b7-1fd0-40f5-99b0-c50ddaeb30e9", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:12Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-trusted-ca-bundle", "reconcileID": "26bde0b7-1fd0-40f5-99b0-c50ddaeb30e9", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:12Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "a79d38be-4548-4561-a362-c20c1d66fa22", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:12Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "a79d38be-4548-4561-a362-c20c1d66fa22", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:12Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "bc0ae812-5b2e-4f94-8bb4-3292c46da1af", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:12Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "bc0ae812-5b2e-4f94-8bb4-3292c46da1af", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:13Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "554a95e4-3ad3-4ebf-ac08-6569b8553297", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:13Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-trusted-ca-bundle", "reconcileID": "4c66f19f-949e-4c18-a3dd-86794ce7197c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:13Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "f7d210d8-46ee-4094-89d5-a81d1f440443", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:30:13Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "f7d210d8-46ee-4094-89d5-a81d1f440443", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:13Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "8fe2b2e8-e9f9-444e-981f-a868ae8d6903", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:13Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "2193ca47-2e1c-4b09-a064-2e53d78ecc13", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:13Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-trusted-ca-bundle", "reconcileID": "575d9b47-8f67-4666-a21c-496ef207bc8c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-test-connection-type-185825", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:30:13Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-trusted-ca-bundle", "reconcileID": "575d9b47-8f67-4666-a21c-496ef207bc8c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:13Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "4bbd29a8-18cf-42d6-91df-006b87c81068", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:41Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "440963b6-6587-4249-a118-e7d6e8090e6b", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:41Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "440963b6-6587-4249-a118-e7d6e8090e6b", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:30:41Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "440963b6-6587-4249-a118-e7d6e8090e6b", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace cypress-test-connection-type-185825 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:30:41Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-trusted-ca-bundle", "reconcileID": "510830df-3561-4fd5-9e85-36a708936c8f", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:41Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-trusted-ca-bundle", "reconcileID": "510830df-3561-4fd5-9e85-36a708936c8f", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:41Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "cad7d795-432b-4bac-8ba9-3e037e4e85a7", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:41Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "cad7d795-432b-4bac-8ba9-3e037e4e85a7", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:41Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "10f44e25-2db7-4200-b498-e5d04dd2a174", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:41Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "10f44e25-2db7-4200-b498-e5d04dd2a174", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:43Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "565afc57-53fd-4df7-a4b1-22cbc193971d", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:43Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-trusted-ca-bundle", "reconcileID": "e8962599-f4cc-448d-b501-1340dcba7fbd", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:43Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "66decba0-a5d5-4b49-8a61-d4f2a4c947ca", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:30:43Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "66decba0-a5d5-4b49-8a61-d4f2a4c947ca", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:43Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a4e99daa-f2cb-49a4-b1d4-df30405e1138", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:43Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "55368b2d-6246-4863-a502-a59b71a5e225", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:43Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-trusted-ca-bundle", "reconcileID": "c60a27a8-0583-493e-a29e-c7ba4f592e7a", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-test-connection-type-185825", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:30:43Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-trusted-ca-bundle", "reconcileID": "c60a27a8-0583-493e-a29e-c7ba4f592e7a", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:43Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b69c743c-aa47-4b15-8ada-0961ea2874f6", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:30:50Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "5193c894-eb71-45a4-8493-988a360a0df5", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:30:50Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-trusted-ca-bundle", "reconcileID": "1b53a24b-fd1d-469d-8227-2860ca2c8295", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:30:50Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "9d4eac32-ca4f-477e-8e92-824dc268f58d", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-workbench-storage-preset-167984", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:30:50Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "9d4eac32-ca4f-477e-8e92-824dc268f58d", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:30:50Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "57d27e7d-4fdf-4ad8-be57-28515623c931", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:30:50Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "d29dcdb0-909a-43aa-8ba7-3166ae96d9ba", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:30:50Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-trusted-ca-bundle", "reconcileID": "0328baf1-d1a1-42ae-8c00-e7e7302324aa", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-workbench-storage-preset-167984", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:30:50Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-trusted-ca-bundle", "reconcileID": "0328baf1-d1a1-42ae-8c00-e7e7302324aa", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:30:50Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "765e5123-692f-4ca9-b23d-b2160b8a7f8c", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:01Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b1ca4c6c-5a29-4532-bac4-b0efa46592a3", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:01Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b1ca4c6c-5a29-4532-bac4-b0efa46592a3", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-workbench-storage-preset-167984", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:31:01Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b1ca4c6c-5a29-4532-bac4-b0efa46592a3", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:31:01Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-trusted-ca-bundle", "reconcileID": "6dca26e5-ce5a-449b-9b4c-a7f1aef80805", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:01Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-trusted-ca-bundle", "reconcileID": "6dca26e5-ce5a-449b-9b4c-a7f1aef80805", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:01Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "ff17160e-7be1-446f-b36c-74b066f945b5", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:01Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "ff17160e-7be1-446f-b36c-74b066f945b5", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:01Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "1d82571d-c586-4e0a-ad04-52e09502b51d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:01Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "1d82571d-c586-4e0a-ad04-52e09502b51d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:02Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "d19f0ab4-4cae-4f46-8df7-f399b4672b5a", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:31:02Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "d19f0ab4-4cae-4f46-8df7-f399b4672b5a", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:31:02Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "d19f0ab4-4cae-4f46-8df7-f399b4672b5a", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace cypress-test-connection-type-185825 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:31:02Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-trusted-ca-bundle", "reconcileID": "b43a835b-1cc7-4db4-90d6-e11edbc09259", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:31:02Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-trusted-ca-bundle", "reconcileID": "b43a835b-1cc7-4db4-90d6-e11edbc09259", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:31:02Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "8e982d7b-e532-455d-8781-82b697f69cce", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:31:02Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "openshift-service-ca.crt", "reconcileID": "8e982d7b-e532-455d-8781-82b697f69cce", "ConfigMap": "openshift-service-ca.crt", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:31:02Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "ea290392-765f-4d07-9222-68748e801963", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:31:02Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cypress-test-connection-type-185825"}, "namespace": "cypress-test-connection-type-185825", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "ea290392-765f-4d07-9222-68748e801963", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cypress-test-connection-type-185825"} 2026-07-15T04:31:03Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "111e276f-ba47-4411-ba16-4118300a0482", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:03Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-trusted-ca-bundle", "reconcileID": "6d5ab907-954f-4375-87f0-46c66de6668b", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:03Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "c1df9a5b-e230-429f-bd9c-e4e7819ff3b5", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-workbench-storage-preset-167984", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:31:03Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "c1df9a5b-e230-429f-bd9c-e4e7819ff3b5", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:03Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "0b1210eb-f52e-4dbe-b434-951e0a5d0a03", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-workbench-storage-preset-167984", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:31:03Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "0b1210eb-f52e-4dbe-b434-951e0a5d0a03", "error": "configmaps \"odh-kserve-custom-ca-bundle\" already exists"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:31:03Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "2cc1c730-836c-4c43-b63b-5c8b94013e69", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-workbench-storage-preset-167984", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:31:03Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "2cc1c730-836c-4c43-b63b-5c8b94013e69", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:03Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-trusted-ca-bundle", "reconcileID": "588ef343-ffed-4814-bc5b-d2fc50d1c2f0", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:03Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "24698a0a-cbf1-4759-9101-1bdb5a209178", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:03Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "ecc00e7b-f94d-4f58-8b73-fcbbe3b81c2c", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:22Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b095872c-9f57-4266-97f5-559011bfef24", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:22Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b095872c-9f57-4266-97f5-559011bfef24", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-workbench-storage-preset-167984", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:31:22Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b095872c-9f57-4266-97f5-559011bfef24", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:31:22Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-trusted-ca-bundle", "reconcileID": "dea0e2e5-d8ad-4ab8-8d23-c36f323f9ca4", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:22Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-trusted-ca-bundle", "reconcileID": "dea0e2e5-d8ad-4ab8-8d23-c36f323f9ca4", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:22Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "bed60906-3098-4004-8acd-c0e0bf569bc3", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:22Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "bed60906-3098-4004-8acd-c0e0bf569bc3", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:22Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "1b0e61fb-19ec-43b5-a34b-4004fc1734bd", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:22Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "1b0e61fb-19ec-43b5-a34b-4004fc1734bd", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:23Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "91250c4f-09b0-4225-aab8-eddc4fe53eb7", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:23Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-trusted-ca-bundle", "reconcileID": "519f01e4-cfdb-4d50-814d-6b641037d0e8", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:23Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "21d64a9e-a488-4eb6-b9c9-6daa8921122c", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-workbench-storage-preset-167984", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:31:23Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "21d64a9e-a488-4eb6-b9c9-6daa8921122c", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:23Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "d3a7266c-25de-4be6-a4fe-66d8925e530a", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-workbench-storage-preset-167984", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:31:23Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "d3a7266c-25de-4be6-a4fe-66d8925e530a", "error": "configmaps \"odh-kserve-custom-ca-bundle\" already exists"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:31:23Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "566ea8c5-cb43-4c27-93b8-ed20b437d3cb", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-workbench-storage-preset-167984", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:31:23Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "566ea8c5-cb43-4c27-93b8-ed20b437d3cb", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:23Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-trusted-ca-bundle", "reconcileID": "f4216f7e-4f11-4cd9-a652-9c0cfc3b92bc", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:23Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "81d1fdc7-2dd3-4277-b87c-7507b3bda8cc", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:23Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "56582836-9cd8-4410-b8f8-63521cc7d4f0", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:41Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a6095b46-4be6-41d8-9707-6b619d05a819", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:41Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a6095b46-4be6-41d8-9707-6b619d05a819", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-workbench-storage-preset-167984", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:31:41Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a6095b46-4be6-41d8-9707-6b619d05a819", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:31:41Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-trusted-ca-bundle", "reconcileID": "998c551a-51a9-4d46-8505-7c3947824d30", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:41Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-trusted-ca-bundle", "reconcileID": "998c551a-51a9-4d46-8505-7c3947824d30", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:41Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "ac4723c3-c638-4e6c-a02e-1aaa0dc07aed", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:41Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "openshift-service-ca.crt", "reconcileID": "ac4723c3-c638-4e6c-a02e-1aaa0dc07aed", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:41Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "775368bd-4be3-4629-8589-58ac40f95b65", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:41Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "775368bd-4be3-4629-8589-58ac40f95b65", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-workbench-storage-preset-167984"} 2026-07-15T04:31:45Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "openshift-service-ca.crt", "reconcileID": "227a93dc-4972-4840-b96d-57c35e351549", "ConfigMap": "openshift-service-ca.crt", "namespace": "lifecycle-test-141919"} 2026-07-15T04:31:45Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-trusted-ca-bundle", "reconcileID": "7d09bc35-3489-4def-8ae1-a0dd883bb535", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:31:45Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "openshift-service-ca.crt", "reconcileID": "3a6f6c62-54dc-4a0e-9b2a-15dcdb7f8522", "ConfigMap": "openshift-service-ca.crt", "namespace": "lifecycle-test-141919", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:31:45Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "openshift-service-ca.crt", "reconcileID": "3a6f6c62-54dc-4a0e-9b2a-15dcdb7f8522", "ConfigMap": "openshift-service-ca.crt", "namespace": "lifecycle-test-141919"} 2026-07-15T04:31:45Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "openshift-service-ca.crt", "reconcileID": "115e96c7-2d56-4dd0-aec1-33c41b455f79", "ConfigMap": "openshift-service-ca.crt", "namespace": "lifecycle-test-141919"} 2026-07-15T04:31:45Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "61391443-77c9-47d7-af73-5f04a4dcc01d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:31:45Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-trusted-ca-bundle", "reconcileID": "a86fc147-d8d0-434f-9d3d-b1b52c9234de", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "lifecycle-test-141919", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:31:45Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-trusted-ca-bundle", "reconcileID": "a86fc147-d8d0-434f-9d3d-b1b52c9234de", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:31:45Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "8ed58ae5-8616-4dc0-9c92-34c118999f13", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:32:34Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "dddb4c12-db16-412b-99d3-df498dcc4e29", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:32:34Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "dddb4c12-db16-412b-99d3-df498dcc4e29", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "lifecycle-test-141919", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:32:34Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "dddb4c12-db16-412b-99d3-df498dcc4e29", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:32:34Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-trusted-ca-bundle", "reconcileID": "2675cb15-a82c-4c2a-9d61-89fcbb98092a", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:32:34Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-trusted-ca-bundle", "reconcileID": "2675cb15-a82c-4c2a-9d61-89fcbb98092a", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:32:34Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "openshift-service-ca.crt", "reconcileID": "f57e28f3-3d9f-4a05-891b-b490d8a9b0b8", "ConfigMap": "openshift-service-ca.crt", "namespace": "lifecycle-test-141919"} 2026-07-15T04:32:34Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "openshift-service-ca.crt", "reconcileID": "f57e28f3-3d9f-4a05-891b-b490d8a9b0b8", "ConfigMap": "openshift-service-ca.crt", "namespace": "lifecycle-test-141919"} 2026-07-15T04:32:34Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "cee3f266-398c-4ee2-a259-ba1321eac241", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:32:34Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "cee3f266-398c-4ee2-a259-ba1321eac241", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:32:42Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "openshift-service-ca.crt", "reconcileID": "927d208e-7c6b-4322-a686-b77d0e266dfd", "ConfigMap": "openshift-service-ca.crt", "namespace": "lifecycle-test-141919"} 2026-07-15T04:32:42Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-trusted-ca-bundle", "reconcileID": "ea4d9f14-d3df-4b54-875f-0172a857014c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:32:42Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "openshift-service-ca.crt", "reconcileID": "04dd9a3d-1325-4a3a-a80d-56090235423d", "ConfigMap": "openshift-service-ca.crt", "namespace": "lifecycle-test-141919", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:32:42Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "openshift-service-ca.crt", "reconcileID": "04dd9a3d-1325-4a3a-a80d-56090235423d", "ConfigMap": "openshift-service-ca.crt", "namespace": "lifecycle-test-141919"} 2026-07-15T04:32:42Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "cbff7bfb-6a53-4971-993d-1de31962ea39", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:32:42Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "openshift-service-ca.crt", "reconcileID": "ff80daad-75ea-4377-9410-ea8dc3558490", "ConfigMap": "openshift-service-ca.crt", "namespace": "lifecycle-test-141919"} 2026-07-15T04:32:42Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-trusted-ca-bundle", "reconcileID": "91d89a0f-0d1e-4ef3-8e36-cf439b6502ef", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "lifecycle-test-141919", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:32:42Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-trusted-ca-bundle", "reconcileID": "91d89a0f-0d1e-4ef3-8e36-cf439b6502ef", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:32:42Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a67ecef8-469a-4065-b74d-ce0e8795033b", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:33:39Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "ce6824f6-bdfd-4491-9b8e-0422dfd03a57", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:33:39Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "ce6824f6-bdfd-4491-9b8e-0422dfd03a57", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "lifecycle-test-141919", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:33:39Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "ce6824f6-bdfd-4491-9b8e-0422dfd03a57", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:33:39Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-trusted-ca-bundle", "reconcileID": "c0abd1d7-eda3-4ab8-b9ee-d763b8de4939", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:33:39Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-trusted-ca-bundle", "reconcileID": "c0abd1d7-eda3-4ab8-b9ee-d763b8de4939", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:33:39Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "openshift-service-ca.crt", "reconcileID": "9d83837c-5237-4f59-bb2f-b4e4ebac539d", "ConfigMap": "openshift-service-ca.crt", "namespace": "lifecycle-test-141919"} 2026-07-15T04:33:39Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "openshift-service-ca.crt", "reconcileID": "9d83837c-5237-4f59-bb2f-b4e4ebac539d", "ConfigMap": "openshift-service-ca.crt", "namespace": "lifecycle-test-141919"} 2026-07-15T04:33:39Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a433ca99-023f-403c-854d-c417bacf0593", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:33:39Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a433ca99-023f-403c-854d-c417bacf0593", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:33:47Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "openshift-service-ca.crt", "reconcileID": "d72a2c74-bda2-492c-9160-2a03f955928f", "ConfigMap": "openshift-service-ca.crt", "namespace": "lifecycle-test-141919"} 2026-07-15T04:33:47Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-trusted-ca-bundle", "reconcileID": "2875c0b7-f9ea-4a4b-a956-ac234c69b6f4", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:33:47Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "openshift-service-ca.crt", "reconcileID": "b28e4450-0e81-42dc-a91f-056d2b8cfb61", "ConfigMap": "openshift-service-ca.crt", "namespace": "lifecycle-test-141919", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:33:47Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "openshift-service-ca.crt", "reconcileID": "b28e4450-0e81-42dc-a91f-056d2b8cfb61", "ConfigMap": "openshift-service-ca.crt", "namespace": "lifecycle-test-141919"} 2026-07-15T04:33:47Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "4234724e-b40f-4b0b-87df-2ad28e3afe3d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:33:47Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "openshift-service-ca.crt", "reconcileID": "2e23f183-7a12-4713-b2ed-a147443675d5", "ConfigMap": "openshift-service-ca.crt", "namespace": "lifecycle-test-141919"} 2026-07-15T04:33:47Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-trusted-ca-bundle", "reconcileID": "9944aea0-6542-4885-81b0-8ae04d82de54", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "lifecycle-test-141919", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:33:47Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-trusted-ca-bundle", "reconcileID": "9944aea0-6542-4885-81b0-8ae04d82de54", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:33:47Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "9cba0c1f-e3d8-40ee-aa27-3740f0a97527", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:34:07Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "openshift-service-ca.crt", "reconcileID": "8e00b94d-130b-4057-881c-80368fe6f76c", "ConfigMap": "openshift-service-ca.crt", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:34:07Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "openshift-service-ca.crt", "reconcileID": "9d085f37-9205-495c-85ee-bc205a6468a9", "ConfigMap": "openshift-service-ca.crt", "namespace": "trainer-v2-test-113378", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:34:07Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "openshift-service-ca.crt", "reconcileID": "9d085f37-9205-495c-85ee-bc205a6468a9", "ConfigMap": "openshift-service-ca.crt", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:34:07Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-trusted-ca-bundle", "reconcileID": "c942098c-224e-442d-9ab9-88f4ae4fe873", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:34:07Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "4cb28949-1d11-468d-aea1-309aa3106147", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:34:07Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "openshift-service-ca.crt", "reconcileID": "94beccb8-1e7f-446d-9f1b-b4a139ad872d", "ConfigMap": "openshift-service-ca.crt", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:34:07Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-trusted-ca-bundle", "reconcileID": "d71d2449-8c32-496f-a681-82d75f7ef6a8", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "trainer-v2-test-113378", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:34:07Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-trusted-ca-bundle", "reconcileID": "d71d2449-8c32-496f-a681-82d75f7ef6a8", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:34:07Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "76ac41f3-47ca-4315-8d78-7ef9c6c7ad22", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:34:45Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "3da9af6c-824b-460c-862f-9daba7859f0e", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:34:45Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "3da9af6c-824b-460c-862f-9daba7859f0e", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "lifecycle-test-141919", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:34:45Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "3da9af6c-824b-460c-862f-9daba7859f0e", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace lifecycle-test-141919 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:34:45Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-trusted-ca-bundle", "reconcileID": "1957c3c5-f076-4d41-bde7-558d3e535f88", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:34:45Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-trusted-ca-bundle", "reconcileID": "1957c3c5-f076-4d41-bde7-558d3e535f88", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:34:45Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "openshift-service-ca.crt", "reconcileID": "6d0de689-642a-491b-a0f7-cbd76d9e244b", "ConfigMap": "openshift-service-ca.crt", "namespace": "lifecycle-test-141919"} 2026-07-15T04:34:45Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "openshift-service-ca.crt", "reconcileID": "6d0de689-642a-491b-a0f7-cbd76d9e244b", "ConfigMap": "openshift-service-ca.crt", "namespace": "lifecycle-test-141919"} 2026-07-15T04:34:45Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "47587952-401b-44f5-b04f-7a7d3ec1d096", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:34:45Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"lifecycle-test-141919"}, "namespace": "lifecycle-test-141919", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "47587952-401b-44f5-b04f-7a7d3ec1d096", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "lifecycle-test-141919"} 2026-07-15T04:34:56Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "bf4e02d8-577b-49ff-8042-c21152c6a74a", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:34:56Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "bf4e02d8-577b-49ff-8042-c21152c6a74a", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "trainer-v2-test-113378", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:34:56Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "bf4e02d8-577b-49ff-8042-c21152c6a74a", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace trainer-v2-test-113378 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:34:56Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "ffa555cf-7c9d-4e2b-a5d6-4674f32d85d3", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:34:56Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "ffa555cf-7c9d-4e2b-a5d6-4674f32d85d3", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "trainer-v2-test-113378", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:34:56Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "ffa555cf-7c9d-4e2b-a5d6-4674f32d85d3", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace trainer-v2-test-113378 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:34:56Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-trusted-ca-bundle", "reconcileID": "87ee7b9f-40c2-46e0-89f5-82516c39bd0d", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:34:56Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-trusted-ca-bundle", "reconcileID": "87ee7b9f-40c2-46e0-89f5-82516c39bd0d", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "trainer-v2-test-113378", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:34:56Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-trusted-ca-bundle", "reconcileID": "87ee7b9f-40c2-46e0-89f5-82516c39bd0d", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace trainer-v2-test-113378 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:34:56Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "openshift-service-ca.crt", "reconcileID": "52cdef76-9e03-48d6-bd10-c97879b148e7", "ConfigMap": "openshift-service-ca.crt", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:34:56Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "openshift-service-ca.crt", "reconcileID": "52cdef76-9e03-48d6-bd10-c97879b148e7", "ConfigMap": "openshift-service-ca.crt", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:34:56Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-trusted-ca-bundle", "reconcileID": "19cf201f-964c-481d-86fd-3c629038b447", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:34:56Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-trusted-ca-bundle", "reconcileID": "19cf201f-964c-481d-86fd-3c629038b447", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:34:56Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "757e8279-ea4c-4a4a-8bb7-61653a427393", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:34:56Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "757e8279-ea4c-4a4a-8bb7-61653a427393", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:35:03Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "openshift-service-ca.crt", "reconcileID": "f7705804-22e3-4d18-8783-19d3cfd9770b", "ConfigMap": "openshift-service-ca.crt", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:35:03Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-trusted-ca-bundle", "reconcileID": "85cee4c8-4850-4093-9fcb-cef90775f907", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:35:03Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "openshift-service-ca.crt", "reconcileID": "524ee2ef-25bd-4afa-ad94-cfca6cf070f5", "ConfigMap": "openshift-service-ca.crt", "namespace": "trainer-v2-test-113378", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:35:03Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "openshift-service-ca.crt", "reconcileID": "524ee2ef-25bd-4afa-ad94-cfca6cf070f5", "ConfigMap": "openshift-service-ca.crt", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:35:03Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "e485d03c-6359-4e8c-90f8-a0b2ec2d7888", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:35:03Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "openshift-service-ca.crt", "reconcileID": "d5005288-8b0e-4a0c-b75f-4c1e57c89f38", "ConfigMap": "openshift-service-ca.crt", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:35:03Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-trusted-ca-bundle", "reconcileID": "6460f22d-d9ae-4f42-9b9e-19785e789a52", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "trainer-v2-test-113378", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:35:03Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-trusted-ca-bundle", "reconcileID": "6460f22d-d9ae-4f42-9b9e-19785e789a52", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:35:03Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "0cc9427c-601d-487d-bd91-612267ede482", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:36:02Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "fd6b0f0d-ca0c-4d9c-b81f-95d6b3b337ed", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:36:02Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "fd6b0f0d-ca0c-4d9c-b81f-95d6b3b337ed", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "trainer-v2-test-113378", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:36:02Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "fd6b0f0d-ca0c-4d9c-b81f-95d6b3b337ed", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace trainer-v2-test-113378 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:36:02Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-trusted-ca-bundle", "reconcileID": "dd265700-894b-45de-b8af-a5d34acd348c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:36:02Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-trusted-ca-bundle", "reconcileID": "dd265700-894b-45de-b8af-a5d34acd348c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:36:02Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "openshift-service-ca.crt", "reconcileID": "b0442fa4-2e71-4521-bfa8-52e279398d9e", "ConfigMap": "openshift-service-ca.crt", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:36:02Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "openshift-service-ca.crt", "reconcileID": "b0442fa4-2e71-4521-bfa8-52e279398d9e", "ConfigMap": "openshift-service-ca.crt", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:36:02Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "83311eeb-90e6-4dc6-8222-d447d8c4f1ac", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:36:02Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "83311eeb-90e6-4dc6-8222-d447d8c4f1ac", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:36:10Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "openshift-service-ca.crt", "reconcileID": "17edcee1-3550-4895-b468-f7c78884d1b3", "ConfigMap": "openshift-service-ca.crt", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:36:10Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-trusted-ca-bundle", "reconcileID": "3d167ebb-f6e0-4014-b7e1-1ee13e297112", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "trainer-v2-test-113378", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:36:10Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-trusted-ca-bundle", "reconcileID": "3d167ebb-f6e0-4014-b7e1-1ee13e297112", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:36:10Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "openshift-service-ca.crt", "reconcileID": "470825df-6ef6-41d4-a877-985915c81e5e", "ConfigMap": "openshift-service-ca.crt", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:36:10Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "6c5007fe-e6df-4928-8aa8-04b03047adcf", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:36:10Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "openshift-service-ca.crt", "reconcileID": "5f0c0094-115b-47a1-b02b-801420ae431a", "ConfigMap": "openshift-service-ca.crt", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:36:10Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-trusted-ca-bundle", "reconcileID": "e9a95308-c61a-4c85-aabd-295a52ca4a72", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "trainer-v2-test-113378", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:36:10Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-trusted-ca-bundle", "reconcileID": "e9a95308-c61a-4c85-aabd-295a52ca4a72", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:36:10Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "0823bdad-68b7-42d3-8013-cf01bb2ba4e4", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:36:13Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "546b84e5-261b-41ad-87db-6d1ddc7d5385", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-register-store-662874"} 2026-07-15T04:36:13Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "546b84e5-261b-41ad-87db-6d1ddc7d5385", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-register-store-662874", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:36:13Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "546b84e5-261b-41ad-87db-6d1ddc7d5385", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace test-register-store-662874 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:36:13Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-trusted-ca-bundle", "reconcileID": "f239781a-b926-4cda-86f8-aa6b2628ef66", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-register-store-662874"} 2026-07-15T04:36:13Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-trusted-ca-bundle", "reconcileID": "f239781a-b926-4cda-86f8-aa6b2628ef66", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-register-store-662874"} 2026-07-15T04:36:13Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "openshift-service-ca.crt", "reconcileID": "e3dbaec2-3425-4e70-a5a5-b3f6a806dd3f", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-register-store-662874"} 2026-07-15T04:36:13Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "openshift-service-ca.crt", "reconcileID": "e3dbaec2-3425-4e70-a5a5-b3f6a806dd3f", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-register-store-662874"} 2026-07-15T04:36:13Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "5f1aef83-94d8-403a-be33-e87194127ed8", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-register-store-662874"} 2026-07-15T04:36:13Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-register-store-662874"}, "namespace": "test-register-store-662874", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "5f1aef83-94d8-403a-be33-e87194127ed8", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-register-store-662874"} 2026-07-15T04:36:40Z INFO No monitoring namespace detected, skipping monitoring reconciliation. {"ResourceName": "ray-ca-tls", "Namespace": "redhat-ods-applications"} 2026-07-15T04:36:40Z INFO Multi Node reconciling. {"ResourceName": "ray-ca-tls", "Namespace": "redhat-ods-applications"} 2026-07-15T04:36:43Z INFO ray ca tls secret modified so ray tls cert need to be updated to sync ca.crt {"ResourceName": "ray-ca-tls", "Namespace": "redhat-ods-applications"} 2026-07-15T04:36:43Z INFO Multi Node reconciled successfully. {"ResourceName": "ray-ca-tls", "Namespace": "redhat-ods-applications"} 2026-07-15T04:37:09Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "921ee84b-05c5-4322-b9a6-9b7e57988790", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:37:09Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "921ee84b-05c5-4322-b9a6-9b7e57988790", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "trainer-v2-test-113378", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:37:09Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "921ee84b-05c5-4322-b9a6-9b7e57988790", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace trainer-v2-test-113378 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:37:09Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-trusted-ca-bundle", "reconcileID": "dcdb966c-e2a5-428f-93e8-dc1638508531", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:37:09Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-trusted-ca-bundle", "reconcileID": "dcdb966c-e2a5-428f-93e8-dc1638508531", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:37:09Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "openshift-service-ca.crt", "reconcileID": "8de9389c-769b-4961-b1c6-b5345d81fee6", "ConfigMap": "openshift-service-ca.crt", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:37:09Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "openshift-service-ca.crt", "reconcileID": "8de9389c-769b-4961-b1c6-b5345d81fee6", "ConfigMap": "openshift-service-ca.crt", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:37:09Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "00a386a6-f3ee-4a45-809b-0fef007dd650", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:37:09Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"trainer-v2-test-113378"}, "namespace": "trainer-v2-test-113378", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "00a386a6-f3ee-4a45-809b-0fef007dd650", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "trainer-v2-test-113378"} 2026-07-15T04:52:44Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-ns-zvxhj"}, "namespace": "test-ns-zvxhj", "name": "openshift-service-ca.crt", "reconcileID": "23feabff-8cd9-463a-9edf-7b6bf928d07e", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-ns-zvxhj"} 2026-07-15T04:52:44Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-ns-zvxhj"}, "namespace": "test-ns-zvxhj", "name": "odh-trusted-ca-bundle", "reconcileID": "3be4a77f-52e7-4175-9218-8b0f1b281013", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-ns-zvxhj"} 2026-07-15T04:52:45Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-ns-zvxhj"}, "namespace": "test-ns-zvxhj", "name": "openshift-service-ca.crt", "reconcileID": "a9354f10-5a8d-44a1-8359-71fb8d78cb7b", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-ns-zvxhj", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:52:45Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-ns-zvxhj"}, "namespace": "test-ns-zvxhj", "name": "openshift-service-ca.crt", "reconcileID": "a9354f10-5a8d-44a1-8359-71fb8d78cb7b", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-ns-zvxhj"} 2026-07-15T04:52:45Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-ns-zvxhj"}, "namespace": "test-ns-zvxhj", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "4f567cc4-bc31-42be-99d1-371a7a49e21e", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-ns-zvxhj"} 2026-07-15T04:52:45Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-ns-zvxhj"}, "namespace": "test-ns-zvxhj", "name": "openshift-service-ca.crt", "reconcileID": "d1669f47-ff4c-4cd3-9d3b-a31b076ba19a", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-ns-zvxhj"} 2026-07-15T04:52:45Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-ns-zvxhj"}, "namespace": "test-ns-zvxhj", "name": "odh-trusted-ca-bundle", "reconcileID": "ceee5ad8-f516-4ea7-aee7-669b2ada1b06", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-ns-zvxhj", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:52:45Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-ns-zvxhj"}, "namespace": "test-ns-zvxhj", "name": "odh-trusted-ca-bundle", "reconcileID": "ceee5ad8-f516-4ea7-aee7-669b2ada1b06", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-ns-zvxhj"} 2026-07-15T04:52:45Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-ns-zvxhj"}, "namespace": "test-ns-zvxhj", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "d6b1e5a3-e356-451d-bbfd-7df424af91c0", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-ns-zvxhj"} 2026-07-15T04:52:45Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-ns-x2tl5"}, "namespace": "test-ns-x2tl5", "name": "openshift-service-ca.crt", "reconcileID": "cf15122e-c038-4c3a-b567-390ac178257b", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-ns-x2tl5"} 2026-07-15T04:52:45Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-ns-x2tl5"}, "namespace": "test-ns-x2tl5", "name": "odh-trusted-ca-bundle", "reconcileID": "45f200ff-fbfc-45f4-96be-bd9d7c1cdef1", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-ns-x2tl5"} 2026-07-15T04:52:45Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-ns-x2tl5"}, "namespace": "test-ns-x2tl5", "name": "openshift-service-ca.crt", "reconcileID": "b9ef3430-5c5e-4bd8-b24d-974bd0838026", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-ns-x2tl5", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:52:45Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-ns-x2tl5"}, "namespace": "test-ns-x2tl5", "name": "openshift-service-ca.crt", "reconcileID": "b9ef3430-5c5e-4bd8-b24d-974bd0838026", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-ns-x2tl5"} 2026-07-15T04:52:45Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-ns-x2tl5"}, "namespace": "test-ns-x2tl5", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "16ebc142-b65e-4a53-97f0-61c6d25605f2", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-ns-x2tl5"} 2026-07-15T04:52:45Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-ns-x2tl5"}, "namespace": "test-ns-x2tl5", "name": "openshift-service-ca.crt", "reconcileID": "3df8600d-16e6-4319-ab10-646933e753a4", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-ns-x2tl5"} 2026-07-15T04:52:45Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-ns-x2tl5"}, "namespace": "test-ns-x2tl5", "name": "odh-trusted-ca-bundle", "reconcileID": "cb8a0af7-6d36-48b1-afda-f1bbe3b7fcb2", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-ns-x2tl5", "update": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:52:45Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-ns-x2tl5"}, "namespace": "test-ns-x2tl5", "name": "odh-trusted-ca-bundle", "reconcileID": "cb8a0af7-6d36-48b1-afda-f1bbe3b7fcb2", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-ns-x2tl5"} 2026-07-15T04:52:45Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-ns-x2tl5"}, "namespace": "test-ns-x2tl5", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "5a1b3f41-a206-49ab-bb11-8be025eb5a76", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-ns-x2tl5"} 2026-07-15T04:52:50Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-ns-x2tl5"}, "namespace": "test-ns-x2tl5", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "cafb0c99-2937-4bd4-829b-b4ca13f7c0e1", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-ns-x2tl5"} 2026-07-15T04:52:50Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-ns-x2tl5"}, "namespace": "test-ns-x2tl5", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "cafb0c99-2937-4bd4-829b-b4ca13f7c0e1", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-ns-x2tl5", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:52:50Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-ns-x2tl5"}, "namespace": "test-ns-x2tl5", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "cafb0c99-2937-4bd4-829b-b4ca13f7c0e1", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace test-ns-x2tl5 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:52:50Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-ns-x2tl5"}, "namespace": "test-ns-x2tl5", "name": "odh-trusted-ca-bundle", "reconcileID": "208b46bd-7cd3-46c4-b5b9-dfe3a97b5496", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-ns-x2tl5"} 2026-07-15T04:52:50Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-ns-x2tl5"}, "namespace": "test-ns-x2tl5", "name": "odh-trusted-ca-bundle", "reconcileID": "208b46bd-7cd3-46c4-b5b9-dfe3a97b5496", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-ns-x2tl5"} 2026-07-15T04:52:50Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-ns-x2tl5"}, "namespace": "test-ns-x2tl5", "name": "openshift-service-ca.crt", "reconcileID": "2fa823f9-ce03-4b66-92d7-fabe26c18c3e", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-ns-x2tl5"} 2026-07-15T04:52:50Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-ns-x2tl5"}, "namespace": "test-ns-x2tl5", "name": "openshift-service-ca.crt", "reconcileID": "2fa823f9-ce03-4b66-92d7-fabe26c18c3e", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-ns-x2tl5"} 2026-07-15T04:52:50Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-ns-x2tl5"}, "namespace": "test-ns-x2tl5", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "51c56dc0-da5d-412c-9837-1adadab1b947", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-ns-x2tl5"} 2026-07-15T04:52:50Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-ns-x2tl5"}, "namespace": "test-ns-x2tl5", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "51c56dc0-da5d-412c-9837-1adadab1b947", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-ns-x2tl5"} 2026-07-15T04:52:51Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-ns-zvxhj"}, "namespace": "test-ns-zvxhj", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "0f8a3211-32e5-4b0a-93cd-1beb7f28e88a", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-ns-zvxhj"} 2026-07-15T04:52:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-ns-zvxhj"}, "namespace": "test-ns-zvxhj", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "0f8a3211-32e5-4b0a-93cd-1beb7f28e88a", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-ns-zvxhj", "create": "odh-kserve-custom-ca-bundle"} 2026-07-15T04:52:51Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-ns-zvxhj"}, "namespace": "test-ns-zvxhj", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "0f8a3211-32e5-4b0a-93cd-1beb7f28e88a", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace test-ns-zvxhj because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-15T04:52:51Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-ns-zvxhj"}, "namespace": "test-ns-zvxhj", "name": "odh-trusted-ca-bundle", "reconcileID": "78d874a5-27f1-4432-95a2-da6352f88d5f", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-ns-zvxhj"} 2026-07-15T04:52:51Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-ns-zvxhj"}, "namespace": "test-ns-zvxhj", "name": "odh-trusted-ca-bundle", "reconcileID": "78d874a5-27f1-4432-95a2-da6352f88d5f", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-ns-zvxhj"} 2026-07-15T04:52:51Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-ns-zvxhj"}, "namespace": "test-ns-zvxhj", "name": "openshift-service-ca.crt", "reconcileID": "b6bacaff-b529-49e7-acc5-e6766636f5d0", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-ns-zvxhj"} 2026-07-15T04:52:51Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-ns-zvxhj"}, "namespace": "test-ns-zvxhj", "name": "openshift-service-ca.crt", "reconcileID": "b6bacaff-b529-49e7-acc5-e6766636f5d0", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-ns-zvxhj"} 2026-07-15T04:52:51Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-ns-zvxhj"}, "namespace": "test-ns-zvxhj", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "34906c02-ce9c-49ef-bdc2-ec785698688d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-ns-zvxhj"} 2026-07-15T04:52:51Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-ns-zvxhj"}, "namespace": "test-ns-zvxhj", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "34906c02-ce9c-49ef-bdc2-ec785698688d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-ns-zvxhj"} ==================== WORKLOAD POD LOG: rhoai-model-registries/model-catalog-76db8fd49f-svbks.log ==================== W0715 03:58:19.840547 1 connect.go:86] Retrying connection to PostgreSQL (attempt 1/25): failed to connect to `user=catalog_user database=model_catalog`: 172.31.173.175:5432 (model-catalog-postgres): dial error: dial tcp 172.31.173.175:5432: connect: connection refused 172.31.173.175:5432 (model-catalog-postgres): dial error: dial tcp 172.31.173.175:5432: connect: connection refused W0715 03:58:20.843990 1 connect.go:86] Retrying connection to PostgreSQL (attempt 2/25): failed to connect to `user=catalog_user database=model_catalog`: 172.31.173.175:5432 (model-catalog-postgres): dial error: dial tcp 172.31.173.175:5432: connect: connection refused 172.31.173.175:5432 (model-catalog-postgres): dial error: dial tcp 172.31.173.175:5432: connect: connection refused W0715 03:58:22.846827 1 connect.go:86] Retrying connection to PostgreSQL (attempt 3/25): failed to connect to `user=catalog_user database=model_catalog`: 172.31.173.175:5432 (model-catalog-postgres): dial error: dial tcp 172.31.173.175:5432: connect: connection refused 172.31.173.175:5432 (model-catalog-postgres): dial error: dial tcp 172.31.173.175:5432: connect: connection refused W0715 03:58:25.851348 1 connect.go:86] Retrying connection to PostgreSQL (attempt 4/25): failed to connect to `user=catalog_user database=model_catalog`: 172.31.173.175:5432 (model-catalog-postgres): dial error: dial tcp 172.31.173.175:5432: connect: connection refused 172.31.173.175:5432 (model-catalog-postgres): dial error: dial tcp 172.31.173.175:5432: connect: connection refused W0715 03:58:29.854389 1 connect.go:86] Retrying connection to PostgreSQL (attempt 5/25): failed to connect to `user=catalog_user database=model_catalog`: 172.31.173.175:5432 (model-catalog-postgres): dial error: dial tcp 172.31.173.175:5432: connect: connection refused 172.31.173.175:5432 (model-catalog-postgres): dial error: dial tcp 172.31.173.175:5432: connect: connection refused W0715 03:58:34.860640 1 connect.go:86] Retrying connection to PostgreSQL (attempt 6/25): failed to connect to `user=catalog_user database=model_catalog`: 172.31.173.175:5432 (model-catalog-postgres): dial error: dial tcp 172.31.173.175:5432: connect: connection refused 172.31.173.175:5432 (model-catalog-postgres): dial error: dial tcp 172.31.173.175:5432: connect: connection refused W0715 03:58:40.867532 1 connect.go:86] Retrying connection to PostgreSQL (attempt 7/25): failed to connect to `user=catalog_user database=model_catalog`: 172.31.173.175:5432 (model-catalog-postgres): dial error: dial tcp 172.31.173.175:5432: connect: connection refused 172.31.173.175:5432 (model-catalog-postgres): dial error: dial tcp 172.31.173.175:5432: connect: connection refused W0715 03:58:47.870807 1 connect.go:86] Retrying connection to PostgreSQL (attempt 8/25): failed to connect to `user=catalog_user database=model_catalog`: 172.31.173.175:5432 (model-catalog-postgres): dial error: dial tcp 172.31.173.175:5432: connect: connection refused 172.31.173.175:5432 (model-catalog-postgres): dial error: dial tcp 172.31.173.175:5432: connect: connection refused I0715 03:58:55.888277 1 connect.go:94] Successfully connected to PostgreSQL database I0715 03:58:55.888737 1 catalog.go:121] Leader election configured: lock duration=1m0s, heartbeat=15s I0715 03:58:55.893147 1 service.go:130] Connecting to EmbedMD service... I0715 03:58:55.893164 1 service.go:137] Connected to EmbedMD service I0715 03:58:55.893169 1 repos.go:35] Getting types... I0715 03:58:55.893201 1 election.go:190] Attempting to acquire leadership... I0715 03:58:55.895224 1 election.go:226] Successfully acquired leadership lock: catalog-leader W0715 03:58:55.904247 1 service.go:186] Unable to get types: no types available: ERROR: relation "Type" does not exist (SQLSTATE 42P01) I0715 03:58:55.913414 1 service.go:162] Running migrations... I0715 03:58:56.433809 1 service.go:167] Migrations completed I0715 03:58:56.433836 1 service.go:169] Syncing types... I0715 03:58:56.472956 1 service.go:174] Syncing types completed W0715 03:58:56.472977 1 election.go:132] Leader callback 0 exited early I0715 03:58:56.904445 1 repos.go:35] Getting types... I0715 03:58:56.905588 1 repos.go:47] Types retrieved I0715 03:58:56.905606 1 repos.go:63] All required types validated successfully I0715 03:58:56.905691 1 performance_metrics.go:154] Loading performance metrics data from [/shared-benchmark-data] I0715 03:58:56.910375 1 performance_metrics.go:239] Built model directory cache (72 models indexed) W0715 03:58:56.910433 1 election.go:132] Leader callback 1 exited early I0715 03:58:56.910466 1 catalog.go:174] Starting loader in read-only mode (standby) I0715 03:58:56.910491 1 loader.go:69] Starting unified loader in read-only mode (standby) W0715 03:58:56.911098 1 config.go:24] Configuration file /data/default-sources/sources.yaml uses deprecated 'catalogs' field. Please rename to 'model_catalogs'. I0715 03:58:56.911122 1 loader.go:204] reading config type yaml... I0715 03:58:56.911129 1 loader.go:222] loaded source redhat_ai_models of type yaml I0715 03:58:56.911132 1 loader.go:204] reading config type yaml... I0715 03:58:56.911136 1 loader.go:222] loaded source redhat_ai_validated_models of type yaml I0715 03:58:56.911140 1 loader.go:204] reading config type yaml... I0715 03:58:56.911145 1 loader.go:222] loaded source other_models of type yaml I0715 03:58:56.911269 1 loader.go:85] Initializing MCP loader - parsing configs W0715 03:58:56.911700 1 config.go:24] Configuration file /data/default-sources/sources.yaml uses deprecated 'catalogs' field. Please rename to 'model_catalogs'. I0715 03:58:56.911712 1 loader.go:150] reading MCP catalog config type yaml... I0715 03:58:56.911720 1 loader.go:166] loaded MCP source rh_mcp_servers of type yaml I0715 03:58:56.911724 1 loader.go:150] reading MCP catalog config type yaml... I0715 03:58:56.911727 1 loader.go:166] loaded MCP source rh_partner_mcp_servers of type yaml I0715 03:58:56.911730 1 loader.go:150] reading MCP catalog config type yaml... I0715 03:58:56.911733 1 loader.go:166] loaded MCP source community_mcp_servers of type yaml I0715 03:58:56.911822 1 loader.go:93] MCP loader config parsing complete I0715 03:58:56.911836 1 loader.go:84] Read-only mode initialized successfully I0715 03:58:56.911905 1 catalog.go:208] Catalog API server listening on 0.0.0.0:8080 I0715 03:58:56.911946 1 catalog.go:228] Became leader - starting leader-only operations I0715 03:58:56.911973 1 loader.go:139] Transitioning to leader mode (read-write) I0715 03:58:56.914082 1 loader.go:379] Reading models from yaml source redhat_ai_models I0715 03:58:56.923355 1 loader.go:379] Reading models from yaml source redhat_ai_validated_models I0715 03:58:57.002208 1 loader.go:379] Reading models from yaml source other_models I0715 03:58:57.006280 1 loader.go:102] MCP loader performing leader operations I0715 03:58:57.006305 1 loader.go:193] Loading MCP servers from source: Red Hat MCP Servers (id: rh_mcp_servers) I0715 03:58:57.006379 1 loader.go:285] Loading model redhat_ai_models:RedHatAI/granite-3.3-8b-instruct with 1 artifact(s) I0715 03:58:57.031239 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Apertus-8B-Instruct-2509-FP8-dynamic with 1 artifact(s) I0715 03:58:57.235009 1 performance_metrics.go:273] Loaded 117 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Apertus-8B-Instruct-2509-FP8-dynamic I0715 03:58:57.235042 1 loader.go:285] Loading model other_models:RedHatAI/Qwen3-Embedding-8B with 1 artifact(s) I0715 03:58:57.249845 1 loader.go:285] Loading model redhat_ai_models:RedHatAI/granite-4.0-h-small with 1 artifact(s) I0715 03:58:57.263390 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/DeepSeek-R1-0528-quantized.w4a16 with 1 artifact(s) I0715 03:58:57.310943 1 loader.go:193] Loading MCP servers from source: Red Hat Partner MCP Servers (id: rh_partner_mcp_servers) I0715 03:58:57.354107 1 performance_metrics.go:273] Loaded 55 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/DeepSeek-R1-0528-quantized.w4a16 I0715 03:58:57.354131 1 loader.go:285] Loading model other_models:RedHatAI/all-MiniLM-L6-v2 with 1 artifact(s) I0715 03:58:57.369620 1 loader.go:285] Loading model redhat_ai_models:RedHatAI/granite-4.0-h-tiny with 1 artifact(s) I0715 03:58:57.383892 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Devstral-Small-2-24B-Instruct-2512 with 1 artifact(s) I0715 03:58:57.654940 1 performance_metrics.go:273] Loaded 138 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Devstral-Small-2-24B-Instruct-2512 I0715 03:58:57.654967 1 loader.go:285] Loading model other_models:RedHatAI/embeddinggemma-300m with 1 artifact(s) I0715 03:58:57.671081 1 loader.go:285] Loading model redhat_ai_models:granite-7b-redhat-lab with 1 artifact(s) I0715 03:58:57.685086 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Kimi-K2-Instruct-quantized.w4a16 with 1 artifact(s) I0715 03:58:57.753586 1 performance_metrics.go:273] Loaded 22 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Kimi-K2-Instruct-quantized.w4a16 I0715 03:58:57.753617 1 loader.go:285] Loading model other_models:RedHatAI/granite-embedding-english-r2 with 1 artifact(s) I0715 03:58:57.768548 1 loader.go:285] Loading model redhat_ai_models:granite-8b-starter-v1 with 1 artifact(s) I0715 03:58:57.781736 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Llama-3.1-8B-Instruct with 1 artifact(s) I0715 03:58:57.794270 1 loader.go:193] Loading MCP servers from source: Community MCP Servers (id: community_mcp_servers) I0715 03:58:57.949542 1 loader.go:116] MCP loader leader operations complete I0715 03:58:57.949567 1 loader.go:156] Leader mode active I0715 03:58:57.982292 1 performance_metrics.go:273] Loaded 107 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Llama-3.1-8B-Instruct I0715 03:58:57.982317 1 loader.go:285] Loading model other_models:RedHatAI/nomic-embed-text-v1.5 with 1 artifact(s) I0715 03:58:57.982379 1 loader.go:420] other_models: loaded 5 models I0715 03:58:58.034540 1 loader.go:431] other_models: cleaned up 0 models I0715 03:58:58.035951 1 loader.go:285] Loading model redhat_ai_models:granite-8b-lab-v1 with 1 artifact(s) I0715 03:58:58.055266 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF with 1 artifact(s) I0715 03:58:58.122388 1 performance_metrics.go:273] Loaded 30 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF I0715 03:58:58.122413 1 loader.go:285] Loading model redhat_ai_models:granite-3.1-8b-lab-v1 with 1 artifact(s) I0715 03:58:58.135705 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic with 1 artifact(s) I0715 03:58:58.202286 1 performance_metrics.go:273] Loaded 35 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic I0715 03:58:58.202316 1 loader.go:285] Loading model redhat_ai_models:granite-8b-code-instruct with 1 artifact(s) I0715 03:58:58.215527 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Llama-3.3-70B-Instruct with 1 artifact(s) I0715 03:58:58.283822 1 performance_metrics.go:273] Loaded 35 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Llama-3.3-70B-Instruct I0715 03:58:58.283850 1 loader.go:285] Loading model redhat_ai_models:granite-8b-code-base with 1 artifact(s) I0715 03:58:58.296726 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Llama-3.3-70B-Instruct-FP8-dynamic with 1 artifact(s) I0715 03:58:58.367822 1 performance_metrics.go:273] Loaded 36 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Llama-3.3-70B-Instruct-FP8-dynamic I0715 03:58:58.367853 1 loader.go:285] Loading model redhat_ai_models:prometheus-8x7b-v2-0 with 1 artifact(s) I0715 03:58:58.367906 1 loader.go:420] redhat_ai_models: loaded 10 models I0715 03:58:58.381425 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16 with 1 artifact(s) I0715 03:58:58.384746 1 loader.go:431] redhat_ai_models: cleaned up 0 models I0715 03:58:58.465815 1 performance_metrics.go:273] Loaded 30 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16 I0715 03:58:58.465846 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8 with 1 artifact(s) I0715 03:58:58.549199 1 performance_metrics.go:273] Loaded 43 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8 I0715 03:58:58.549229 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Llama-4-Maverick-17B-128E-Instruct with 1 artifact(s) I0715 03:58:58.590063 1 performance_metrics.go:273] Loaded 3 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Llama-4-Maverick-17B-128E-Instruct I0715 03:58:58.590090 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Llama-4-Maverick-17B-128E-Instruct-FP8 with 1 artifact(s) I0715 03:58:58.647632 1 performance_metrics.go:273] Loaded 18 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Llama-4-Maverick-17B-128E-Instruct-FP8 I0715 03:58:58.647658 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Llama-4-Scout-17B-16E-Instruct with 1 artifact(s) I0715 03:58:58.694936 1 performance_metrics.go:273] Loaded 15 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Llama-4-Scout-17B-16E-Instruct I0715 03:58:58.694961 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic with 1 artifact(s) I0715 03:58:58.768212 1 performance_metrics.go:273] Loaded 40 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic I0715 03:58:58.768238 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16 with 1 artifact(s) I0715 03:58:58.821660 1 performance_metrics.go:273] Loaded 16 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16 I0715 03:58:58.821685 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic with 1 artifact(s) I0715 03:58:58.867461 1 performance_metrics.go:273] Loaded 3 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic I0715 03:58:58.867488 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 with 1 artifact(s) I0715 03:58:58.885850 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 with 1 artifact(s) I0715 03:58:58.903171 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/MiniMax-M2.5 with 1 artifact(s) I0715 03:58:58.973694 1 performance_metrics.go:273] Loaded 41 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/MiniMax-M2.5 I0715 03:58:58.973719 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Ministral-3-14B-Instruct-2512 with 1 artifact(s) I0715 03:58:59.159302 1 performance_metrics.go:273] Loaded 130 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Ministral-3-14B-Instruct-2512 I0715 03:58:59.159331 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Ministral-3-3B-Instruct-2512 with 1 artifact(s) I0715 03:58:59.362543 1 performance_metrics.go:273] Loaded 149 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Ministral-3-3B-Instruct-2512 I0715 03:58:59.362587 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Mistral-Large-3-675B-Instruct-2512 with 1 artifact(s) I0715 03:58:59.409092 1 performance_metrics.go:273] Loaded 18 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Mistral-Large-3-675B-Instruct-2512 I0715 03:58:59.409118 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Mistral-Large-3-675B-Instruct-2512-NVFP4 with 1 artifact(s) I0715 03:58:59.485412 1 performance_metrics.go:273] Loaded 42 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Mistral-Large-3-675B-Instruct-2512-NVFP4 I0715 03:58:59.485442 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Mistral-Small-24B-Instruct-2501 with 1 artifact(s) I0715 03:58:59.593845 1 performance_metrics.go:273] Loaded 81 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Mistral-Small-24B-Instruct-2501 I0715 03:58:59.593877 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Mistral-Small-24B-Instruct-2501-FP8-dynamic with 1 artifact(s) I0715 03:58:59.640925 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w4a16 with 1 artifact(s) I0715 03:58:59.660166 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w8a8 with 1 artifact(s) I0715 03:58:59.681300 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Mistral-Small-3.1-24B-Instruct-2503 with 1 artifact(s) I0715 03:58:59.853562 1 performance_metrics.go:273] Loaded 105 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Mistral-Small-3.1-24B-Instruct-2503 I0715 03:58:59.853593 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic with 1 artifact(s) I0715 03:59:00.040479 1 performance_metrics.go:273] Loaded 112 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic I0715 03:59:00.040521 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16 with 1 artifact(s) I0715 03:59:00.181547 1 performance_metrics.go:273] Loaded 104 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16 I0715 03:59:00.181585 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8 with 1 artifact(s) I0715 03:59:00.383529 1 performance_metrics.go:273] Loaded 123 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8 I0715 03:59:00.383564 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Mistral-Small-4-119B-2603 with 1 artifact(s) I0715 03:59:00.464472 1 performance_metrics.go:273] Loaded 40 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Mistral-Small-4-119B-2603 I0715 03:59:00.464501 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Mistral-Small-4-119B-2603-NVFP4 with 1 artifact(s) I0715 03:59:00.592449 1 performance_metrics.go:273] Loaded 91 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Mistral-Small-4-119B-2603-NVFP4 I0715 03:59:00.592559 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Mixtral-8x7B-Instruct-v0.1 with 1 artifact(s) I0715 03:59:00.712673 1 performance_metrics.go:273] Loaded 59 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Mixtral-8x7B-Instruct-v0.1 I0715 03:59:00.712700 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8 with 1 artifact(s) I0715 03:59:00.890299 1 performance_metrics.go:273] Loaded 126 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8 I0715 03:59:00.890332 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 with 1 artifact(s) I0715 03:59:01.048590 1 performance_metrics.go:273] Loaded 80 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 I0715 03:59:01.048621 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-FP8 with 1 artifact(s) I0715 03:59:01.172475 1 performance_metrics.go:273] Loaded 79 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-FP8 I0715 03:59:01.172504 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 with 1 artifact(s) I0715 03:59:01.255675 1 performance_metrics.go:273] Loaded 31 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 I0715 03:59:01.255707 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/NVIDIA-Nemotron-Nano-9B-v2-FP8-dynamic with 1 artifact(s) I0715 03:59:01.346704 1 performance_metrics.go:273] Loaded 46 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/NVIDIA-Nemotron-Nano-9B-v2-FP8-dynamic I0715 03:59:01.346734 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Phi-4-mini-instruct-FP8-dynamic with 1 artifact(s) I0715 03:59:01.491129 1 performance_metrics.go:273] Loaded 110 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Phi-4-mini-instruct-FP8-dynamic I0715 03:59:01.491159 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Phi-4-reasoning-FP8-dynamic with 1 artifact(s) I0715 03:59:01.649184 1 performance_metrics.go:273] Loaded 75 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Phi-4-reasoning-FP8-dynamic I0715 03:59:01.649213 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Qwen2.5-7B-Instruct with 1 artifact(s) I0715 03:59:01.792521 1 performance_metrics.go:273] Loaded 102 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Qwen2.5-7B-Instruct I0715 03:59:01.792553 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Qwen2.5-7B-Instruct-FP8-dynamic with 1 artifact(s) I0715 03:59:01.980453 1 performance_metrics.go:273] Loaded 110 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Qwen2.5-7B-Instruct-FP8-dynamic I0715 03:59:01.980485 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Qwen2.5-7B-Instruct-quantized.w4a16 with 1 artifact(s) I0715 03:59:02.145462 1 performance_metrics.go:273] Loaded 87 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Qwen2.5-7B-Instruct-quantized.w4a16 I0715 03:59:02.145491 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a8 with 1 artifact(s) I0715 03:59:02.294538 1 performance_metrics.go:273] Loaded 106 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a8 I0715 03:59:02.294571 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Qwen3-8B-FP8-dynamic with 1 artifact(s) I0715 03:59:02.555875 1 performance_metrics.go:273] Loaded 155 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Qwen3-8B-FP8-dynamic I0715 03:59:02.555905 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Qwen3-Coder-480B-A35B-Instruct-FP8 with 1 artifact(s) I0715 03:59:02.603568 1 performance_metrics.go:273] Loaded 13 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Qwen3-Coder-480B-A35B-Instruct-FP8 I0715 03:59:02.603591 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Qwen3-Coder-Next-NVFP4 with 1 artifact(s) I0715 03:59:02.777120 1 performance_metrics.go:273] Loaded 119 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Qwen3-Coder-Next-NVFP4 I0715 03:59:02.777147 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Qwen3-Next-80B-A3B-Instruct-quantized.w4a16 with 1 artifact(s) I0715 03:59:02.978510 1 performance_metrics.go:273] Loaded 133 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Qwen3-Next-80B-A3B-Instruct-quantized.w4a16 I0715 03:59:02.978538 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Qwen3-VL-235B-A22B-Instruct-NVFP4 with 1 artifact(s) I0715 03:59:03.137954 1 performance_metrics.go:273] Loaded 79 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Qwen3-VL-235B-A22B-Instruct-NVFP4 I0715 03:59:03.137984 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Qwen3.5-122B-A10B-FP8-dynamic with 1 artifact(s) I0715 03:59:03.211679 1 performance_metrics.go:273] Loaded 42 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Qwen3.5-122B-A10B-FP8-dynamic I0715 03:59:03.211706 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Qwen3.5-35B-A3B-FP8-dynamic with 1 artifact(s) I0715 03:59:03.381514 1 performance_metrics.go:273] Loaded 108 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Qwen3.5-35B-A3B-FP8-dynamic I0715 03:59:03.381545 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic with 1 artifact(s) I0715 03:59:03.458841 1 performance_metrics.go:273] Loaded 25 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic I0715 03:59:03.458872 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/Voxtral-Mini-3B-2507-FP8-dynamic with 1 artifact(s) I0715 03:59:03.478283 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/gemma-2-9b-it with 1 artifact(s) I0715 03:59:03.495517 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/gemma-2-9b-it-FP8 with 1 artifact(s) I0715 03:59:03.514728 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/gemma-3n-E4B-it-FP8-dynamic with 1 artifact(s) I0715 03:59:03.647962 1 performance_metrics.go:273] Loaded 81 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/gemma-3n-E4B-it-FP8-dynamic I0715 03:59:03.647994 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/gpt-oss-120b with 1 artifact(s) I0715 03:59:03.863899 1 performance_metrics.go:273] Loaded 148 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/gpt-oss-120b I0715 03:59:03.863930 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/gpt-oss-120b-essential with 1 artifact(s) I0715 03:59:04.082138 1 performance_metrics.go:273] Loaded 148 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/gpt-oss-120b-essential I0715 03:59:04.082168 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/gpt-oss-20b with 1 artifact(s) I0715 03:59:04.363082 1 performance_metrics.go:273] Loaded 177 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/gpt-oss-20b I0715 03:59:04.363110 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/gpt-oss-20b-essential with 1 artifact(s) I0715 03:59:04.652183 1 performance_metrics.go:273] Loaded 177 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/gpt-oss-20b-essential I0715 03:59:04.652216 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/granite-3.1-8b-base-quantized.w4a16 with 1 artifact(s) I0715 03:59:04.670431 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/granite-3.1-8b-instruct with 2 artifact(s) I0715 03:59:04.849835 1 performance_metrics.go:273] Loaded 95 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/granite-3.1-8b-instruct I0715 03:59:04.849864 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/granite-3.1-8b-instruct-FP8-dynamic with 1 artifact(s) I0715 03:59:04.891404 1 performance_metrics.go:273] Loaded 6 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/granite-3.1-8b-instruct-FP8-dynamic I0715 03:59:04.891427 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/granite-3.1-8b-instruct-quantized.w4a16 with 1 artifact(s) I0715 03:59:04.938015 1 performance_metrics.go:273] Loaded 4 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/granite-3.1-8b-instruct-quantized.w4a16 I0715 03:59:04.938037 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/granite-3.1-8b-instruct-quantized.w8a8 with 1 artifact(s) I0715 03:59:04.975596 1 performance_metrics.go:273] Loaded 1 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/granite-3.1-8b-instruct-quantized.w8a8 I0715 03:59:04.975624 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/granite-4.0-h-small-FP8-dynamic with 1 artifact(s) I0715 03:59:05.053052 1 performance_metrics.go:273] Loaded 42 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/granite-4.0-h-small-FP8-dynamic I0715 03:59:05.053084 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/granite-4.0-h-tiny-FP8-dynamic with 1 artifact(s) I0715 03:59:05.157696 1 performance_metrics.go:273] Loaded 46 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/granite-4.0-h-tiny-FP8-dynamic I0715 03:59:05.157735 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/phi-4 with 1 artifact(s) I0715 03:59:05.270842 1 performance_metrics.go:273] Loaded 55 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/phi-4 I0715 03:59:05.270875 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/phi-4-FP8-dynamic with 1 artifact(s) I0715 03:59:05.375579 1 performance_metrics.go:273] Loaded 54 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/phi-4-FP8-dynamic I0715 03:59:05.375616 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/phi-4-quantized.w4a16 with 1 artifact(s) I0715 03:59:05.482870 1 performance_metrics.go:273] Loaded 52 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/phi-4-quantized.w4a16 I0715 03:59:05.482901 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/phi-4-quantized.w8a8 with 1 artifact(s) I0715 03:59:05.605369 1 performance_metrics.go:273] Loaded 60 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/phi-4-quantized.w8a8 I0715 03:59:05.605400 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/sarvam-105b-FP8-dynamic with 1 artifact(s) I0715 03:59:05.739477 1 performance_metrics.go:273] Loaded 61 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/sarvam-105b-FP8-dynamic I0715 03:59:05.739511 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/sarvam-30b-FP8-dynamic with 1 artifact(s) I0715 03:59:05.885947 1 performance_metrics.go:273] Loaded 105 performance metrics artifacts for model redhat_ai_validated_models:RedHatAI/sarvam-30b-FP8-dynamic I0715 03:59:05.885978 1 loader.go:285] Loading model redhat_ai_validated_models:RedHatAI/whisper-large-v3-turbo-quantized.w4a16 with 1 artifact(s) I0715 03:59:05.885990 1 loader.go:420] redhat_ai_validated_models: loaded 76 models I0715 03:59:05.965559 1 loader.go:431] redhat_ai_validated_models: cleaned up 0 models W0715 03:58:21.700728 1 deprecated.go:66] ==== Removed Flag Warning ====================== logtostderr is removed in the k8s upstream and has no effect any more. =============================================== I0715 03:58:21.700796 1 kube-rbac-proxy.go:553] Reading config file: /etc/kube-rbac-proxy/config-file.yaml I0715 03:58:21.701378 1 kube-rbac-proxy.go:247] Valid token audiences: I0715 03:58:21.702103 1 kube-rbac-proxy.go:370] Reading certificate files I0715 03:58:21.702444 1 kube-rbac-proxy.go:418] Starting TCP socket on 0.0.0.0:8443 I0715 03:58:21.702539 1 kube-rbac-proxy.go:466] Starting TCP socket on 0.0.0.0:8888 I0715 03:58:21.702773 1 kube-rbac-proxy.go:425] Listening securely on 0.0.0.0:8443 I0715 03:58:21.702776 1 kube-rbac-proxy.go:473] Listening securely on 0.0.0.0:8888 for proxy endpoints ==================== WORKLOAD POD LOG: rhoai-model-registries/model-catalog-postgres-f9fd8fcdd-xjf29.log ==================== The files belonging to this database system will be owned by user "postgres". This user must also own the server process. The database cluster will be initialized with locale "en_US.utf8". The default database encoding has accordingly been set to "UTF8". The default text search configuration will be set to "english". Data page checksums are disabled. fixing permissions on existing directory /var/lib/pgsql/data/userdata ... ok creating subdirectories ... ok selecting dynamic shared memory implementation ... posix selecting default max_connections ... 100 selecting default shared_buffers ... 128MB selecting default time zone ... UTC creating configuration files ... ok running bootstrap script ... ok performing post-bootstrap initialization ... ok syncing data to disk ... ok Success. You can now start the database server using: pg_ctl -D /var/lib/pgsql/data/userdata -l logfile start initdb: warning: enabling "trust" authentication for local connections initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. waiting for server to start....2026-07-15 03:58:40.642 UTC [30] LOG: redirecting log output to logging collector process 2026-07-15 03:58:40.642 UTC [30] HINT: Future log output will appear in directory "log". done server started /var/run/postgresql:5432 - accepting connections => sourcing /usr/share/container-scripts/postgresql/start/set_passwords.sh ... ALTER ROLE waiting for server to shut down.... done server stopped Starting server... 2026-07-15 03:58:40.983 UTC [1] LOG: redirecting log output to logging collector process 2026-07-15 03:58:40.983 UTC [1] HINT: Future log output will appear in directory "log". ==================== WORKLOAD POD LOG: rhoai-model-registries/mysql-db-registry-1784089476971-9d84456b8-ltrlc.log ==================== 2026-07-15 04:25:05+00:00 [Note] [Entrypoint]: Entrypoint script for MySQL Server 8.3.0-1.el8 started. 2026-07-15 04:25:05+00:00 [Note] [Entrypoint]: Initializing database files 2026-07-15T04:25:05.269012Z 0 [System] [MY-015017] [Server] MySQL Server Initialization - start. 2026-07-15T04:25:05.270992Z 0 [Warning] [MY-010918] [Server] 'default_authentication_plugin' is deprecated and will be removed in a future release. Please use authentication_policy instead. 2026-07-15T04:25:05.271009Z 0 [System] [MY-013169] [Server] /usr/sbin/mysqld (mysqld 8.3.0) initializing of server in progress as process 36 2026-07-15T04:25:05.273201Z 0 [Warning] [MY-010122] [Server] One can only use the --user switch if running as root 2026-07-15T04:25:05.277911Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started. 2026-07-15T04:25:05.753343Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended. 2026-07-15T04:25:07.154731Z 6 [Warning] [MY-010453] [Server] root@localhost is created with an empty password ! Please consider switching off the --initialize-insecure option. 2026-07-15T04:25:07.476432Z 6 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:25:11.871040Z 0 [System] [MY-015018] [Server] MySQL Server Initialization - end. 2026-07-15 04:25:11+00:00 [Note] [Entrypoint]: Database files initialized 2026-07-15 04:25:11+00:00 [Note] [Entrypoint]: Starting temporary server 2026-07-15T04:25:11.922433Z 0 [System] [MY-015015] [Server] MySQL Server - start. 2026-07-15T04:25:12.150394Z 0 [Warning] [MY-010918] [Server] 'default_authentication_plugin' is deprecated and will be removed in a future release. Please use authentication_policy instead. 2026-07-15T04:25:12.150420Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.3.0) starting as process 80 2026-07-15T04:25:12.156445Z 0 [Warning] [MY-010122] [Server] One can only use the --user switch if running as root 2026-07-15T04:25:12.164978Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started. 2026-07-15T04:25:12.296515Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended. 2026-07-15T04:25:12.558780Z 0 [Warning] [MY-010068] [Server] CA certificate ca.pem is self signed. 2026-07-15T04:25:12.558808Z 0 [System] [MY-013602] [Server] Channel mysql_main configured to support TLS. Encrypted connections are now supported for this channel. 2026-07-15T04:25:12.559517Z 0 [Warning] [MY-011810] [Server] Insecure configuration for --pid-file: Location '/var/run/mysqld' in the path is accessible to all OS users. Consider choosing a different directory. 2026-07-15T04:25:12.576654Z 0 [System] [MY-011323] [Server] X Plugin ready for connections. Socket: /var/run/mysqld/mysqlx.sock 2026-07-15T04:25:12.576729Z 0 [System] [MY-010931] [Server] /usr/sbin/mysqld: ready for connections. Version: '8.3.0' socket: '/var/run/mysqld/mysqld.sock' port: 0 MySQL Community Server - GPL. 2026-07-15 04:25:12+00:00 [Note] [Entrypoint]: Temporary server started. '/var/lib/mysql/mysql.sock' -> '/var/run/mysqld/mysqld.sock' 2026-07-15T04:25:12.613937Z 8 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' Warning: Unable to load '/usr/share/zoneinfo/iso3166.tab' as time zone. Skipping it. Warning: Unable to load '/usr/share/zoneinfo/leap-seconds.list' as time zone. Skipping it. Warning: Unable to load '/usr/share/zoneinfo/leapseconds' as time zone. Skipping it. Warning: Unable to load '/usr/share/zoneinfo/tzdata.zi' as time zone. Skipping it. Warning: Unable to load '/usr/share/zoneinfo/zone.tab' as time zone. Skipping it. Warning: Unable to load '/usr/share/zoneinfo/zone1970.tab' as time zone. Skipping it. 2026-07-15T04:25:14.304762Z 9 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:25:14.305619Z 9 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:25:14.310481Z 9 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15 04:25:14+00:00 [Note] [Entrypoint]: Creating database model-registry 2026-07-15T04:25:14.327997Z 10 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15 04:25:14+00:00 [Note] [Entrypoint]: Creating user mlmduser 2026-07-15T04:25:14.345843Z 11 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:25:14.346890Z 11 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15 04:25:14+00:00 [Note] [Entrypoint]: Giving user mlmduser access to schema model-registry 2026-07-15T04:25:14.361757Z 12 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15 04:25:14+00:00 [Note] [Entrypoint]: Stopping temporary server 2026-07-15T04:25:14.374608Z 13 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:25:14.377364Z 13 [System] [MY-013172] [Server] Received SHUTDOWN from user root. Shutting down mysqld (Version: 8.3.0). 2026-07-15T04:25:16.698073Z 0 [System] [MY-010910] [Server] /usr/sbin/mysqld: Shutdown complete (mysqld 8.3.0) MySQL Community Server - GPL. 2026-07-15T04:25:16.698091Z 0 [System] [MY-015016] [Server] MySQL Server - end. 2026-07-15 04:25:17+00:00 [Note] [Entrypoint]: Temporary server stopped 2026-07-15 04:25:17+00:00 [Note] [Entrypoint]: MySQL init process done. Ready for start up. 2026-07-15T04:25:17.390528Z 0 [System] [MY-015015] [Server] MySQL Server - start. 2026-07-15T04:25:17.622367Z 0 [Warning] [MY-010918] [Server] 'default_authentication_plugin' is deprecated and will be removed in a future release. Please use authentication_policy instead. 2026-07-15T04:25:17.622392Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.3.0) starting as process 1 2026-07-15T04:25:17.624564Z 0 [Warning] [MY-010122] [Server] One can only use the --user switch if running as root 2026-07-15T04:25:17.630400Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started. 2026-07-15T04:25:17.760477Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended. 2026-07-15T04:25:17.966838Z 0 [Warning] [MY-010068] [Server] CA certificate ca.pem is self signed. 2026-07-15T04:25:17.966865Z 0 [System] [MY-013602] [Server] Channel mysql_main configured to support TLS. Encrypted connections are now supported for this channel. 2026-07-15T04:25:17.967655Z 0 [Warning] [MY-011810] [Server] Insecure configuration for --pid-file: Location '/var/run/mysqld' in the path is accessible to all OS users. Consider choosing a different directory. 2026-07-15T04:25:17.986282Z 0 [System] [MY-011323] [Server] X Plugin ready for connections. Bind-address: '::' port: 33060, socket: /var/run/mysqld/mysqlx.sock 2026-07-15T04:25:17.986348Z 0 [System] [MY-010931] [Server] /usr/sbin/mysqld: ready for connections. Version: '8.3.0' socket: '/var/run/mysqld/mysqld.sock' port: 3306 MySQL Community Server - GPL. 2026-07-15T04:25:27.008100Z 8 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:25:28.903946Z 9 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:25:37.007504Z 10 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:25:38.917318Z 11 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:25:47.007586Z 12 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:25:48.903665Z 13 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:25:57.007983Z 14 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:25:58.903975Z 15 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:26:07.007970Z 16 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:26:08.904148Z 17 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:26:17.009742Z 18 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:26:18.903249Z 19 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:26:27.008328Z 20 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:26:28.903498Z 21 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:26:37.008763Z 22 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:26:38.904429Z 23 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:26:47.008102Z 24 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:26:48.903345Z 25 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:26:57.007917Z 26 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:26:58.903402Z 27 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:27:07.007940Z 28 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:27:08.903401Z 29 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:27:17.007915Z 30 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:27:18.904055Z 31 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:27:27.007345Z 32 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:27:28.903245Z 33 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:27:37.007948Z 34 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:27:38.903851Z 35 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:27:47.008747Z 36 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:27:48.904024Z 37 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:27:57.008152Z 38 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:27:58.904132Z 39 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:28:07.007606Z 40 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:28:08.903929Z 41 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:28:17.008305Z 42 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:28:18.903900Z 43 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:28:27.007718Z 44 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:28:28.903292Z 45 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:28:37.007730Z 46 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:28:38.904854Z 47 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:28:47.008150Z 48 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:28:48.903566Z 49 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:28:57.008204Z 50 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:28:58.904491Z 51 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:29:07.008113Z 52 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:29:08.903532Z 53 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:29:17.008140Z 54 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:29:18.903356Z 55 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:29:27.007609Z 56 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:29:28.903302Z 57 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:29:37.009573Z 58 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:29:38.903471Z 59 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:29:47.007606Z 60 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:29:48.903709Z 61 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:29:57.008624Z 62 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:29:58.903309Z 63 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:30:07.007916Z 64 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:30:08.903930Z 65 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:30:17.007576Z 66 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:30:18.903552Z 67 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:30:27.007887Z 68 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:30:28.903885Z 69 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:30:37.008054Z 70 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:30:38.903555Z 71 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:30:47.008718Z 72 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:30:48.903960Z 73 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:30:57.007664Z 74 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:30:58.903974Z 75 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:31:07.007790Z 76 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:31:08.903244Z 77 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:31:17.007984Z 78 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:31:18.903327Z 79 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:31:27.007902Z 80 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:31:28.903337Z 81 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:31:37.007900Z 82 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:31:38.903671Z 83 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:31:47.007921Z 84 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:31:48.903492Z 85 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:31:57.011970Z 86 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:31:58.903462Z 87 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:32:07.007945Z 88 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:32:08.903119Z 89 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:32:17.007769Z 90 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:32:18.904688Z 91 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:32:27.008326Z 92 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:32:28.903236Z 93 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:32:37.007523Z 94 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:32:38.903221Z 95 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:32:47.008261Z 96 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:32:48.903414Z 97 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:32:57.007704Z 98 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:32:58.903935Z 99 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:33:07.007494Z 100 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:33:08.903879Z 101 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:33:17.008112Z 102 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:33:18.903361Z 103 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:33:27.008147Z 104 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:33:28.903465Z 105 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:33:37.007866Z 106 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:33:38.903291Z 107 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:33:47.007936Z 108 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:33:48.905818Z 109 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:33:57.008084Z 110 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:33:58.903435Z 111 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:34:07.008598Z 112 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:34:08.903844Z 113 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:34:17.007888Z 114 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:34:18.903631Z 115 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:34:27.008368Z 116 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:34:28.903157Z 117 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:34:37.007881Z 118 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:34:38.904010Z 119 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:34:47.008761Z 120 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:34:48.903115Z 121 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:34:57.007477Z 122 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:34:58.903178Z 123 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:35:07.008295Z 124 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:35:08.903549Z 125 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:35:17.008109Z 126 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:35:18.903081Z 127 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:35:27.007943Z 128 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:35:28.903801Z 129 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:35:37.007243Z 130 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:35:38.904088Z 131 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:35:47.007763Z 132 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:35:48.904054Z 133 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:35:57.007658Z 134 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:35:58.903905Z 135 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:36:07.009086Z 136 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:36:08.903742Z 137 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:36:17.009128Z 138 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:36:18.903316Z 139 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:36:27.007658Z 140 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:36:28.903784Z 141 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:36:37.007930Z 142 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:36:38.903454Z 143 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:36:47.008447Z 144 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:36:48.904096Z 145 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:36:57.007303Z 146 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:36:58.903984Z 147 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:37:07.007063Z 148 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:37:08.903772Z 149 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:37:17.008784Z 150 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:37:18.903918Z 151 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:37:27.007770Z 152 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:37:28.904057Z 153 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:37:37.007752Z 154 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:37:38.903964Z 155 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:37:47.007894Z 156 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:37:48.903853Z 157 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:37:57.008067Z 158 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:37:58.903866Z 159 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:38:07.007665Z 160 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:38:08.903830Z 161 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:38:17.007648Z 162 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:38:18.904620Z 163 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:38:27.008370Z 164 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:38:28.903518Z 165 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:38:37.007745Z 166 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:38:38.903825Z 167 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:38:47.007552Z 168 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:38:48.904209Z 169 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:38:57.007644Z 170 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:38:58.902967Z 171 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:39:07.007841Z 172 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:39:08.903318Z 173 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:39:17.007205Z 174 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:39:18.903322Z 175 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:39:27.007730Z 176 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:39:28.903870Z 177 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:39:37.007874Z 178 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:39:38.903550Z 179 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:39:47.009385Z 180 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:39:48.903373Z 181 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:39:57.008753Z 182 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:39:58.904106Z 183 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:40:07.007756Z 184 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:40:08.902900Z 185 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:40:17.007327Z 186 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:40:18.903442Z 187 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:40:27.008020Z 188 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:40:28.903321Z 189 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:40:37.008070Z 190 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:40:38.903562Z 191 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:40:47.008417Z 192 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:40:48.903990Z 193 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:40:57.007225Z 194 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:40:58.903175Z 195 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:41:07.008200Z 196 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:41:08.903793Z 197 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:41:17.007325Z 198 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:41:18.902942Z 199 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:41:27.007551Z 200 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:41:28.903131Z 201 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:41:37.008330Z 202 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:41:38.903372Z 203 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:41:47.008019Z 204 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:41:48.903509Z 205 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:41:57.008979Z 206 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:41:58.902810Z 207 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:42:07.007140Z 208 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:42:08.903160Z 209 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:42:17.007969Z 210 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:42:18.903155Z 211 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:42:27.007284Z 212 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:42:28.903637Z 213 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:42:37.007981Z 214 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:42:38.903358Z 215 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:42:47.008418Z 216 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:42:48.903737Z 217 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:42:57.007637Z 218 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:42:58.904222Z 219 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:43:07.007274Z 220 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:43:08.903511Z 221 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:43:17.008029Z 222 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:43:18.903974Z 223 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:43:27.007328Z 224 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:43:28.903656Z 225 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:43:37.007525Z 226 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:43:38.903749Z 227 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:43:47.007925Z 228 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:43:48.903441Z 229 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:43:57.008094Z 230 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:43:58.903965Z 231 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:44:07.007425Z 232 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:44:08.903600Z 233 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:44:17.007573Z 234 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:44:18.903688Z 235 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:44:27.007386Z 236 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:44:28.903682Z 237 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:44:37.008572Z 238 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:44:38.903158Z 239 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:44:47.007587Z 240 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:44:48.903848Z 241 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:44:57.008373Z 242 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:44:58.903139Z 243 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:45:07.007077Z 244 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:45:08.903756Z 245 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:45:17.008520Z 246 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:45:18.903163Z 247 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:45:27.007883Z 248 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:45:28.903964Z 249 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:45:37.007686Z 250 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:45:38.903933Z 251 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:45:47.007508Z 252 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:45:48.903924Z 253 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:45:57.012007Z 254 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:45:58.920553Z 255 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:46:07.011198Z 256 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:46:08.911994Z 257 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:46:17.009416Z 258 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:46:18.907946Z 259 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:46:27.007707Z 260 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:46:28.903707Z 261 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:46:37.008723Z 262 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:46:38.903935Z 263 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:46:47.009079Z 264 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:46:48.904960Z 265 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:46:57.007948Z 266 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:46:58.903036Z 267 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:47:07.007673Z 268 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:47:08.903669Z 269 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:47:17.007908Z 270 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:47:18.903576Z 271 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:47:27.007884Z 272 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:47:28.903704Z 273 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:47:37.007505Z 274 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:47:38.903826Z 275 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:47:47.007169Z 276 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:47:48.903973Z 277 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:47:57.013551Z 278 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:47:58.903833Z 279 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:48:07.008646Z 280 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:48:08.903659Z 281 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:48:17.008427Z 282 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:48:18.903005Z 283 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:48:27.007444Z 284 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:48:28.903597Z 285 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:48:37.008035Z 286 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:48:38.903729Z 287 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:48:47.007734Z 288 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:48:48.904004Z 289 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:48:57.007047Z 290 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:48:58.902916Z 291 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:49:07.006981Z 292 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:49:08.903216Z 293 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:49:17.007761Z 294 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:49:18.903470Z 295 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:49:27.008148Z 296 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:49:28.903593Z 297 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:49:37.008139Z 298 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:49:38.903785Z 299 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:49:47.007800Z 300 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:49:48.903689Z 301 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:49:57.008062Z 302 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:49:58.903117Z 303 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:50:07.007766Z 304 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:50:08.902922Z 305 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:50:17.008537Z 306 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:50:18.903424Z 307 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:50:27.007439Z 308 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:50:28.903169Z 309 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:50:37.008372Z 310 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:50:38.903474Z 311 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:50:47.007506Z 312 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:50:48.903787Z 313 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:50:57.008488Z 314 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:50:58.903561Z 315 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:51:07.007239Z 316 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:51:08.903508Z 317 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:51:17.007544Z 318 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:51:18.903371Z 319 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:51:27.008068Z 320 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:51:28.907241Z 321 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:51:37.007753Z 322 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:51:38.903738Z 323 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:51:47.008488Z 324 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:51:48.903858Z 325 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:51:57.007637Z 326 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:51:58.902836Z 327 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:52:07.007519Z 328 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:52:08.903005Z 329 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:52:17.007972Z 330 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:52:18.903498Z 331 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:52:27.007272Z 332 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:52:28.902863Z 333 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:52:37.007349Z 334 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:52:38.903145Z 335 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:52:47.008016Z 336 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:52:48.904936Z 337 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:52:57.007727Z 338 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:52:58.903758Z 339 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:53:07.007816Z 340 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:53:08.903568Z 341 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:53:17.007144Z 342 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:53:18.903478Z 343 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:53:27.008747Z 344 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:53:28.903168Z 345 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:53:37.008160Z 346 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:53:38.904028Z 347 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:53:47.007465Z 348 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:53:48.904249Z 349 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:53:57.008003Z 350 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-15T04:53:58.903356Z 351 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' ==================== WORKLOAD POD LOG: rhoai-model-registries/postgres-db-registry-1784089476971-7dc89bd7d4-sv6kq.log ==================== chmod: changing permissions of '/var/run/postgresql': Operation not permitted The files belonging to this database system will be owned by user "1000680000". This user must also own the server process. The database cluster will be initialized with locale "en_US.utf8". The default database encoding has accordingly been set to "UTF8". The default text search configuration will be set to "english". Data page checksums are disabled. fixing permissions on existing directory /var/lib/postgresql/data/pgdata ... ok creating subdirectories ... ok selecting dynamic shared memory implementation ... posix selecting default max_connections ... 100 selecting default shared_buffers ... 128MB selecting default time zone ... Etc/UTC creating configuration files ... ok running bootstrap script ... ok performing post-bootstrap initialization ... ok syncing data to disk ... ok Success. You can now start the database server using: pg_ctl -D /var/lib/postgresql/data/pgdata -l logfile start initdb: warning: enabling "trust" authentication for local connections initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. waiting for server to start....2026-07-15 04:25:43.202 UTC [30] LOG: starting PostgreSQL 16.14 (Debian 16.14-1.pgdg13+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 14.2.0-19) 14.2.0, 64-bit 2026-07-15 04:25:43.202 UTC [30] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432" 2026-07-15 04:25:43.213 UTC [33] LOG: database system was shut down at 2026-07-15 04:25:43 UTC 2026-07-15 04:25:43.219 UTC [30] LOG: database system is ready to accept connections done server started CREATE DATABASE /usr/local/bin/docker-entrypoint.sh: ignoring /docker-entrypoint-initdb.d/* waiting for server to shut down...2026-07-15 04:25:43.395 UTC [30] LOG: received fast shutdown request .2026-07-15 04:25:43.397 UTC [30] LOG: aborting any active transactions 2026-07-15 04:25:43.399 UTC [30] LOG: background worker "logical replication launcher" (PID 36) exited with exit code 1 2026-07-15 04:25:43.400 UTC [31] LOG: shutting down 2026-07-15 04:25:43.401 UTC [31] LOG: checkpoint starting: shutdown immediate 2026-07-15 04:25:43.442 UTC [31] LOG: checkpoint complete: wrote 926 buffers (5.7%); 0 WAL file(s) added, 0 removed, 0 recycled; write=0.029 s, sync=0.007 s, total=0.043 s; sync files=301, longest=0.003 s, average=0.001 s; distance=4273 kB, estimate=4273 kB; lsn=0/191F0F8, redo lsn=0/191F0F8 2026-07-15 04:25:43.447 UTC [30] LOG: database system is shut down done server stopped PostgreSQL init process complete; ready for start up. 2026-07-15 04:25:43.521 UTC [1] LOG: starting PostgreSQL 16.14 (Debian 16.14-1.pgdg13+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 14.2.0-19) 14.2.0, 64-bit 2026-07-15 04:25:43.522 UTC [1] LOG: listening on IPv4 address "0.0.0.0", port 5432 2026-07-15 04:25:43.522 UTC [1] LOG: listening on IPv6 address "::", port 5432 2026-07-15 04:25:43.525 UTC [1] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432" 2026-07-15 04:25:43.532 UTC [46] LOG: database system was shut down at 2026-07-15 04:25:43 UTC 2026-07-15 04:25:43.538 UTC [1] LOG: database system is ready to accept connections 2026-07-15 04:30:43.630 UTC [44] LOG: checkpoint starting: time 2026-07-15 04:30:47.856 UTC [44] LOG: checkpoint complete: wrote 45 buffers (0.3%); 0 WAL file(s) added, 0 removed, 0 recycled; write=4.212 s, sync=0.006 s, total=4.226 s; sync files=12, longest=0.004 s, average=0.001 s; distance=261 kB, estimate=261 kB; lsn=0/1960530, redo lsn=0/19604F8