==================== ISSUES SUMMARY ==================== ========== ODH/RHOAI ISSUES SUMMARY (status, events, highlights only) ========== 18m Warning InvalidConfiguration servicemonitor/controller-manager-metrics-monitor "redhat-ods-applications/controller-manager-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 18m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 111s Warning FailedToRetrieveImagePullSecret pod/maas-controller-85bdcf9988-ckcwv Unable to retrieve some image pull secrets (maas-controller-dockercfg-zj2bh); attempting to pull the image may not succeed. 8m31s Warning Deleting modelregistry/postgres-registry-1783918867047 Custom Resource postgres-registry-1783918867047 is being deleted from the namespace rhoai-model-registries 9m7s Warning Deleting modelregistry/e2e-test-registry Custom Resource e2e-test-registry is being deleted from the namespace rhoai-model-registries 9m6s Warning Deleting modelregistry/e2e-test-registry Custom Resource e2e-test-registry is being deleted from the namespace rhoai-model-registries 7m22s Warning Deleting modelregistry/default-db-registry-1783918867047 Custom Resource default-db-registry-1783918867047 is being deleted from the namespace rhoai-model-registries 5m37s Warning Deleting modelregistry/test-model-registry-662874 Custom Resource test-model-registry-662874 is being deleted from the namespace rhoai-model-registries 10m Warning Unhealthy pod/mysql-db-registry-1783918867047-84487f84fc-22f2p Readiness probe failed: mysql: [Warning] Using a password on the command line interface can be insecure.... 8m5s Warning Unhealthy pod/default-db-registry-1783918867047-7f557d6cb6-md4jr Startup probe failed: Get "http://10.129.71.136:8080/readyz/isDirty": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 8m3s Warning Unhealthy pod/default-db-registry-1783918867047-7f557d6cb6-md4jr Startup probe failed: HTTP probe failed with statuscode: 503 6m54s Warning Unhealthy pod/default-db-registry-1783918867047-postgres-56d4658969-486fm Readiness probe errored and resulted in unknown state: rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1 6m57s Warning FailedScheduling pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0 0/3 nodes are available: 3 Insufficient cpu. preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 6m52s Warning FailedScheduling pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0 0/3 nodes are available: 3 Insufficient cpu. preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 11m Warning FailedMount pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0 MountVolume.SetUp failed for volume "kube-rbac-proxy-tls-certificates" : secret "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-kube-rbac-proxy-tls" not found 11m Warning FailedMount notebook/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: MountVolume.SetUp failed for volume "kube-rbac-proxy-tls-certificates" : secret "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-kube-rbac-proxy-tls" not found 6m52s Warning FailedScheduling notebook/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: 0/3 nodes are available: 3 Insufficient cpu. preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. {"level":"error","ts":"2026-07-13T04:46:04Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:46:45Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:47:33Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:48:27Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:49:10Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:50:01Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:50:49Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:51:35Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:52:19Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:52:52Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:53:30Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:54:20Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:55:13Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:56:12Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:57:11Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:58:02Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:58:44Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:59:16Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:00:00Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:00:53Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:01:37Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:02:24Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:03:10Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:04:00Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:04:55Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:05:33Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:06:26Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:07:22Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:08:03Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:09:03Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:09:52Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:10:42Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:11:16Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} --------------------------------------------------------------------------------------------------- ==================== STATUS REPORT ==================== ========== ODH/RHOAI STATUS REPORT (2026-07-13T05:11:49Z) ========== --- OpenShift / OCP version --- Client Version: 4.20.8 Kustomize Version: v5.6.0 Server Version: 4.20.12 Kubernetes Version: v1.33.6 --- Namespaces --- namespace/redhat-ods-applications namespace/redhat-ods-monitoring namespace/redhat-ods-operator namespace/rhoai-model-registries namespace/rhods-notebooks --- Subscriptions (redhat-ods-operator) --- NAME PACKAGE SOURCE CHANNEL rhods-operator rhods-operator rhoai-catalog-dev beta Subscription conditions (unhealthy): CatalogSourcesUnhealthy: status=False reason=AllCatalogSourcesHealthy message=all available catalogsources are healthy --- ClusterServiceVersions (redhat-ods-operator) --- NAME DISPLAY VERSION REPLACES PHASE authorino-operator.v1.4.1 Authorino Operator 1.4.1 authorino-operator.v1.3.2 Succeeded cert-manager-operator.v1.20.0 cert-manager Operator for Red Hat OpenShift 1.20.0 cert-manager-operator.v1.19.0 Succeeded custom-metrics-autoscaler.v2.19.0-1 Custom Metrics Autoscaler 2.19.0-1 custom-metrics-autoscaler.v2.18.1-2 Succeeded dns-operator.v1.4.0 DNS Operator 1.4.0 dns-operator.v1.3.1 Succeeded kueue-operator.v1.3.1 Red Hat build of Kueue 1.3.1 Succeeded limitador-operator.v1.4.0 Limitador Operator 1.4.0 limitador-operator.v1.3.1 Succeeded rhcl-operator.v1.4.1 Red Hat Connectivity Link 1.4.1 rhcl-operator.v1.3.5 Succeeded rhods-operator.3.5.0-ea.2 Red Hat OpenShift AI 3.5.0-ea.2 Succeeded servicemeshoperator3.v3.1.0 Red Hat OpenShift Service Mesh 3 3.1.0 servicemeshoperator3.v3.0.13 Pending --- CSVs not in Succeeded phase --- servicemeshoperator3.v3.1.0: phase=Pending reason=Copied message=The operator is running in openshift-operators but is managing this namespace --- InstallPlans (redhat-ods-operator, not Complete) --- (no non-Complete InstallPlans) --- DataScienceCluster --- NAME READY REASON default-dsc True DSC Ready summary: True reason= DSC component states: aigateway: managementState=n/a aipipelines: managementState=Managed dashboard: managementState=Managed feastoperator: managementState=Managed kserve: managementState=Managed kueue: managementState=Unmanaged llamastackoperator: managementState=n/a mlflowoperator: managementState=Managed modelregistry: managementState=Managed ogx: managementState=Removed ray: managementState=Managed sparkoperator: managementState=Managed trainer: managementState=Managed trainingoperator: managementState=Managed trustyai: managementState=Managed workbenches: managementState=Managed DSC conditions: Ready: status=True reason= message= ProvisioningSucceeded: status=True reason= message= ComponentsReady: status=True reason= message= AIPipelinesReady: status=True reason= message= DashboardReady: status=True reason= message= FeastOperatorReady: status=True reason= message= KserveLLMInferenceServiceDependencies: status=True reason= message= KserveLLMInferenceServiceWideEPDependencies: status=True reason= message= KserveReady: status=True reason= message= KueueReady: status=True reason= message= LLM-D-WVADependencies: status=True reason= message= MLflowOperatorReady: status=True reason= message= MaaSPrerequisitesAvailable: status=False reason=MaaSPrerequisitesNotMet message=maas-default-gateway is missing required annotations: security.opendatahub.io/authorino-tls-bootstrap="true" ModelControllerReady: status=True reason= message= ModelRegistryReady: status=True reason= message= ModelsAsServiceReady: status=True reason=Reconciled message=MaaS platform manifests applied and maas-api deployment is available OGXReady: status=False reason=Removed message=Component ManagementState is set to Removed RayReady: status=True reason= message= SparkOperatorReady: status=True reason= message= TrainerReady: status=True reason= message= TrainingOperatorReady: status=True reason= message= TrustyAIReady: status=True reason= message= WorkbenchesReady: status=True reason= message= --- DSCInitialization --- NAME AGE PHASE CREATED AT default-dsci 11h Ready 2026-07-12T17:42:29Z DSCInitialization conditions: ReconcileComplete: status=True reason=ReconcileCompleted message=Reconcile completed successfully Available: status=True reason=ReconcileCompleted message=Reconcile completed successfully Progressing: status=False reason=ReconcileCompleted message=Reconcile completed successfully Degraded: status=False reason=ReconcileCompleted message=Reconcile completed successfully Upgradeable: status=True reason=ReconcileCompleted message=Reconcile completed successfully MonitoringReady: status=True reason=Ready message=Monitoring stack is initialized Ready: status=True reason= message= ProvisioningSucceeded: status=True reason= message= MonitoringStackAvailable: status=False reason=MetricsNotConfigured message=Metrics not configured in DSCI CR TempoAvailable: status=False reason=TracesNotConfigured message=Traces not configured in DSCI CR OpenTelemetryCollectorAvailable: status=False reason=MetricsNotConfiguredAndTracesNotConfigured message=Metrics not configured in DSCI CR Traces not configured in DSCI CR AlertingAvailable: status=False reason=AlertingNotConfigured message=Alerting not configured in DSCI CR ThanosQuerierAvailable: status=False reason=MetricsNotConfigured message=Metrics not configured in DSCI CR PersesAvailable: status=False reason=MetricsNotConfiguredAndTracesNotConfigured message=Perses requires at least Metrics or Traces to be configured NodeMetricsEndpointAvailable: status=False reason=MetricsNotConfigured message=Metrics not configured in DSCI CR --- Component CRs (Ready) --- NAME READY REASON URL dashboard.components.platform.opendatahub.io/default-dashboard True NAME READY REASON datasciencepipelines.components.platform.opendatahub.io/default-datasciencepipelines True NAME READY REASON feastoperator.components.platform.opendatahub.io/default-feastoperator True NAME READY REASON kserve.components.platform.opendatahub.io/default-kserve True NAME READY REASON kueue.components.platform.opendatahub.io/default-kueue True NAME READY REASON mlflowoperator.components.platform.opendatahub.io/default-mlflowoperator True NAME READY REASON URI modelcontroller.components.platform.opendatahub.io/default-modelcontroller True NAME READY REASON modelregistry.components.platform.opendatahub.io/default-modelregistry True NAME READY REASON modelsasservice.components.platform.opendatahub.io/default-modelsasservice True NAME READY REASON ray.components.platform.opendatahub.io/default-ray True NAME READY REASON sparkoperator.components.platform.opendatahub.io/default-sparkoperator True NAME READY REASON trainer.components.platform.opendatahub.io/default-trainer True NAME READY REASON trainingoperator.components.platform.opendatahub.io/default-trainingoperator True NAME READY REASON trustyai.components.platform.opendatahub.io/default-trustyai True NAME READY REASON workbenches.components.platform.opendatahub.io/default-workbenches True --- Deployments not fully ready (ODH/RHOAI namespaces) --- (all deployments report ready replicas == desired) --- Pods not Running/Succeeded (ODH/RHOAI namespaces) --- (all pods Running or Succeeded) --------------------------------------------------------------------------------------------------- ==================== EVENTS ==================== ========== ODH/RHOAI EVENTS (Warning / Error / Failed) ========== --- namespace/redhat-ods-applications --- LAST SEEN TYPE REASON OBJECT MESSAGE 18m Warning InvalidConfiguration servicemonitor/controller-manager-metrics-monitor "redhat-ods-applications/controller-manager-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 18m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 111s Warning FailedToRetrieveImagePullSecret pod/maas-controller-85bdcf9988-ckcwv Unable to retrieve some image pull secrets (maas-controller-dockercfg-zj2bh); attempting to pull the image may not succeed. --- namespace/redhat-ods-monitoring --- (no events) --- namespace/redhat-ods-operator --- (no events) --- namespace/rhoai-model-registries --- LAST SEEN TYPE REASON OBJECT MESSAGE 8m31s Warning Deleting modelregistry/postgres-registry-1783918867047 Custom Resource postgres-registry-1783918867047 is being deleted from the namespace rhoai-model-registries 9m7s Warning Deleting modelregistry/e2e-test-registry Custom Resource e2e-test-registry is being deleted from the namespace rhoai-model-registries 9m6s Warning Deleting modelregistry/e2e-test-registry Custom Resource e2e-test-registry is being deleted from the namespace rhoai-model-registries 7m22s Warning Deleting modelregistry/default-db-registry-1783918867047 Custom Resource default-db-registry-1783918867047 is being deleted from the namespace rhoai-model-registries 5m37s Warning Deleting modelregistry/test-model-registry-662874 Custom Resource test-model-registry-662874 is being deleted from the namespace rhoai-model-registries 10m Warning Unhealthy pod/mysql-db-registry-1783918867047-84487f84fc-22f2p Readiness probe failed: mysql: [Warning] Using a password on the command line interface can be insecure.... 8m5s Warning Unhealthy pod/default-db-registry-1783918867047-7f557d6cb6-md4jr Startup probe failed: Get "http://10.129.71.136:8080/readyz/isDirty": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 8m3s Warning Unhealthy pod/default-db-registry-1783918867047-7f557d6cb6-md4jr Startup probe failed: HTTP probe failed with statuscode: 503 6m54s Warning Unhealthy pod/default-db-registry-1783918867047-postgres-56d4658969-486fm Readiness probe errored and resulted in unknown state: rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1 --- namespace/rhods-notebooks --- LAST SEEN TYPE REASON OBJECT MESSAGE 6m57s Warning FailedScheduling pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0 0/3 nodes are available: 3 Insufficient cpu. preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 6m52s Warning FailedScheduling pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0 0/3 nodes are available: 3 Insufficient cpu. preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 11m Warning FailedMount pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0 MountVolume.SetUp failed for volume "kube-rbac-proxy-tls-certificates" : secret "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-kube-rbac-proxy-tls" not found 11m Warning FailedMount notebook/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: MountVolume.SetUp failed for volume "kube-rbac-proxy-tls-certificates" : secret "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-kube-rbac-proxy-tls" not found 6m52s Warning FailedScheduling notebook/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: 0/3 nodes are available: 3 Insufficient cpu. preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. --------------------------------------------------------------------------------------------------- ==================== OPERATOR LOG HIGHLIGHTS ==================== ========== ODH/RHOAI LOG HIGHLIGHTS (errors, webhooks, reconcile failures) ========== Source: rhods-operator pods in redhat-ods-operator (since-time=2026-07-13T04:45:59Z) --- redhat-ods-operator/rhods-operator-56f596f98f-7qpq4 --- {"level":"error","ts":"2026-07-13T04:46:04Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:46:45Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:47:33Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:48:27Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:49:10Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:50:01Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:50:49Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:51:35Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:52:19Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:52:52Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:53:30Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:54:20Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:55:13Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:56:12Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:57:11Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:58:02Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:58:44Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:59:16Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:00:00Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:00:53Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:01:37Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:02:24Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:03:10Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:04:00Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:04:55Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:05:33Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:06:26Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:07:22Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:08:03Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:09:03Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:09:52Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:10:42Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:11:16Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} --------------------------------------------------------------------------------------------------- ==================== OPERATOR POD LOG: rhods-operator-56f596f98f-4pk47.log ==================== ==================== OPERATOR POD LOG: rhods-operator-56f596f98f-7qpq4.log ==================== {"level":"error","ts":"2026-07-13T04:46:04Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T04:46:17Z","logger":"controller-runtime.cache","msg":"Warning: This version is deprecated. Use v1beta2 instead."} {"level":"error","ts":"2026-07-13T04:46:45Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T04:47:15Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcea72ea-0a57-43dc-941e-0724e135073a"} {"level":"info","ts":"2026-07-13T04:47:15Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcea72ea-0a57-43dc-941e-0724e135073a"} {"level":"info","ts":"2026-07-13T04:47:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcea72ea-0a57-43dc-941e-0724e135073a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:47:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcea72ea-0a57-43dc-941e-0724e135073a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T04:47:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcea72ea-0a57-43dc-941e-0724e135073a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T04:47:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcea72ea-0a57-43dc-941e-0724e135073a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T04:47:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcea72ea-0a57-43dc-941e-0724e135073a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T04:47:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcea72ea-0a57-43dc-941e-0724e135073a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T04:47:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcea72ea-0a57-43dc-941e-0724e135073a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T04:47:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcea72ea-0a57-43dc-941e-0724e135073a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T04:47:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcea72ea-0a57-43dc-941e-0724e135073a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T04:47:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcea72ea-0a57-43dc-941e-0724e135073a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T04:47:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcea72ea-0a57-43dc-941e-0724e135073a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T04:47:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcea72ea-0a57-43dc-941e-0724e135073a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:47:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcea72ea-0a57-43dc-941e-0724e135073a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:47:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcea72ea-0a57-43dc-941e-0724e135073a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T04:47:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcea72ea-0a57-43dc-941e-0724e135073a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:47:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcea72ea-0a57-43dc-941e-0724e135073a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:47:15Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"630f90c3-83ed-4df9-82bb-d07f271afb4a","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T04:47:15Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"630f90c3-83ed-4df9-82bb-d07f271afb4a","name":"redhat-ods-applications"} {"level":"error","ts":"2026-07-13T04:47:33Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"135a6176-1143-417e-b372-4d1be015122b"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"apply","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"135a6176-1143-417e-b372-4d1be015122b"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"135a6176-1143-417e-b372-4d1be015122b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ogx.initialize"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"135a6176-1143-417e-b372-4d1be015122b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ogx.checkPreConditions"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"135a6176-1143-417e-b372-4d1be015122b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"135a6176-1143-417e-b372-4d1be015122b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b2901502-e63a-4fff-b114-12b2c899324b"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b2901502-e63a-4fff-b114-12b2c899324b"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b2901502-e63a-4fff-b114-12b2c899324b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b2901502-e63a-4fff-b114-12b2c899324b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b2901502-e63a-4fff-b114-12b2c899324b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"135a6176-1143-417e-b372-4d1be015122b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b2901502-e63a-4fff-b114-12b2c899324b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"135a6176-1143-417e-b372-4d1be015122b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"135a6176-1143-417e-b372-4d1be015122b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"135a6176-1143-417e-b372-4d1be015122b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"b358e2db-c1fd-4f59-a4f6-cc3dee2b32cb"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"apply","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"b358e2db-c1fd-4f59-a4f6-cc3dee2b32cb"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"b358e2db-c1fd-4f59-a4f6-cc3dee2b32cb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ogx.initialize"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"b358e2db-c1fd-4f59-a4f6-cc3dee2b32cb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ogx.checkPreConditions"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"b358e2db-c1fd-4f59-a4f6-cc3dee2b32cb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"b358e2db-c1fd-4f59-a4f6-cc3dee2b32cb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"b358e2db-c1fd-4f59-a4f6-cc3dee2b32cb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"b358e2db-c1fd-4f59-a4f6-cc3dee2b32cb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"b358e2db-c1fd-4f59-a4f6-cc3dee2b32cb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:47:36Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"b358e2db-c1fd-4f59-a4f6-cc3dee2b32cb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:47:37Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b2901502-e63a-4fff-b114-12b2c899324b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:47:37Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b2901502-e63a-4fff-b114-12b2c899324b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:47:37Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"b2901502-e63a-4fff-b114-12b2c899324b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-13T04:48:27Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:49:10Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:50:01Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T04:50:37Z","logger":"controller-runtime.cache","msg":"Warning: This version is deprecated. Use v1beta2 instead."} {"level":"error","ts":"2026-07-13T04:50:49Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T04:50:59Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5478d77c-a77b-44d7-8b48-5851100a447e"} {"level":"info","ts":"2026-07-13T04:50:59Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5478d77c-a77b-44d7-8b48-5851100a447e"} {"level":"info","ts":"2026-07-13T04:50:59Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"2ee88ec5-8c7b-465d-8a91-3a8fce00924a"} {"level":"info","ts":"2026-07-13T04:50:59Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"2ee88ec5-8c7b-465d-8a91-3a8fce00924a"} {"level":"info","ts":"2026-07-13T04:50:59Z","msg":"Pre-condition skipped by runtime predicate","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"2ee88ec5-8c7b-465d-8a91-3a8fce00924a","conditionType":"LLM-D-WVADependencies"} {"level":"info","ts":"2026-07-13T04:50:59Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"2ee88ec5-8c7b-465d-8a91-3a8fce00924a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-13T04:50:59Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"2ee88ec5-8c7b-465d-8a91-3a8fce00924a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:50:59Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"2ee88ec5-8c7b-465d-8a91-3a8fce00924a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:50:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5478d77c-a77b-44d7-8b48-5851100a447e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-13T04:50:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5478d77c-a77b-44d7-8b48-5851100a447e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:50:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5478d77c-a77b-44d7-8b48-5851100a447e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-13T04:50:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5478d77c-a77b-44d7-8b48-5851100a447e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-13T04:50:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5478d77c-a77b-44d7-8b48-5851100a447e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:50:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5478d77c-a77b-44d7-8b48-5851100a447e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-13T04:50:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5478d77c-a77b-44d7-8b48-5851100a447e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T04:50:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5478d77c-a77b-44d7-8b48-5851100a447e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:00Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"2ee88ec5-8c7b-465d-8a91-3a8fce00924a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:00Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"2ee88ec5-8c7b-465d-8a91-3a8fce00924a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:00Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"2ee88ec5-8c7b-465d-8a91-3a8fce00924a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:51:00Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"bfcbc4bf-6d1d-4021-bfcc-c8f72584950f"} {"level":"info","ts":"2026-07-13T04:51:00Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"bfcbc4bf-6d1d-4021-bfcc-c8f72584950f"} {"level":"info","ts":"2026-07-13T04:51:00Z","msg":"Pre-condition skipped by runtime predicate","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"bfcbc4bf-6d1d-4021-bfcc-c8f72584950f","conditionType":"LLM-D-WVADependencies"} {"level":"info","ts":"2026-07-13T04:51:00Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"bfcbc4bf-6d1d-4021-bfcc-c8f72584950f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-13T04:51:00Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"bfcbc4bf-6d1d-4021-bfcc-c8f72584950f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:00Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"bfcbc4bf-6d1d-4021-bfcc-c8f72584950f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:00Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"bfcbc4bf-6d1d-4021-bfcc-c8f72584950f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:00Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"bfcbc4bf-6d1d-4021-bfcc-c8f72584950f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:00Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"bfcbc4bf-6d1d-4021-bfcc-c8f72584950f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:51:07Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"bb697a38-6a9e-43d0-8f23-0ab5cb80c8df"} {"level":"info","ts":"2026-07-13T04:51:07Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"bb697a38-6a9e-43d0-8f23-0ab5cb80c8df"} {"level":"info","ts":"2026-07-13T04:51:07Z","msg":"Pre-condition skipped by runtime predicate","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"bb697a38-6a9e-43d0-8f23-0ab5cb80c8df","conditionType":"LLM-D-WVADependencies"} {"level":"info","ts":"2026-07-13T04:51:07Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"bb697a38-6a9e-43d0-8f23-0ab5cb80c8df","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-13T04:51:07Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"bb697a38-6a9e-43d0-8f23-0ab5cb80c8df","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:07Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"bb697a38-6a9e-43d0-8f23-0ab5cb80c8df","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:07Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"bb697a38-6a9e-43d0-8f23-0ab5cb80c8df","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:07Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"bb697a38-6a9e-43d0-8f23-0ab5cb80c8df","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:07Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"bb697a38-6a9e-43d0-8f23-0ab5cb80c8df","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:51:07Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"abcf7287-94f0-4c08-ab4d-aa685a7c07d6"} {"level":"info","ts":"2026-07-13T04:51:07Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"abcf7287-94f0-4c08-ab4d-aa685a7c07d6"} {"level":"info","ts":"2026-07-13T04:51:07Z","msg":"Pre-condition skipped by runtime predicate","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"abcf7287-94f0-4c08-ab4d-aa685a7c07d6","conditionType":"LLM-D-WVADependencies"} {"level":"info","ts":"2026-07-13T04:51:07Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"abcf7287-94f0-4c08-ab4d-aa685a7c07d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-13T04:51:07Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"abcf7287-94f0-4c08-ab4d-aa685a7c07d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:07Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"abcf7287-94f0-4c08-ab4d-aa685a7c07d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:07Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"abcf7287-94f0-4c08-ab4d-aa685a7c07d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:07Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"abcf7287-94f0-4c08-ab4d-aa685a7c07d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:07Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"abcf7287-94f0-4c08-ab4d-aa685a7c07d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:51:09Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5478d77c-a77b-44d7-8b48-5851100a447e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-13T04:51:09Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5478d77c-a77b-44d7-8b48-5851100a447e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:09Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5478d77c-a77b-44d7-8b48-5851100a447e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:09Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5478d77c-a77b-44d7-8b48-5851100a447e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:51:09Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ffd1c521-cb6f-44df-b108-e6c7269bb5be"} {"level":"info","ts":"2026-07-13T04:51:09Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ffd1c521-cb6f-44df-b108-e6c7269bb5be"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ffd1c521-cb6f-44df-b108-e6c7269bb5be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ffd1c521-cb6f-44df-b108-e6c7269bb5be","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ffd1c521-cb6f-44df-b108-e6c7269bb5be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ffd1c521-cb6f-44df-b108-e6c7269bb5be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ffd1c521-cb6f-44df-b108-e6c7269bb5be","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ffd1c521-cb6f-44df-b108-e6c7269bb5be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ffd1c521-cb6f-44df-b108-e6c7269bb5be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ffd1c521-cb6f-44df-b108-e6c7269bb5be","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ffd1c521-cb6f-44df-b108-e6c7269bb5be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ffd1c521-cb6f-44df-b108-e6c7269bb5be","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ffd1c521-cb6f-44df-b108-e6c7269bb5be","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"ffd1c521-cb6f-44df-b108-e6c7269bb5be","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"4cede36f-1923-4afb-9934-9ece8fef61ed"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"4cede36f-1923-4afb-9934-9ece8fef61ed"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"4cede36f-1923-4afb-9934-9ece8fef61ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"4cede36f-1923-4afb-9934-9ece8fef61ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"4cede36f-1923-4afb-9934-9ece8fef61ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"4cede36f-1923-4afb-9934-9ece8fef61ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"4cede36f-1923-4afb-9934-9ece8fef61ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"4cede36f-1923-4afb-9934-9ece8fef61ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"4cede36f-1923-4afb-9934-9ece8fef61ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T04:51:10Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"4cede36f-1923-4afb-9934-9ece8fef61ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:11Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"4cede36f-1923-4afb-9934-9ece8fef61ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-13T04:51:11Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"4cede36f-1923-4afb-9934-9ece8fef61ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:11Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"4cede36f-1923-4afb-9934-9ece8fef61ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:11Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"4cede36f-1923-4afb-9934-9ece8fef61ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:51:11Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"62ba0598-1abf-4b67-98be-316afa7e1308"} {"level":"info","ts":"2026-07-13T04:51:11Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"62ba0598-1abf-4b67-98be-316afa7e1308"} {"level":"info","ts":"2026-07-13T04:51:11Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"62ba0598-1abf-4b67-98be-316afa7e1308","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-13T04:51:11Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"62ba0598-1abf-4b67-98be-316afa7e1308","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:11Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"62ba0598-1abf-4b67-98be-316afa7e1308","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-13T04:51:11Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"62ba0598-1abf-4b67-98be-316afa7e1308","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-13T04:51:11Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"62ba0598-1abf-4b67-98be-316afa7e1308","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:11Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"62ba0598-1abf-4b67-98be-316afa7e1308","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-13T04:51:11Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"62ba0598-1abf-4b67-98be-316afa7e1308","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T04:51:11Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"62ba0598-1abf-4b67-98be-316afa7e1308","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:11Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"62ba0598-1abf-4b67-98be-316afa7e1308","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-13T04:51:11Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"62ba0598-1abf-4b67-98be-316afa7e1308","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:11Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"62ba0598-1abf-4b67-98be-316afa7e1308","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:11Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"62ba0598-1abf-4b67-98be-316afa7e1308","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2d85b0ff-b906-4afa-b23d-948169d8e845"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2d85b0ff-b906-4afa-b23d-948169d8e845"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"ca2cc42d-734a-4989-9416-ddd0f97b8a75"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"ca2cc42d-734a-4989-9416-ddd0f97b8a75"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Pre-condition skipped by runtime predicate","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"ca2cc42d-734a-4989-9416-ddd0f97b8a75","conditionType":"LLM-D-WVADependencies"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"ca2cc42d-734a-4989-9416-ddd0f97b8a75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"ca2cc42d-734a-4989-9416-ddd0f97b8a75","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"ca2cc42d-734a-4989-9416-ddd0f97b8a75","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"ca2cc42d-734a-4989-9416-ddd0f97b8a75","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"ca2cc42d-734a-4989-9416-ddd0f97b8a75","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"ca2cc42d-734a-4989-9416-ddd0f97b8a75","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"9d2b2cfe-dd08-403e-aba0-5460b0acb253"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"9d2b2cfe-dd08-403e-aba0-5460b0acb253"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Pre-condition skipped by runtime predicate","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"9d2b2cfe-dd08-403e-aba0-5460b0acb253","conditionType":"LLM-D-WVADependencies"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"9d2b2cfe-dd08-403e-aba0-5460b0acb253","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"9d2b2cfe-dd08-403e-aba0-5460b0acb253","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"9d2b2cfe-dd08-403e-aba0-5460b0acb253","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"9d2b2cfe-dd08-403e-aba0-5460b0acb253","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"9d2b2cfe-dd08-403e-aba0-5460b0acb253","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"9d2b2cfe-dd08-403e-aba0-5460b0acb253","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2d85b0ff-b906-4afa-b23d-948169d8e845","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2d85b0ff-b906-4afa-b23d-948169d8e845","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2d85b0ff-b906-4afa-b23d-948169d8e845","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2d85b0ff-b906-4afa-b23d-948169d8e845","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2d85b0ff-b906-4afa-b23d-948169d8e845","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2d85b0ff-b906-4afa-b23d-948169d8e845","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2d85b0ff-b906-4afa-b23d-948169d8e845","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T04:51:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2d85b0ff-b906-4afa-b23d-948169d8e845","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2d85b0ff-b906-4afa-b23d-948169d8e845","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-13T04:51:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2d85b0ff-b906-4afa-b23d-948169d8e845","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2d85b0ff-b906-4afa-b23d-948169d8e845","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2d85b0ff-b906-4afa-b23d-948169d8e845","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:51:15Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f2f538e1-f6be-463b-8621-cd94a81abc2d"} {"level":"info","ts":"2026-07-13T04:51:15Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f2f538e1-f6be-463b-8621-cd94a81abc2d"} {"level":"info","ts":"2026-07-13T04:51:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f2f538e1-f6be-463b-8621-cd94a81abc2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-13T04:51:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f2f538e1-f6be-463b-8621-cd94a81abc2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f2f538e1-f6be-463b-8621-cd94a81abc2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-13T04:51:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f2f538e1-f6be-463b-8621-cd94a81abc2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-13T04:51:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f2f538e1-f6be-463b-8621-cd94a81abc2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f2f538e1-f6be-463b-8621-cd94a81abc2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-13T04:51:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f2f538e1-f6be-463b-8621-cd94a81abc2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T04:51:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f2f538e1-f6be-463b-8621-cd94a81abc2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f2f538e1-f6be-463b-8621-cd94a81abc2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f2f538e1-f6be-463b-8621-cd94a81abc2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f2f538e1-f6be-463b-8621-cd94a81abc2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f2f538e1-f6be-463b-8621-cd94a81abc2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"03b29e0a-b3bd-4ab9-8c4e-e2f68d053628"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"03b29e0a-b3bd-4ab9-8c4e-e2f68d053628"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"03b29e0a-b3bd-4ab9-8c4e-e2f68d053628","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"03b29e0a-b3bd-4ab9-8c4e-e2f68d053628","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"03b29e0a-b3bd-4ab9-8c4e-e2f68d053628","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"03b29e0a-b3bd-4ab9-8c4e-e2f68d053628","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"03b29e0a-b3bd-4ab9-8c4e-e2f68d053628","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"03b29e0a-b3bd-4ab9-8c4e-e2f68d053628","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"03b29e0a-b3bd-4ab9-8c4e-e2f68d053628","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"03b29e0a-b3bd-4ab9-8c4e-e2f68d053628","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"03b29e0a-b3bd-4ab9-8c4e-e2f68d053628","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"03b29e0a-b3bd-4ab9-8c4e-e2f68d053628","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"03b29e0a-b3bd-4ab9-8c4e-e2f68d053628","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"03b29e0a-b3bd-4ab9-8c4e-e2f68d053628","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"975d8d7c-3f7d-423e-ae4e-aec1e81a7e43"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"975d8d7c-3f7d-423e-ae4e-aec1e81a7e43"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"975d8d7c-3f7d-423e-ae4e-aec1e81a7e43","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"975d8d7c-3f7d-423e-ae4e-aec1e81a7e43","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"975d8d7c-3f7d-423e-ae4e-aec1e81a7e43","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"975d8d7c-3f7d-423e-ae4e-aec1e81a7e43","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"975d8d7c-3f7d-423e-ae4e-aec1e81a7e43","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"975d8d7c-3f7d-423e-ae4e-aec1e81a7e43","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"975d8d7c-3f7d-423e-ae4e-aec1e81a7e43","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T04:51:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"975d8d7c-3f7d-423e-ae4e-aec1e81a7e43","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:17Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"975d8d7c-3f7d-423e-ae4e-aec1e81a7e43","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-13T04:51:17Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"975d8d7c-3f7d-423e-ae4e-aec1e81a7e43","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:17Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"975d8d7c-3f7d-423e-ae4e-aec1e81a7e43","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:17Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"975d8d7c-3f7d-423e-ae4e-aec1e81a7e43","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:51:17Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"37020286-10f4-4f05-9b82-f9b651504acf"} {"level":"info","ts":"2026-07-13T04:51:17Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"37020286-10f4-4f05-9b82-f9b651504acf"} {"level":"info","ts":"2026-07-13T04:51:17Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"37020286-10f4-4f05-9b82-f9b651504acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-13T04:51:17Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"37020286-10f4-4f05-9b82-f9b651504acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:17Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"37020286-10f4-4f05-9b82-f9b651504acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-13T04:51:17Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"37020286-10f4-4f05-9b82-f9b651504acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-13T04:51:17Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"37020286-10f4-4f05-9b82-f9b651504acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:17Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"37020286-10f4-4f05-9b82-f9b651504acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-13T04:51:17Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"37020286-10f4-4f05-9b82-f9b651504acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T04:51:17Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"37020286-10f4-4f05-9b82-f9b651504acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:17Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"37020286-10f4-4f05-9b82-f9b651504acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-13T04:51:17Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"37020286-10f4-4f05-9b82-f9b651504acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:17Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"37020286-10f4-4f05-9b82-f9b651504acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:17Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"37020286-10f4-4f05-9b82-f9b651504acf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:51:17Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"45e4e49c-e6e4-428e-b309-39bb2ba37103"} {"level":"info","ts":"2026-07-13T04:51:17Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"45e4e49c-e6e4-428e-b309-39bb2ba37103"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"45e4e49c-e6e4-428e-b309-39bb2ba37103","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"45e4e49c-e6e4-428e-b309-39bb2ba37103","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"45e4e49c-e6e4-428e-b309-39bb2ba37103","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"45e4e49c-e6e4-428e-b309-39bb2ba37103","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"45e4e49c-e6e4-428e-b309-39bb2ba37103","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"45e4e49c-e6e4-428e-b309-39bb2ba37103","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"45e4e49c-e6e4-428e-b309-39bb2ba37103","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"45e4e49c-e6e4-428e-b309-39bb2ba37103","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"45e4e49c-e6e4-428e-b309-39bb2ba37103","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"45e4e49c-e6e4-428e-b309-39bb2ba37103","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"45e4e49c-e6e4-428e-b309-39bb2ba37103","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"45e4e49c-e6e4-428e-b309-39bb2ba37103","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"c7bdd6bb-6384-4db5-b4cf-92b41611ea54"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"c7bdd6bb-6384-4db5-b4cf-92b41611ea54"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"c7bdd6bb-6384-4db5-b4cf-92b41611ea54","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"c7bdd6bb-6384-4db5-b4cf-92b41611ea54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"c7bdd6bb-6384-4db5-b4cf-92b41611ea54","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"c7bdd6bb-6384-4db5-b4cf-92b41611ea54","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"c7bdd6bb-6384-4db5-b4cf-92b41611ea54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"c7bdd6bb-6384-4db5-b4cf-92b41611ea54","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"c7bdd6bb-6384-4db5-b4cf-92b41611ea54","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T04:51:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"c7bdd6bb-6384-4db5-b4cf-92b41611ea54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:19Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"c7bdd6bb-6384-4db5-b4cf-92b41611ea54","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-13T04:51:19Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"c7bdd6bb-6384-4db5-b4cf-92b41611ea54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:19Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"c7bdd6bb-6384-4db5-b4cf-92b41611ea54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:51:19Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"c7bdd6bb-6384-4db5-b4cf-92b41611ea54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-13T04:51:35Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:52:19Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:52:52Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:53:30Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:54:20Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T04:54:49Z","logger":"controller-runtime.cache","msg":"Warning: This version is deprecated. Use v1beta2 instead."} {"level":"info","ts":"2026-07-13T04:54:58Z","logger":"controller-runtime.cache","msg":"Warning: This version is deprecated. Use v1beta2 instead."} {"level":"error","ts":"2026-07-13T04:55:13Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:56:12Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:57:11Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"08fa8a07-8599-407f-b02f-566998b5ab52"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"08fa8a07-8599-407f-b02f-566998b5ab52"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"08fa8a07-8599-407f-b02f-566998b5ab52","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"08fa8a07-8599-407f-b02f-566998b5ab52","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a3010cf3-8303-4251-bc24-edf0b1f1dad5"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a3010cf3-8303-4251-bc24-edf0b1f1dad5"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"08fa8a07-8599-407f-b02f-566998b5ab52","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a3010cf3-8303-4251-bc24-edf0b1f1dad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a3010cf3-8303-4251-bc24-edf0b1f1dad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a3010cf3-8303-4251-bc24-edf0b1f1dad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a3010cf3-8303-4251-bc24-edf0b1f1dad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a3010cf3-8303-4251-bc24-edf0b1f1dad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a3010cf3-8303-4251-bc24-edf0b1f1dad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a3010cf3-8303-4251-bc24-edf0b1f1dad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a3010cf3-8303-4251-bc24-edf0b1f1dad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a3010cf3-8303-4251-bc24-edf0b1f1dad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"reconcile","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"59f7a05d-eba2-48b8-8912-689ad21713f6"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"apply","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"59f7a05d-eba2-48b8-8912-689ad21713f6"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"59f7a05d-eba2-48b8-8912-689ad21713f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.initializeModules"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"59f7a05d-eba2-48b8-8912-689ad21713f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.cleanupDisabledModules"} {"level":"info","ts":"2026-07-13T04:57:18Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus.checkMaaSPrerequisites","msg":"MaaS gateway missing required annotations","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"08fa8a07-8599-407f-b02f-566998b5ab52","gateway":"maas-default-gateway","missing":["security.opendatahub.io/authorino-tls-bootstrap=\"true\""]} {"level":"info","ts":"2026-07-13T04:57:18Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.cleanupDisabledModules","msg":"module CR gone, cleaning up operator resources","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"59f7a05d-eba2-48b8-8912-689ad21713f6","module":"aigateway"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"08fa8a07-8599-407f-b02f-566998b5ab52","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"08fa8a07-8599-407f-b02f-566998b5ab52","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a3010cf3-8303-4251-bc24-edf0b1f1dad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a3010cf3-8303-4251-bc24-edf0b1f1dad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a3010cf3-8303-4251-bc24-edf0b1f1dad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a3010cf3-8303-4251-bc24-edf0b1f1dad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"13947b04-a960-4553-96ef-be20eaf70b83"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"13947b04-a960-4553-96ef-be20eaf70b83"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Pre-condition skipped by runtime predicate","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"13947b04-a960-4553-96ef-be20eaf70b83","conditionType":"LLM-D-WVADependencies"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"13947b04-a960-4553-96ef-be20eaf70b83","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"13947b04-a960-4553-96ef-be20eaf70b83","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"13947b04-a960-4553-96ef-be20eaf70b83","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"13947b04-a960-4553-96ef-be20eaf70b83","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"13947b04-a960-4553-96ef-be20eaf70b83","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"13947b04-a960-4553-96ef-be20eaf70b83","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"reconcile","controller":"mlflowoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"MLflowOperator","MLflowOperator":{"name":"default-mlflowoperator"},"namespace":"","name":"default-mlflowoperator","reconcileID":"77119987-569a-42ce-b366-44cf3bc1ef93"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"apply","controller":"mlflowoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"MLflowOperator","MLflowOperator":{"name":"default-mlflowoperator"},"namespace":"","name":"default-mlflowoperator","reconcileID":"77119987-569a-42ce-b366-44cf3bc1ef93"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"mlflowoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"MLflowOperator","MLflowOperator":{"name":"default-mlflowoperator"},"namespace":"","name":"default-mlflowoperator","reconcileID":"77119987-569a-42ce-b366-44cf3bc1ef93","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/mlflowoperator.initialize"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"mlflowoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"MLflowOperator","MLflowOperator":{"name":"default-mlflowoperator"},"namespace":"","name":"default-mlflowoperator","reconcileID":"77119987-569a-42ce-b366-44cf3bc1ef93","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/mlflowoperator.setKustomizedParams"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a3010cf3-8303-4251-bc24-edf0b1f1dad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a3010cf3-8303-4251-bc24-edf0b1f1dad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a3010cf3-8303-4251-bc24-edf0b1f1dad5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"mlflowoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"MLflowOperator","MLflowOperator":{"name":"default-mlflowoperator"},"namespace":"","name":"default-mlflowoperator","reconcileID":"77119987-569a-42ce-b366-44cf3bc1ef93","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"mlflowoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"MLflowOperator","MLflowOperator":{"name":"default-mlflowoperator"},"namespace":"","name":"default-mlflowoperator","reconcileID":"77119987-569a-42ce-b366-44cf3bc1ef93","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"mlflowoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"MLflowOperator","MLflowOperator":{"name":"default-mlflowoperator"},"namespace":"","name":"default-mlflowoperator","reconcileID":"77119987-569a-42ce-b366-44cf3bc1ef93","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"reconcile","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"8ecd5feb-74a5-4216-9391-9940cd38951a"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"apply","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"8ecd5feb-74a5-4216-9391-9940cd38951a"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"8ecd5feb-74a5-4216-9391-9940cd38951a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.initialize"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"8ecd5feb-74a5-4216-9391-9940cd38951a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.setKustomizedParams"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"8ecd5feb-74a5-4216-9391-9940cd38951a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"8ecd5feb-74a5-4216-9391-9940cd38951a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"8ecd5feb-74a5-4216-9391-9940cd38951a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/feastoperator.migrateDeploymentSelector"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"reconcile","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6bd36d7a-7bec-4d08-bbc4-b3b6cc7dca66"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"apply","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6bd36d7a-7bec-4d08-bbc4-b3b6cc7dca66"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6bd36d7a-7bec-4d08-bbc4-b3b6cc7dca66","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.initialize"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6bd36d7a-7bec-4d08-bbc4-b3b6cc7dca66","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainer.checkJobSetCRD"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d039ff08-4deb-4046-a6a9-4685f64d6fc6"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d039ff08-4deb-4046-a6a9-4685f64d6fc6"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"8ecd5feb-74a5-4216-9391-9940cd38951a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6bd36d7a-7bec-4d08-bbc4-b3b6cc7dca66","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6bd36d7a-7bec-4d08-bbc4-b3b6cc7dca66","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6bd36d7a-7bec-4d08-bbc4-b3b6cc7dca66","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"reconcile","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"f40872b2-575b-4f63-a60d-1a248f8c1c14"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"apply","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"f40872b2-575b-4f63-a60d-1a248f8c1c14"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"f40872b2-575b-4f63-a60d-1a248f8c1c14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.initialize"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"f40872b2-575b-4f63-a60d-1a248f8c1c14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.customizeManifests"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"f40872b2-575b-4f63-a60d-1a248f8c1c14","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"f40872b2-575b-4f63-a60d-1a248f8c1c14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.configureDependencies"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"f40872b2-575b-4f63-a60d-1a248f8c1c14","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"f40872b2-575b-4f63-a60d-1a248f8c1c14","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"f40872b2-575b-4f63-a60d-1a248f8c1c14","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"reconcile","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e2f41407-65f2-4cab-a853-de3902d1a483"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"apply","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e2f41407-65f2-4cab-a853-de3902d1a483"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e2f41407-65f2-4cab-a853-de3902d1a483","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/sanitycheck.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"reconcile","controller":"trustyai","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrustyAI","TrustyAI":{"name":"default-trustyai"},"namespace":"","name":"default-trustyai","reconcileID":"2db84028-14d9-442c-84e6-d0f03910afd4"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"apply","controller":"trustyai","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrustyAI","TrustyAI":{"name":"default-trustyai"},"namespace":"","name":"default-trustyai","reconcileID":"2db84028-14d9-442c-84e6-d0f03910afd4"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"trustyai","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrustyAI","TrustyAI":{"name":"default-trustyai"},"namespace":"","name":"default-trustyai","reconcileID":"2db84028-14d9-442c-84e6-d0f03910afd4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trustyai.checkPreConditions"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"reconcile","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"fe7e6ae9-6b55-4771-a786-4154abc0b802"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"apply","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"fe7e6ae9-6b55-4771-a786-4154abc0b802"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"fe7e6ae9-6b55-4771-a786-4154abc0b802","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.initialize"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"fe7e6ae9-6b55-4771-a786-4154abc0b802","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"fe7e6ae9-6b55-4771-a786-4154abc0b802","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.configureDependencies"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"fe7e6ae9-6b55-4771-a786-4154abc0b802","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.setKustomizedParams"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"fe7e6ae9-6b55-4771-a786-4154abc0b802","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"59f7a05d-eba2-48b8-8912-689ad21713f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.provisionModules"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"59f7a05d-eba2-48b8-8912-689ad21713f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/helm.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"59f7a05d-eba2-48b8-8912-689ad21713f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"59f7a05d-eba2-48b8-8912-689ad21713f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.injectModuleEnv"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"59f7a05d-eba2-48b8-8912-689ad21713f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"59f7a05d-eba2-48b8-8912-689ad21713f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.updateModuleStatus"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"59f7a05d-eba2-48b8-8912-689ad21713f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"18f87c2b-08bc-4b2d-ac1e-63ec7048587c"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"18f87c2b-08bc-4b2d-ac1e-63ec7048587c"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"18f87c2b-08bc-4b2d-ac1e-63ec7048587c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"18f87c2b-08bc-4b2d-ac1e-63ec7048587c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c37bcf8b-572b-43e9-bc1a-1f610e740c0a"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c37bcf8b-572b-43e9-bc1a-1f610e740c0a"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c37bcf8b-572b-43e9-bc1a-1f610e740c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"trustyai","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrustyAI","TrustyAI":{"name":"default-trustyai"},"namespace":"","name":"default-trustyai","reconcileID":"2db84028-14d9-442c-84e6-d0f03910afd4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trustyai.initialize"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"trustyai","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrustyAI","TrustyAI":{"name":"default-trustyai"},"namespace":"","name":"default-trustyai","reconcileID":"2db84028-14d9-442c-84e6-d0f03910afd4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trustyai.createConfigMap"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"trustyai","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrustyAI","TrustyAI":{"name":"default-trustyai"},"namespace":"","name":"default-trustyai","reconcileID":"2db84028-14d9-442c-84e6-d0f03910afd4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"trustyai","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrustyAI","TrustyAI":{"name":"default-trustyai"},"namespace":"","name":"default-trustyai","reconcileID":"2db84028-14d9-442c-84e6-d0f03910afd4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"trustyai","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrustyAI","TrustyAI":{"name":"default-trustyai"},"namespace":"","name":"default-trustyai","reconcileID":"2db84028-14d9-442c-84e6-d0f03910afd4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e2f41407-65f2-4cab-a853-de3902d1a483","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ray.initialize"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e2f41407-65f2-4cab-a853-de3902d1a483","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e2f41407-65f2-4cab-a853-de3902d1a483","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a6d9b7a0-0e4b-4901-af56-7ee1e5fa3af0"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"apply","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a6d9b7a0-0e4b-4901-af56-7ee1e5fa3af0"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a6d9b7a0-0e4b-4901-af56-7ee1e5fa3af0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.checkPreConditions"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a6d9b7a0-0e4b-4901-af56-7ee1e5fa3af0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.initialize"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a6d9b7a0-0e4b-4901-af56-7ee1e5fa3af0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a6d9b7a0-0e4b-4901-af56-7ee1e5fa3af0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a6d9b7a0-0e4b-4901-af56-7ee1e5fa3af0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageDefaultKueueResourcesAction"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c37bcf8b-572b-43e9-bc1a-1f610e740c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d039ff08-4deb-4046-a6a9-4685f64d6fc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d039ff08-4deb-4046-a6a9-4685f64d6fc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d039ff08-4deb-4046-a6a9-4685f64d6fc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d039ff08-4deb-4046-a6a9-4685f64d6fc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d039ff08-4deb-4046-a6a9-4685f64d6fc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e2f41407-65f2-4cab-a853-de3902d1a483","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"reconcile","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"f4f1cd20-5579-4ecb-99a3-a838a45ba57e"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"apply","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"f4f1cd20-5579-4ecb-99a3-a838a45ba57e"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"f4f1cd20-5579-4ecb-99a3-a838a45ba57e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/sparkoperator.initialize"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"f4f1cd20-5579-4ecb-99a3-a838a45ba57e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"f4f1cd20-5579-4ecb-99a3-a838a45ba57e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:18Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"f4f1cd20-5579-4ecb-99a3-a838a45ba57e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"59f7a05d-eba2-48b8-8912-689ad21713f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"59f7a05d-eba2-48b8-8912-689ad21713f6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dynamicownership.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"reconcile","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"682a4470-e8c5-4547-a15c-d191574419c2"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"apply","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"682a4470-e8c5-4547-a15c-d191574419c2"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"682a4470-e8c5-4547-a15c-d191574419c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelsasservice.renderMaasOperatorInstall"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d039ff08-4deb-4046-a6a9-4685f64d6fc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d039ff08-4deb-4046-a6a9-4685f64d6fc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d039ff08-4deb-4046-a6a9-4685f64d6fc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"reconcile","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"2c46c987-908c-4710-a083-2cb47b8ddc8e"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"apply","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"2c46c987-908c-4710-a083-2cb47b8ddc8e"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"2c46c987-908c-4710-a083-2cb47b8ddc8e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/trainingoperator.initialize"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"2c46c987-908c-4710-a083-2cb47b8ddc8e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"2c46c987-908c-4710-a083-2cb47b8ddc8e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"2c46c987-908c-4710-a083-2cb47b8ddc8e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"reconcile","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"50cbbf7c-19e6-4fc0-9398-0925cf1bf182"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"apply","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"50cbbf7c-19e6-4fc0-9398-0925cf1bf182"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"50cbbf7c-19e6-4fc0-9398-0925cf1bf182","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.checkPreConditions"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"50cbbf7c-19e6-4fc0-9398-0925cf1bf182","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.initialize"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"50cbbf7c-19e6-4fc0-9398-0925cf1bf182","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/datasciencepipelines.argoWorkflowsControllersOptions"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"50cbbf7c-19e6-4fc0-9398-0925cf1bf182","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"50cbbf7c-19e6-4fc0-9398-0925cf1bf182","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"50cbbf7c-19e6-4fc0-9398-0925cf1bf182","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a6d9b7a0-0e4b-4901-af56-7ee1e5fa3af0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding"} {"level":"info","ts":"2026-07-13T04:57:19Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding","msg":"Successfully managed kueue admin role binding","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a6d9b7a0-0e4b-4901-af56-7ee1e5fa3af0","adminGroups":["rhods-admins"]} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a6d9b7a0-0e4b-4901-af56-7ee1e5fa3af0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"08fa8a07-8599-407f-b02f-566998b5ab52","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:19Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"682a4470-e8c5-4547-a15c-d191574419c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:20Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c37bcf8b-572b-43e9-bc1a-1f610e740c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T04:57:20Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c37bcf8b-572b-43e9-bc1a-1f610e740c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T04:57:20Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c37bcf8b-572b-43e9-bc1a-1f610e740c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T04:57:20Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c37bcf8b-572b-43e9-bc1a-1f610e740c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T04:57:20Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c37bcf8b-572b-43e9-bc1a-1f610e740c0a","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T04:57:20Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c37bcf8b-572b-43e9-bc1a-1f610e740c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:20Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c37bcf8b-572b-43e9-bc1a-1f610e740c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:20Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"f4f1cd20-5579-4ecb-99a3-a838a45ba57e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:20Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"f4f1cd20-5579-4ecb-99a3-a838a45ba57e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:20Z","msg":"Executing action","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","SparkOperator":{"name":"default-sparkoperator"},"namespace":"","name":"default-sparkoperator","reconcileID":"f4f1cd20-5579-4ecb-99a3-a838a45ba57e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:20Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"18f87c2b-08bc-4b2d-ac1e-63ec7048587c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-13T04:57:20Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"18f87c2b-08bc-4b2d-ac1e-63ec7048587c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-13T04:57:20Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"18f87c2b-08bc-4b2d-ac1e-63ec7048587c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:20Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"18f87c2b-08bc-4b2d-ac1e-63ec7048587c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a6d9b7a0-0e4b-4901-af56-7ee1e5fa3af0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a6d9b7a0-0e4b-4901-af56-7ee1e5fa3af0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a6d9b7a0-0e4b-4901-af56-7ee1e5fa3af0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.configureClusterQueueViewerRoleAction"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a6d9b7a0-0e4b-4901-af56-7ee1e5fa3af0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a6d9b7a0-0e4b-4901-af56-7ee1e5fa3af0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:21Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"a6672c5e-a72a-42b8-9202-f51e23ef9400","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"a6672c5e-a72a-42b8-9202-f51e23ef9400","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b48c019-ce06-4b1c-b202-ca87a4d8379e"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b48c019-ce06-4b1c-b202-ca87a4d8379e"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b48c019-ce06-4b1c-b202-ca87a4d8379e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b48c019-ce06-4b1c-b202-ca87a4d8379e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b48c019-ce06-4b1c-b202-ca87a4d8379e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b48c019-ce06-4b1c-b202-ca87a4d8379e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b48c019-ce06-4b1c-b202-ca87a4d8379e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b48c019-ce06-4b1c-b202-ca87a4d8379e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b48c019-ce06-4b1c-b202-ca87a4d8379e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b48c019-ce06-4b1c-b202-ca87a4d8379e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b48c019-ce06-4b1c-b202-ca87a4d8379e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d039ff08-4deb-4046-a6a9-4685f64d6fc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b48c019-ce06-4b1c-b202-ca87a4d8379e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b48c019-ce06-4b1c-b202-ca87a4d8379e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b48c019-ce06-4b1c-b202-ca87a4d8379e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b48c019-ce06-4b1c-b202-ca87a4d8379e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d039ff08-4deb-4046-a6a9-4685f64d6fc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d039ff08-4deb-4046-a6a9-4685f64d6fc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d039ff08-4deb-4046-a6a9-4685f64d6fc6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b48c019-ce06-4b1c-b202-ca87a4d8379e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b48c019-ce06-4b1c-b202-ca87a4d8379e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b48c019-ce06-4b1c-b202-ca87a4d8379e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:21Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"delete","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"08fa8a07-8599-407f-b02f-566998b5ab52","gvk":"components.platform.opendatahub.io/v1alpha1, Kind=OGX","ns":"","name":"default-ogx"} {"level":"info","ts":"2026-07-13T04:57:21Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"2818edf0-16a8-4993-9109-a2afc40f51a8"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"09648295-d39b-43f4-8b90-99fd192ad388"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"fe7e6ae9-6b55-4771-a786-4154abc0b802","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90b55bc5-7e9a-4d32-8715-7a3c6e942225"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"apply","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90b55bc5-7e9a-4d32-8715-7a3c6e942225"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90b55bc5-7e9a-4d32-8715-7a3c6e942225","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.checkPreConditions"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90b55bc5-7e9a-4d32-8715-7a3c6e942225","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.initialize"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90b55bc5-7e9a-4d32-8715-7a3c6e942225","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90b55bc5-7e9a-4d32-8715-7a3c6e942225","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90b55bc5-7e9a-4d32-8715-7a3c6e942225","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageDefaultKueueResourcesAction"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"83680b2b-88d4-482f-9e64-8b9ceb4d9ba4"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"6c8b118d-a820-4c62-90ec-7b1068bbb205"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"b43e5852-25ff-44b3-9148-ae2b87041fac"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"83e3168a-3bfc-4ff0-b918-b7f5795d8b52"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"f40872b2-575b-4f63-a60d-1a248f8c1c14","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"30ae30f6-2c05-40c8-9d13-5a8ea1218c5d"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"a1dd81b9-e49d-4bfd-81af-e41e19de7cc0"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"f8f41a2c-4676-40cf-a347-a29b817e9397"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"83998177-12e4-4bd9-bc5b-44dae033d338"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"f40872b2-575b-4f63-a60d-1a248f8c1c14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelregistry.updateStatus"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"f40872b2-575b-4f63-a60d-1a248f8c1c14","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"f40872b2-575b-4f63-a60d-1a248f8c1c14","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"mlflowoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"MLflowOperator","MLflowOperator":{"name":"default-mlflowoperator"},"namespace":"","name":"default-mlflowoperator","reconcileID":"77119987-569a-42ce-b366-44cf3bc1ef93","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"61c3f6b4-dc8f-49e2-83dd-e1fd4c5ef216"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"mlflowoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"MLflowOperator","MLflowOperator":{"name":"default-mlflowoperator"},"namespace":"","name":"default-mlflowoperator","reconcileID":"77119987-569a-42ce-b366-44cf3bc1ef93","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"mlflowoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"MLflowOperator","MLflowOperator":{"name":"default-mlflowoperator"},"namespace":"","name":"default-mlflowoperator","reconcileID":"77119987-569a-42ce-b366-44cf3bc1ef93","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90b55bc5-7e9a-4d32-8715-7a3c6e942225","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding"} {"level":"info","ts":"2026-07-13T04:57:22Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding","msg":"Successfully managed kueue admin role binding","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90b55bc5-7e9a-4d32-8715-7a3c6e942225","adminGroups":["rhods-admins"]} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90b55bc5-7e9a-4d32-8715-7a3c6e942225","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"b4d185e7-a773-4cd2-8683-15d10d32ee6f"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"b31e5805-f201-433e-9150-fb4ef312a0e1"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"8ecd5feb-74a5-4216-9391-9940cd38951a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"8ecd5feb-74a5-4216-9391-9940cd38951a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","FeastOperator":{"name":"default-feastoperator"},"namespace":"","name":"default-feastoperator","reconcileID":"8ecd5feb-74a5-4216-9391-9940cd38951a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"08fa8a07-8599-407f-b02f-566998b5ab52","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"f335b553-7942-43d5-8292-41328f4ae35a"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"12902288-1410-4c31-85e6-4a2303f238a1"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"12902288-1410-4c31-85e6-4a2303f238a1"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"12902288-1410-4c31-85e6-4a2303f238a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"12902288-1410-4c31-85e6-4a2303f238a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"12902288-1410-4c31-85e6-4a2303f238a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-13T04:57:22Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus.checkMaaSPrerequisites","msg":"MaaS gateway missing required annotations","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"12902288-1410-4c31-85e6-4a2303f238a1","gateway":"maas-default-gateway","missing":["security.opendatahub.io/authorino-tls-bootstrap=\"true\""]} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"12902288-1410-4c31-85e6-4a2303f238a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"12902288-1410-4c31-85e6-4a2303f238a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"938299c5-f6bf-42dc-8f71-5aa4799625bc"} {"level":"info","ts":"2026-07-13T04:57:22Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c83f052d-9c95-4808-bf17-57f655941631","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c83f052d-9c95-4808-bf17-57f655941631","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ab22a8f0-d4fa-4444-83c3-cb1b26e261c5"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ab22a8f0-d4fa-4444-83c3-cb1b26e261c5"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ab22a8f0-d4fa-4444-83c3-cb1b26e261c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ab22a8f0-d4fa-4444-83c3-cb1b26e261c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ab22a8f0-d4fa-4444-83c3-cb1b26e261c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ab22a8f0-d4fa-4444-83c3-cb1b26e261c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ab22a8f0-d4fa-4444-83c3-cb1b26e261c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ab22a8f0-d4fa-4444-83c3-cb1b26e261c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ab22a8f0-d4fa-4444-83c3-cb1b26e261c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ab22a8f0-d4fa-4444-83c3-cb1b26e261c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ab22a8f0-d4fa-4444-83c3-cb1b26e261c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ab22a8f0-d4fa-4444-83c3-cb1b26e261c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ab22a8f0-d4fa-4444-83c3-cb1b26e261c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ab22a8f0-d4fa-4444-83c3-cb1b26e261c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ab22a8f0-d4fa-4444-83c3-cb1b26e261c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ab22a8f0-d4fa-4444-83c3-cb1b26e261c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ab22a8f0-d4fa-4444-83c3-cb1b26e261c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ab22a8f0-d4fa-4444-83c3-cb1b26e261c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"e5a85558-7b52-4f1b-be92-798701bfb946"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90b55bc5-7e9a-4d32-8715-7a3c6e942225","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90b55bc5-7e9a-4d32-8715-7a3c6e942225","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90b55bc5-7e9a-4d32-8715-7a3c6e942225","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.configureClusterQueueViewerRoleAction"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90b55bc5-7e9a-4d32-8715-7a3c6e942225","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90b55bc5-7e9a-4d32-8715-7a3c6e942225","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"2657d6e7-c3b6-42e4-b894-68f14b8b2ae4"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4f274c24-9156-4d85-b961-63a52c659ae9"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"apply","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4f274c24-9156-4d85-b961-63a52c659ae9"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4f274c24-9156-4d85-b961-63a52c659ae9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.checkPreConditions"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4f274c24-9156-4d85-b961-63a52c659ae9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.initialize"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4f274c24-9156-4d85-b961-63a52c659ae9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4f274c24-9156-4d85-b961-63a52c659ae9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4f274c24-9156-4d85-b961-63a52c659ae9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageDefaultKueueResourcesAction"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"1514229f-3061-4050-a819-2f2ecba53e2f"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c37bcf8b-572b-43e9-bc1a-1f610e740c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"36caea91-aaf4-4b9d-9221-9e1f3a07bfca"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c37bcf8b-572b-43e9-bc1a-1f610e740c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c37bcf8b-572b-43e9-bc1a-1f610e740c0a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2b1adda0-bac9-4cb3-82fa-e41cd20e3445"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2b1adda0-bac9-4cb3-82fa-e41cd20e3445"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2b1adda0-bac9-4cb3-82fa-e41cd20e3445","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"12902288-1410-4c31-85e6-4a2303f238a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4f274c24-9156-4d85-b961-63a52c659ae9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding"} {"level":"info","ts":"2026-07-13T04:57:23Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding","msg":"Successfully managed kueue admin role binding","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4f274c24-9156-4d85-b961-63a52c659ae9","adminGroups":["rhods-admins"]} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4f274c24-9156-4d85-b961-63a52c659ae9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2b1adda0-bac9-4cb3-82fa-e41cd20e3445","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"682a4470-e8c5-4547-a15c-d191574419c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelsasservice.ensureMaasClusterConfigControllerRef"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"682a4470-e8c5-4547-a15c-d191574419c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"682a4470-e8c5-4547-a15c-d191574419c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"682a4470-e8c5-4547-a15c-d191574419c2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4f274c24-9156-4d85-b961-63a52c659ae9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4f274c24-9156-4d85-b961-63a52c659ae9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4f274c24-9156-4d85-b961-63a52c659ae9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.configureClusterQueueViewerRoleAction"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4f274c24-9156-4d85-b961-63a52c659ae9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4f274c24-9156-4d85-b961-63a52c659ae9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2b1adda0-bac9-4cb3-82fa-e41cd20e3445","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2b1adda0-bac9-4cb3-82fa-e41cd20e3445","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2b1adda0-bac9-4cb3-82fa-e41cd20e3445","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2b1adda0-bac9-4cb3-82fa-e41cd20e3445","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T04:57:23Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2b1adda0-bac9-4cb3-82fa-e41cd20e3445","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2b1adda0-bac9-4cb3-82fa-e41cd20e3445","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2b1adda0-bac9-4cb3-82fa-e41cd20e3445","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:23Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"baef066f-da90-4057-93af-f9b2e8633f44","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"baef066f-da90-4057-93af-f9b2e8633f44","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:57:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2b1adda0-bac9-4cb3-82fa-e41cd20e3445","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2b1adda0-bac9-4cb3-82fa-e41cd20e3445","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2b1adda0-bac9-4cb3-82fa-e41cd20e3445","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"f4ab835c-778e-4060-8003-ffd041dc196f"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e408bef-f0a7-4613-abdf-8a8cbaafbd31"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e408bef-f0a7-4613-abdf-8a8cbaafbd31"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e408bef-f0a7-4613-abdf-8a8cbaafbd31","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"fcf6cc64-4be4-4b79-a4fc-e6f28fc1ab31"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e408bef-f0a7-4613-abdf-8a8cbaafbd31","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e408bef-f0a7-4613-abdf-8a8cbaafbd31","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e408bef-f0a7-4613-abdf-8a8cbaafbd31","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e408bef-f0a7-4613-abdf-8a8cbaafbd31","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e408bef-f0a7-4613-abdf-8a8cbaafbd31","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T04:57:24Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e408bef-f0a7-4613-abdf-8a8cbaafbd31","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e408bef-f0a7-4613-abdf-8a8cbaafbd31","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e408bef-f0a7-4613-abdf-8a8cbaafbd31","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"12902288-1410-4c31-85e6-4a2303f238a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"50cbbf7c-19e6-4fc0-9398-0925cf1bf182","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"50cbbf7c-19e6-4fc0-9398-0925cf1bf182","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","DataSciencePipelines":{"name":"default-datasciencepipelines"},"namespace":"","name":"default-datasciencepipelines","reconcileID":"50cbbf7c-19e6-4fc0-9398-0925cf1bf182","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e408bef-f0a7-4613-abdf-8a8cbaafbd31","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e408bef-f0a7-4613-abdf-8a8cbaafbd31","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5e408bef-f0a7-4613-abdf-8a8cbaafbd31","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"33357a15-e720-4ce1-bab9-6692480f2548"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"33357a15-e720-4ce1-bab9-6692480f2548"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"33357a15-e720-4ce1-bab9-6692480f2548","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"33357a15-e720-4ce1-bab9-6692480f2548","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb3d781-76f9-41fe-88bb-3cb465b94377"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb3d781-76f9-41fe-88bb-3cb465b94377"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb3d781-76f9-41fe-88bb-3cb465b94377","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb3d781-76f9-41fe-88bb-3cb465b94377","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb3d781-76f9-41fe-88bb-3cb465b94377","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb3d781-76f9-41fe-88bb-3cb465b94377","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb3d781-76f9-41fe-88bb-3cb465b94377","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb3d781-76f9-41fe-88bb-3cb465b94377","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb3d781-76f9-41fe-88bb-3cb465b94377","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb3d781-76f9-41fe-88bb-3cb465b94377","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb3d781-76f9-41fe-88bb-3cb465b94377","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"33357a15-e720-4ce1-bab9-6692480f2548","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-13T04:57:24Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus.checkMaaSPrerequisites","msg":"MaaS gateway missing required annotations","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"33357a15-e720-4ce1-bab9-6692480f2548","gateway":"maas-default-gateway","missing":["security.opendatahub.io/authorino-tls-bootstrap=\"true\""]} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"33357a15-e720-4ce1-bab9-6692480f2548","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"33357a15-e720-4ce1-bab9-6692480f2548","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fccc2cc2-7e92-41ab-90aa-3c1a5d42c5ac"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fccc2cc2-7e92-41ab-90aa-3c1a5d42c5ac"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fccc2cc2-7e92-41ab-90aa-3c1a5d42c5ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb3d781-76f9-41fe-88bb-3cb465b94377","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb3d781-76f9-41fe-88bb-3cb465b94377","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb3d781-76f9-41fe-88bb-3cb465b94377","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb3d781-76f9-41fe-88bb-3cb465b94377","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb3d781-76f9-41fe-88bb-3cb465b94377","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb3d781-76f9-41fe-88bb-3cb465b94377","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1bb3d781-76f9-41fe-88bb-3cb465b94377","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fccc2cc2-7e92-41ab-90aa-3c1a5d42c5ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"33357a15-e720-4ce1-bab9-6692480f2548","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fccc2cc2-7e92-41ab-90aa-3c1a5d42c5ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fccc2cc2-7e92-41ab-90aa-3c1a5d42c5ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fccc2cc2-7e92-41ab-90aa-3c1a5d42c5ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fccc2cc2-7e92-41ab-90aa-3c1a5d42c5ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T04:57:24Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fccc2cc2-7e92-41ab-90aa-3c1a5d42c5ac","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fccc2cc2-7e92-41ab-90aa-3c1a5d42c5ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fccc2cc2-7e92-41ab-90aa-3c1a5d42c5ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fccc2cc2-7e92-41ab-90aa-3c1a5d42c5ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fccc2cc2-7e92-41ab-90aa-3c1a5d42c5ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fccc2cc2-7e92-41ab-90aa-3c1a5d42c5ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"6cb05ba9-8561-4112-b4f7-318d1dac2200","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"6cb05ba9-8561-4112-b4f7-318d1dac2200","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6bd36d7a-7bec-4d08-bbc4-b3b6cc7dca66","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6bd36d7a-7bec-4d08-bbc4-b3b6cc7dca66","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","Trainer":{"name":"default-trainer"},"namespace":"","name":"default-trainer","reconcileID":"6bd36d7a-7bec-4d08-bbc4-b3b6cc7dca66","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"2c46c987-908c-4710-a083-2cb47b8ddc8e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"2c46c987-908c-4710-a083-2cb47b8ddc8e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","TrainingOperator":{"name":"default-trainingoperator"},"namespace":"","name":"default-trainingoperator","reconcileID":"2c46c987-908c-4710-a083-2cb47b8ddc8e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:24Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"33357a15-e720-4ce1-bab9-6692480f2548","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"899ee142-c70b-49ce-8e53-da65956b0f84"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"899ee142-c70b-49ce-8e53-da65956b0f84"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"899ee142-c70b-49ce-8e53-da65956b0f84","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"899ee142-c70b-49ce-8e53-da65956b0f84","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"899ee142-c70b-49ce-8e53-da65956b0f84","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"899ee142-c70b-49ce-8e53-da65956b0f84","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"899ee142-c70b-49ce-8e53-da65956b0f84","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"899ee142-c70b-49ce-8e53-da65956b0f84","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"899ee142-c70b-49ce-8e53-da65956b0f84","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"899ee142-c70b-49ce-8e53-da65956b0f84","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"899ee142-c70b-49ce-8e53-da65956b0f84","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"899ee142-c70b-49ce-8e53-da65956b0f84","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"899ee142-c70b-49ce-8e53-da65956b0f84","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"899ee142-c70b-49ce-8e53-da65956b0f84","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"899ee142-c70b-49ce-8e53-da65956b0f84","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"899ee142-c70b-49ce-8e53-da65956b0f84","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"899ee142-c70b-49ce-8e53-da65956b0f84","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"899ee142-c70b-49ce-8e53-da65956b0f84","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c433754f-6e38-4893-84a7-4551de8d813e","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c433754f-6e38-4893-84a7-4551de8d813e","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df441119-7c0f-46ea-9b56-bf6212604cbd"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df441119-7c0f-46ea-9b56-bf6212604cbd"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df441119-7c0f-46ea-9b56-bf6212604cbd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df441119-7c0f-46ea-9b56-bf6212604cbd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df441119-7c0f-46ea-9b56-bf6212604cbd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df441119-7c0f-46ea-9b56-bf6212604cbd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df441119-7c0f-46ea-9b56-bf6212604cbd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df441119-7c0f-46ea-9b56-bf6212604cbd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df441119-7c0f-46ea-9b56-bf6212604cbd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df441119-7c0f-46ea-9b56-bf6212604cbd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df441119-7c0f-46ea-9b56-bf6212604cbd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df441119-7c0f-46ea-9b56-bf6212604cbd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df441119-7c0f-46ea-9b56-bf6212604cbd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df441119-7c0f-46ea-9b56-bf6212604cbd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df441119-7c0f-46ea-9b56-bf6212604cbd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df441119-7c0f-46ea-9b56-bf6212604cbd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df441119-7c0f-46ea-9b56-bf6212604cbd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df441119-7c0f-46ea-9b56-bf6212604cbd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"trustyai","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrustyAI","TrustyAI":{"name":"default-trustyai"},"namespace":"","name":"default-trustyai","reconcileID":"2db84028-14d9-442c-84e6-d0f03910afd4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"trustyai","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrustyAI","TrustyAI":{"name":"default-trustyai"},"namespace":"","name":"default-trustyai","reconcileID":"2db84028-14d9-442c-84e6-d0f03910afd4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"trustyai","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrustyAI","TrustyAI":{"name":"default-trustyai"},"namespace":"","name":"default-trustyai","reconcileID":"2db84028-14d9-442c-84e6-d0f03910afd4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"fe7e6ae9-6b55-4771-a786-4154abc0b802","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"fe7e6ae9-6b55-4771-a786-4154abc0b802","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/imagestreams.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"fe7e6ae9-6b55-4771-a786-4154abc0b802","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/workbenches.updateStatus"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"fe7e6ae9-6b55-4771-a786-4154abc0b802","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0b68dda2-9e67-417b-872c-4f21f190750b"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0b68dda2-9e67-417b-872c-4f21f190750b"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0b68dda2-9e67-417b-872c-4f21f190750b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0b68dda2-9e67-417b-872c-4f21f190750b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0b68dda2-9e67-417b-872c-4f21f190750b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0b68dda2-9e67-417b-872c-4f21f190750b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0b68dda2-9e67-417b-872c-4f21f190750b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0b68dda2-9e67-417b-872c-4f21f190750b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0b68dda2-9e67-417b-872c-4f21f190750b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0b68dda2-9e67-417b-872c-4f21f190750b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0b68dda2-9e67-417b-872c-4f21f190750b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0b68dda2-9e67-417b-872c-4f21f190750b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0b68dda2-9e67-417b-872c-4f21f190750b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0b68dda2-9e67-417b-872c-4f21f190750b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0b68dda2-9e67-417b-872c-4f21f190750b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0b68dda2-9e67-417b-872c-4f21f190750b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0b68dda2-9e67-417b-872c-4f21f190750b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:25Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0b68dda2-9e67-417b-872c-4f21f190750b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:26Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"18f87c2b-08bc-4b2d-ac1e-63ec7048587c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:26Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"18f87c2b-08bc-4b2d-ac1e-63ec7048587c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-13T04:57:26Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"18f87c2b-08bc-4b2d-ac1e-63ec7048587c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-13T04:57:26Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"18f87c2b-08bc-4b2d-ac1e-63ec7048587c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:26Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"18f87c2b-08bc-4b2d-ac1e-63ec7048587c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:26Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d684384e-7995-42c8-ae92-57ee1770012a"} {"level":"info","ts":"2026-07-13T04:57:26Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d684384e-7995-42c8-ae92-57ee1770012a"} {"level":"info","ts":"2026-07-13T04:57:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d684384e-7995-42c8-ae92-57ee1770012a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T04:57:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d684384e-7995-42c8-ae92-57ee1770012a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T04:57:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d684384e-7995-42c8-ae92-57ee1770012a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T04:57:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d684384e-7995-42c8-ae92-57ee1770012a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T04:57:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d684384e-7995-42c8-ae92-57ee1770012a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T04:57:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d684384e-7995-42c8-ae92-57ee1770012a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T04:57:26Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d684384e-7995-42c8-ae92-57ee1770012a","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T04:57:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d684384e-7995-42c8-ae92-57ee1770012a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d684384e-7995-42c8-ae92-57ee1770012a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d684384e-7995-42c8-ae92-57ee1770012a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T04:57:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d684384e-7995-42c8-ae92-57ee1770012a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d684384e-7995-42c8-ae92-57ee1770012a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:27Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e2f41407-65f2-4cab-a853-de3902d1a483","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:27Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e2f41407-65f2-4cab-a853-de3902d1a483","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:57:27Z","msg":"Executing action","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","Ray":{"name":"default-ray"},"namespace":"","name":"default-ray","reconcileID":"e2f41407-65f2-4cab-a853-de3902d1a483","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:27Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"fe7e6ae9-6b55-4771-a786-4154abc0b802"} {"level":"info","ts":"2026-07-13T04:57:27Z","msg":"Executing action","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","Workbenches":{"name":"default-workbenches"},"namespace":"","name":"default-workbenches","reconcileID":"fe7e6ae9-6b55-4771-a786-4154abc0b802","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:57:30Z","logger":"controller-runtime.cache","msg":"Warning: This version is deprecated. Use v1beta2 instead."} {"level":"error","ts":"2026-07-13T04:58:02Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T04:58:20Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a11565ac-e2f0-4250-81e9-87cb5cfb3d56"} {"level":"info","ts":"2026-07-13T04:58:20Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a11565ac-e2f0-4250-81e9-87cb5cfb3d56"} {"level":"info","ts":"2026-07-13T04:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a11565ac-e2f0-4250-81e9-87cb5cfb3d56","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a11565ac-e2f0-4250-81e9-87cb5cfb3d56","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T04:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a11565ac-e2f0-4250-81e9-87cb5cfb3d56","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T04:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a11565ac-e2f0-4250-81e9-87cb5cfb3d56","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T04:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a11565ac-e2f0-4250-81e9-87cb5cfb3d56","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T04:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a11565ac-e2f0-4250-81e9-87cb5cfb3d56","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T04:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a11565ac-e2f0-4250-81e9-87cb5cfb3d56","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T04:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a11565ac-e2f0-4250-81e9-87cb5cfb3d56","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T04:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a11565ac-e2f0-4250-81e9-87cb5cfb3d56","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T04:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a11565ac-e2f0-4250-81e9-87cb5cfb3d56","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T04:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a11565ac-e2f0-4250-81e9-87cb5cfb3d56","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T04:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a11565ac-e2f0-4250-81e9-87cb5cfb3d56","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a11565ac-e2f0-4250-81e9-87cb5cfb3d56","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a11565ac-e2f0-4250-81e9-87cb5cfb3d56","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T04:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a11565ac-e2f0-4250-81e9-87cb5cfb3d56","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T04:58:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a11565ac-e2f0-4250-81e9-87cb5cfb3d56","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T04:58:20Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c1a05911-f9f9-4b67-a1d9-80396db2d286","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T04:58:20Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c1a05911-f9f9-4b67-a1d9-80396db2d286","name":"redhat-ods-applications"} {"level":"error","ts":"2026-07-13T04:58:44Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T04:59:16Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:00:00Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T05:00:01Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3722098d-8855-4a45-891d-93f2aebd322f"} {"level":"info","ts":"2026-07-13T05:00:01Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3722098d-8855-4a45-891d-93f2aebd322f"} {"level":"info","ts":"2026-07-13T05:00:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3722098d-8855-4a45-891d-93f2aebd322f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:00:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3722098d-8855-4a45-891d-93f2aebd322f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:00:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3722098d-8855-4a45-891d-93f2aebd322f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:00:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3722098d-8855-4a45-891d-93f2aebd322f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:00:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3722098d-8855-4a45-891d-93f2aebd322f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:00:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3722098d-8855-4a45-891d-93f2aebd322f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:00:01Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3722098d-8855-4a45-891d-93f2aebd322f","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:00:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3722098d-8855-4a45-891d-93f2aebd322f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3722098d-8855-4a45-891d-93f2aebd322f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3722098d-8855-4a45-891d-93f2aebd322f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:00:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3722098d-8855-4a45-891d-93f2aebd322f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3722098d-8855-4a45-891d-93f2aebd322f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:00:01Z","logger":"controller-runtime.cache","msg":"Warning: This version is deprecated. Use v1beta2 instead."} {"level":"info","ts":"2026-07-13T05:00:16Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7c6fcf5a-c894-4a4f-80f8-414a837c5cf7"} {"level":"info","ts":"2026-07-13T05:00:16Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7c6fcf5a-c894-4a4f-80f8-414a837c5cf7"} {"level":"info","ts":"2026-07-13T05:00:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7c6fcf5a-c894-4a4f-80f8-414a837c5cf7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:00:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7c6fcf5a-c894-4a4f-80f8-414a837c5cf7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:00:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7c6fcf5a-c894-4a4f-80f8-414a837c5cf7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:00:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7c6fcf5a-c894-4a4f-80f8-414a837c5cf7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:00:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7c6fcf5a-c894-4a4f-80f8-414a837c5cf7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:00:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7c6fcf5a-c894-4a4f-80f8-414a837c5cf7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:00:16Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7c6fcf5a-c894-4a4f-80f8-414a837c5cf7","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:00:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7c6fcf5a-c894-4a4f-80f8-414a837c5cf7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7c6fcf5a-c894-4a4f-80f8-414a837c5cf7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7c6fcf5a-c894-4a4f-80f8-414a837c5cf7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:00:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7c6fcf5a-c894-4a4f-80f8-414a837c5cf7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7c6fcf5a-c894-4a4f-80f8-414a837c5cf7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8240ba23-5e9c-422d-8e48-045338b0c15a"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8240ba23-5e9c-422d-8e48-045338b0c15a"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8240ba23-5e9c-422d-8e48-045338b0c15a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8240ba23-5e9c-422d-8e48-045338b0c15a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8240ba23-5e9c-422d-8e48-045338b0c15a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8240ba23-5e9c-422d-8e48-045338b0c15a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8240ba23-5e9c-422d-8e48-045338b0c15a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8240ba23-5e9c-422d-8e48-045338b0c15a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:00:18Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8240ba23-5e9c-422d-8e48-045338b0c15a","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8240ba23-5e9c-422d-8e48-045338b0c15a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8240ba23-5e9c-422d-8e48-045338b0c15a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8240ba23-5e9c-422d-8e48-045338b0c15a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8240ba23-5e9c-422d-8e48-045338b0c15a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8240ba23-5e9c-422d-8e48-045338b0c15a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4ea85296-314b-4f4d-9414-70dc526d0da6"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4ea85296-314b-4f4d-9414-70dc526d0da6"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4ea85296-314b-4f4d-9414-70dc526d0da6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4ea85296-314b-4f4d-9414-70dc526d0da6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4ea85296-314b-4f4d-9414-70dc526d0da6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4ea85296-314b-4f4d-9414-70dc526d0da6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4ea85296-314b-4f4d-9414-70dc526d0da6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4ea85296-314b-4f4d-9414-70dc526d0da6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:00:18Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4ea85296-314b-4f4d-9414-70dc526d0da6","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4ea85296-314b-4f4d-9414-70dc526d0da6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4ea85296-314b-4f4d-9414-70dc526d0da6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4ea85296-314b-4f4d-9414-70dc526d0da6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4ea85296-314b-4f4d-9414-70dc526d0da6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4ea85296-314b-4f4d-9414-70dc526d0da6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc7b2f36-f3e9-480b-9f94-ba36bd3bc677"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc7b2f36-f3e9-480b-9f94-ba36bd3bc677"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc7b2f36-f3e9-480b-9f94-ba36bd3bc677","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc7b2f36-f3e9-480b-9f94-ba36bd3bc677","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc7b2f36-f3e9-480b-9f94-ba36bd3bc677","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc7b2f36-f3e9-480b-9f94-ba36bd3bc677","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc7b2f36-f3e9-480b-9f94-ba36bd3bc677","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc7b2f36-f3e9-480b-9f94-ba36bd3bc677","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:00:18Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc7b2f36-f3e9-480b-9f94-ba36bd3bc677","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc7b2f36-f3e9-480b-9f94-ba36bd3bc677","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc7b2f36-f3e9-480b-9f94-ba36bd3bc677","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc7b2f36-f3e9-480b-9f94-ba36bd3bc677","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc7b2f36-f3e9-480b-9f94-ba36bd3bc677","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc7b2f36-f3e9-480b-9f94-ba36bd3bc677","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d879fca-2b96-4a82-8356-f8c95eb661cf"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d879fca-2b96-4a82-8356-f8c95eb661cf"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d879fca-2b96-4a82-8356-f8c95eb661cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d879fca-2b96-4a82-8356-f8c95eb661cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d879fca-2b96-4a82-8356-f8c95eb661cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d879fca-2b96-4a82-8356-f8c95eb661cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d879fca-2b96-4a82-8356-f8c95eb661cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d879fca-2b96-4a82-8356-f8c95eb661cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d879fca-2b96-4a82-8356-f8c95eb661cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d879fca-2b96-4a82-8356-f8c95eb661cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d879fca-2b96-4a82-8356-f8c95eb661cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d879fca-2b96-4a82-8356-f8c95eb661cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d879fca-2b96-4a82-8356-f8c95eb661cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d879fca-2b96-4a82-8356-f8c95eb661cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d879fca-2b96-4a82-8356-f8c95eb661cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d879fca-2b96-4a82-8356-f8c95eb661cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d879fca-2b96-4a82-8356-f8c95eb661cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1d879fca-2b96-4a82-8356-f8c95eb661cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"b2ad18cd-5834-4b43-aa4e-0afc0847af95","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"b2ad18cd-5834-4b43-aa4e-0afc0847af95","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a1735089-64f8-4a78-b6b8-19ee56711096"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a1735089-64f8-4a78-b6b8-19ee56711096"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a1735089-64f8-4a78-b6b8-19ee56711096","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a1735089-64f8-4a78-b6b8-19ee56711096","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a1735089-64f8-4a78-b6b8-19ee56711096","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a1735089-64f8-4a78-b6b8-19ee56711096","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a1735089-64f8-4a78-b6b8-19ee56711096","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a1735089-64f8-4a78-b6b8-19ee56711096","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a1735089-64f8-4a78-b6b8-19ee56711096","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a1735089-64f8-4a78-b6b8-19ee56711096","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a1735089-64f8-4a78-b6b8-19ee56711096","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a1735089-64f8-4a78-b6b8-19ee56711096","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a1735089-64f8-4a78-b6b8-19ee56711096","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a1735089-64f8-4a78-b6b8-19ee56711096","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a1735089-64f8-4a78-b6b8-19ee56711096","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a1735089-64f8-4a78-b6b8-19ee56711096","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a1735089-64f8-4a78-b6b8-19ee56711096","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a1735089-64f8-4a78-b6b8-19ee56711096","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ddecfea-94bb-43a9-9e69-aa631183ce9e"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ddecfea-94bb-43a9-9e69-aa631183ce9e"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ddecfea-94bb-43a9-9e69-aa631183ce9e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ddecfea-94bb-43a9-9e69-aa631183ce9e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ddecfea-94bb-43a9-9e69-aa631183ce9e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ddecfea-94bb-43a9-9e69-aa631183ce9e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ddecfea-94bb-43a9-9e69-aa631183ce9e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ddecfea-94bb-43a9-9e69-aa631183ce9e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ddecfea-94bb-43a9-9e69-aa631183ce9e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ddecfea-94bb-43a9-9e69-aa631183ce9e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ddecfea-94bb-43a9-9e69-aa631183ce9e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ddecfea-94bb-43a9-9e69-aa631183ce9e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ddecfea-94bb-43a9-9e69-aa631183ce9e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ddecfea-94bb-43a9-9e69-aa631183ce9e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ddecfea-94bb-43a9-9e69-aa631183ce9e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ddecfea-94bb-43a9-9e69-aa631183ce9e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ddecfea-94bb-43a9-9e69-aa631183ce9e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ddecfea-94bb-43a9-9e69-aa631183ce9e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:00:19Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"4066fde5-c44c-490a-be60-93d57ce28333","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"4066fde5-c44c-490a-be60-93d57ce28333","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d8f9538d-e288-4a59-bcee-e5a38fe441d7"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d8f9538d-e288-4a59-bcee-e5a38fe441d7"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d8f9538d-e288-4a59-bcee-e5a38fe441d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d8f9538d-e288-4a59-bcee-e5a38fe441d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d8f9538d-e288-4a59-bcee-e5a38fe441d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d8f9538d-e288-4a59-bcee-e5a38fe441d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d8f9538d-e288-4a59-bcee-e5a38fe441d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d8f9538d-e288-4a59-bcee-e5a38fe441d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d8f9538d-e288-4a59-bcee-e5a38fe441d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d8f9538d-e288-4a59-bcee-e5a38fe441d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d8f9538d-e288-4a59-bcee-e5a38fe441d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d8f9538d-e288-4a59-bcee-e5a38fe441d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d8f9538d-e288-4a59-bcee-e5a38fe441d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d8f9538d-e288-4a59-bcee-e5a38fe441d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d8f9538d-e288-4a59-bcee-e5a38fe441d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d8f9538d-e288-4a59-bcee-e5a38fe441d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d8f9538d-e288-4a59-bcee-e5a38fe441d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d8f9538d-e288-4a59-bcee-e5a38fe441d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b308b1bf-8c0f-4cd7-8b52-15447fe551f2"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b308b1bf-8c0f-4cd7-8b52-15447fe551f2"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b308b1bf-8c0f-4cd7-8b52-15447fe551f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b308b1bf-8c0f-4cd7-8b52-15447fe551f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b308b1bf-8c0f-4cd7-8b52-15447fe551f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b308b1bf-8c0f-4cd7-8b52-15447fe551f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b308b1bf-8c0f-4cd7-8b52-15447fe551f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b308b1bf-8c0f-4cd7-8b52-15447fe551f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b308b1bf-8c0f-4cd7-8b52-15447fe551f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b308b1bf-8c0f-4cd7-8b52-15447fe551f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:00:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b308b1bf-8c0f-4cd7-8b52-15447fe551f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b308b1bf-8c0f-4cd7-8b52-15447fe551f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b308b1bf-8c0f-4cd7-8b52-15447fe551f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b308b1bf-8c0f-4cd7-8b52-15447fe551f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b308b1bf-8c0f-4cd7-8b52-15447fe551f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b308b1bf-8c0f-4cd7-8b52-15447fe551f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b308b1bf-8c0f-4cd7-8b52-15447fe551f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b308b1bf-8c0f-4cd7-8b52-15447fe551f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bbc00e86-dd9f-4740-be7f-025032ed698b"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bbc00e86-dd9f-4740-be7f-025032ed698b"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bbc00e86-dd9f-4740-be7f-025032ed698b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bbc00e86-dd9f-4740-be7f-025032ed698b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bbc00e86-dd9f-4740-be7f-025032ed698b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bbc00e86-dd9f-4740-be7f-025032ed698b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bbc00e86-dd9f-4740-be7f-025032ed698b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bbc00e86-dd9f-4740-be7f-025032ed698b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bbc00e86-dd9f-4740-be7f-025032ed698b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bbc00e86-dd9f-4740-be7f-025032ed698b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bbc00e86-dd9f-4740-be7f-025032ed698b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bbc00e86-dd9f-4740-be7f-025032ed698b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bbc00e86-dd9f-4740-be7f-025032ed698b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bbc00e86-dd9f-4740-be7f-025032ed698b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bbc00e86-dd9f-4740-be7f-025032ed698b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bbc00e86-dd9f-4740-be7f-025032ed698b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bbc00e86-dd9f-4740-be7f-025032ed698b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bbc00e86-dd9f-4740-be7f-025032ed698b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:00:20Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"555b2baa-ebf6-492e-b5ec-cad6ba89f679","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"555b2baa-ebf6-492e-b5ec-cad6ba89f679","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-user-perm-test-526006","reconcileID":"3a44bea8-c9b7-4488-9777-5162b42c67ec"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-user-perm-test-526006","reconcileID":"f5f5b2a8-e872-42ed-8211-14fcdff7d080"} {"level":"info","ts":"2026-07-13T05:00:20Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-user-perm-test-526006","reconcileID":"12e843c2-c507-413d-bb5f-8ba1677ae0db"} {"level":"info","ts":"2026-07-13T05:00:46Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fa664a5-3e10-4994-b114-5d9810c2c0f0"} {"level":"info","ts":"2026-07-13T05:00:46Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fa664a5-3e10-4994-b114-5d9810c2c0f0"} {"level":"info","ts":"2026-07-13T05:00:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fa664a5-3e10-4994-b114-5d9810c2c0f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:00:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fa664a5-3e10-4994-b114-5d9810c2c0f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:00:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fa664a5-3e10-4994-b114-5d9810c2c0f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:00:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fa664a5-3e10-4994-b114-5d9810c2c0f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:00:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fa664a5-3e10-4994-b114-5d9810c2c0f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:00:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fa664a5-3e10-4994-b114-5d9810c2c0f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:00:46Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fa664a5-3e10-4994-b114-5d9810c2c0f0","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:00:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fa664a5-3e10-4994-b114-5d9810c2c0f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fa664a5-3e10-4994-b114-5d9810c2c0f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fa664a5-3e10-4994-b114-5d9810c2c0f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:00:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fa664a5-3e10-4994-b114-5d9810c2c0f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:00:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fa664a5-3e10-4994-b114-5d9810c2c0f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-13T05:00:53Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T05:01:01Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9f7bb07b-3e98-40cd-8f5d-18fcba9cc4a8"} {"level":"info","ts":"2026-07-13T05:01:01Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9f7bb07b-3e98-40cd-8f5d-18fcba9cc4a8"} {"level":"info","ts":"2026-07-13T05:01:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9f7bb07b-3e98-40cd-8f5d-18fcba9cc4a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:01:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9f7bb07b-3e98-40cd-8f5d-18fcba9cc4a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:01:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9f7bb07b-3e98-40cd-8f5d-18fcba9cc4a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:01:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9f7bb07b-3e98-40cd-8f5d-18fcba9cc4a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:01:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9f7bb07b-3e98-40cd-8f5d-18fcba9cc4a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:01:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9f7bb07b-3e98-40cd-8f5d-18fcba9cc4a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:01:01Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9f7bb07b-3e98-40cd-8f5d-18fcba9cc4a8","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:01:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9f7bb07b-3e98-40cd-8f5d-18fcba9cc4a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:01:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9f7bb07b-3e98-40cd-8f5d-18fcba9cc4a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:01:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9f7bb07b-3e98-40cd-8f5d-18fcba9cc4a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:01:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9f7bb07b-3e98-40cd-8f5d-18fcba9cc4a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:01:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9f7bb07b-3e98-40cd-8f5d-18fcba9cc4a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:01:16Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"928c14a8-69ea-4a91-beb2-db66f2c82be7"} {"level":"info","ts":"2026-07-13T05:01:16Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"928c14a8-69ea-4a91-beb2-db66f2c82be7"} {"level":"info","ts":"2026-07-13T05:01:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"928c14a8-69ea-4a91-beb2-db66f2c82be7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:01:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"928c14a8-69ea-4a91-beb2-db66f2c82be7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:01:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"928c14a8-69ea-4a91-beb2-db66f2c82be7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:01:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"928c14a8-69ea-4a91-beb2-db66f2c82be7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:01:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"928c14a8-69ea-4a91-beb2-db66f2c82be7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:01:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"928c14a8-69ea-4a91-beb2-db66f2c82be7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:01:16Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"928c14a8-69ea-4a91-beb2-db66f2c82be7","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:01:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"928c14a8-69ea-4a91-beb2-db66f2c82be7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:01:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"928c14a8-69ea-4a91-beb2-db66f2c82be7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:01:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"928c14a8-69ea-4a91-beb2-db66f2c82be7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:01:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"928c14a8-69ea-4a91-beb2-db66f2c82be7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:01:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"928c14a8-69ea-4a91-beb2-db66f2c82be7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:01:25Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-edit-test-project-609558","reconcileID":"906bf7f2-75aa-4c14-9e16-3511a20b3cfa"} {"level":"info","ts":"2026-07-13T05:01:25Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-edit-test-project-609558","reconcileID":"424ffc3d-4902-40b6-8981-dbc1186dc264"} {"level":"info","ts":"2026-07-13T05:01:25Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-edit-test-project-609558","reconcileID":"9a74ea3c-4d76-49b8-b188-3239c1eb9f5f"} {"level":"error","ts":"2026-07-13T05:01:37Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T05:01:46Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d37c1175-e11d-45f8-9a85-5dda772fc2ad"} {"level":"info","ts":"2026-07-13T05:01:46Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d37c1175-e11d-45f8-9a85-5dda772fc2ad"} {"level":"info","ts":"2026-07-13T05:01:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d37c1175-e11d-45f8-9a85-5dda772fc2ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:01:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d37c1175-e11d-45f8-9a85-5dda772fc2ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:01:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d37c1175-e11d-45f8-9a85-5dda772fc2ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:01:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d37c1175-e11d-45f8-9a85-5dda772fc2ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:01:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d37c1175-e11d-45f8-9a85-5dda772fc2ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:01:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d37c1175-e11d-45f8-9a85-5dda772fc2ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:01:46Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d37c1175-e11d-45f8-9a85-5dda772fc2ad","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:01:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d37c1175-e11d-45f8-9a85-5dda772fc2ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:01:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d37c1175-e11d-45f8-9a85-5dda772fc2ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:01:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d37c1175-e11d-45f8-9a85-5dda772fc2ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:01:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d37c1175-e11d-45f8-9a85-5dda772fc2ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:01:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d37c1175-e11d-45f8-9a85-5dda772fc2ad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:01:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"qe-cluster-storage-sc-dsp","reconcileID":"5a0414cd-9e25-4a80-91c8-8a4e8ce3e74a"} {"level":"info","ts":"2026-07-13T05:01:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"qe-cluster-storage-sc-dsp","reconcileID":"f8dda5ad-c235-4b95-ad95-c46e4145bd56"} {"level":"info","ts":"2026-07-13T05:01:47Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"qe-cluster-storage-sc-dsp","reconcileID":"c3c24118-701c-47d5-8c9f-c32f61323a92"} {"level":"info","ts":"2026-07-13T05:02:01Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"00872d11-8ba2-4816-bd21-e7dc08785e24"} {"level":"info","ts":"2026-07-13T05:02:01Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"00872d11-8ba2-4816-bd21-e7dc08785e24"} {"level":"info","ts":"2026-07-13T05:02:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"00872d11-8ba2-4816-bd21-e7dc08785e24","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"00872d11-8ba2-4816-bd21-e7dc08785e24","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"00872d11-8ba2-4816-bd21-e7dc08785e24","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:02:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"00872d11-8ba2-4816-bd21-e7dc08785e24","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:02:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"00872d11-8ba2-4816-bd21-e7dc08785e24","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:02:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"00872d11-8ba2-4816-bd21-e7dc08785e24","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:02:01Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"00872d11-8ba2-4816-bd21-e7dc08785e24","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:02:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"00872d11-8ba2-4816-bd21-e7dc08785e24","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"00872d11-8ba2-4816-bd21-e7dc08785e24","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"00872d11-8ba2-4816-bd21-e7dc08785e24","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:02:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"00872d11-8ba2-4816-bd21-e7dc08785e24","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"00872d11-8ba2-4816-bd21-e7dc08785e24","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:02:16Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d3239738-ff7e-44c4-bde6-bb3bd578c51e"} {"level":"info","ts":"2026-07-13T05:02:16Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d3239738-ff7e-44c4-bde6-bb3bd578c51e"} {"level":"info","ts":"2026-07-13T05:02:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d3239738-ff7e-44c4-bde6-bb3bd578c51e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d3239738-ff7e-44c4-bde6-bb3bd578c51e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d3239738-ff7e-44c4-bde6-bb3bd578c51e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:02:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d3239738-ff7e-44c4-bde6-bb3bd578c51e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:02:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d3239738-ff7e-44c4-bde6-bb3bd578c51e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:02:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d3239738-ff7e-44c4-bde6-bb3bd578c51e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:02:16Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d3239738-ff7e-44c4-bde6-bb3bd578c51e","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:02:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d3239738-ff7e-44c4-bde6-bb3bd578c51e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d3239738-ff7e-44c4-bde6-bb3bd578c51e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d3239738-ff7e-44c4-bde6-bb3bd578c51e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:02:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d3239738-ff7e-44c4-bde6-bb3bd578c51e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d3239738-ff7e-44c4-bde6-bb3bd578c51e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b0c217f0-89c5-437a-879b-ec88fa92605a"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b0c217f0-89c5-437a-879b-ec88fa92605a"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b0c217f0-89c5-437a-879b-ec88fa92605a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b0c217f0-89c5-437a-879b-ec88fa92605a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b0c217f0-89c5-437a-879b-ec88fa92605a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b0c217f0-89c5-437a-879b-ec88fa92605a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b0c217f0-89c5-437a-879b-ec88fa92605a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b0c217f0-89c5-437a-879b-ec88fa92605a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:02:18Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b0c217f0-89c5-437a-879b-ec88fa92605a","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b0c217f0-89c5-437a-879b-ec88fa92605a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b0c217f0-89c5-437a-879b-ec88fa92605a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b0c217f0-89c5-437a-879b-ec88fa92605a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b0c217f0-89c5-437a-879b-ec88fa92605a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b0c217f0-89c5-437a-879b-ec88fa92605a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"20c8560a-d08f-4431-b145-f5f9508d0c06"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"20c8560a-d08f-4431-b145-f5f9508d0c06"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"20c8560a-d08f-4431-b145-f5f9508d0c06","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"20c8560a-d08f-4431-b145-f5f9508d0c06","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"20c8560a-d08f-4431-b145-f5f9508d0c06","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"20c8560a-d08f-4431-b145-f5f9508d0c06","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"20c8560a-d08f-4431-b145-f5f9508d0c06","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"20c8560a-d08f-4431-b145-f5f9508d0c06","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:02:18Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"20c8560a-d08f-4431-b145-f5f9508d0c06","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"20c8560a-d08f-4431-b145-f5f9508d0c06","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"20c8560a-d08f-4431-b145-f5f9508d0c06","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"20c8560a-d08f-4431-b145-f5f9508d0c06","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"20c8560a-d08f-4431-b145-f5f9508d0c06","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"20c8560a-d08f-4431-b145-f5f9508d0c06","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a6fe69f9-5778-4ab2-a563-356e7af99a85"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a6fe69f9-5778-4ab2-a563-356e7af99a85"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a6fe69f9-5778-4ab2-a563-356e7af99a85","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a6fe69f9-5778-4ab2-a563-356e7af99a85","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a6fe69f9-5778-4ab2-a563-356e7af99a85","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a6fe69f9-5778-4ab2-a563-356e7af99a85","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a6fe69f9-5778-4ab2-a563-356e7af99a85","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a6fe69f9-5778-4ab2-a563-356e7af99a85","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:02:18Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a6fe69f9-5778-4ab2-a563-356e7af99a85","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a6fe69f9-5778-4ab2-a563-356e7af99a85","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a6fe69f9-5778-4ab2-a563-356e7af99a85","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a6fe69f9-5778-4ab2-a563-356e7af99a85","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a6fe69f9-5778-4ab2-a563-356e7af99a85","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a6fe69f9-5778-4ab2-a563-356e7af99a85","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3ec72bef-a492-4624-9c78-34ae2c2dfb8d"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3ec72bef-a492-4624-9c78-34ae2c2dfb8d"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3ec72bef-a492-4624-9c78-34ae2c2dfb8d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3ec72bef-a492-4624-9c78-34ae2c2dfb8d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3ec72bef-a492-4624-9c78-34ae2c2dfb8d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3ec72bef-a492-4624-9c78-34ae2c2dfb8d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3ec72bef-a492-4624-9c78-34ae2c2dfb8d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3ec72bef-a492-4624-9c78-34ae2c2dfb8d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3ec72bef-a492-4624-9c78-34ae2c2dfb8d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3ec72bef-a492-4624-9c78-34ae2c2dfb8d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3ec72bef-a492-4624-9c78-34ae2c2dfb8d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3ec72bef-a492-4624-9c78-34ae2c2dfb8d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3ec72bef-a492-4624-9c78-34ae2c2dfb8d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3ec72bef-a492-4624-9c78-34ae2c2dfb8d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3ec72bef-a492-4624-9c78-34ae2c2dfb8d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3ec72bef-a492-4624-9c78-34ae2c2dfb8d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3ec72bef-a492-4624-9c78-34ae2c2dfb8d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3ec72bef-a492-4624-9c78-34ae2c2dfb8d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:02:18Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"46a3bd76-8c78-4a3e-b41a-fed917e0b786","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:02:18Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"46a3bd76-8c78-4a3e-b41a-fed917e0b786","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:02:19Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60890b0d-f554-4551-9f6b-34d311098d3f"} {"level":"info","ts":"2026-07-13T05:02:19Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60890b0d-f554-4551-9f6b-34d311098d3f"} {"level":"info","ts":"2026-07-13T05:02:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60890b0d-f554-4551-9f6b-34d311098d3f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60890b0d-f554-4551-9f6b-34d311098d3f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:02:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60890b0d-f554-4551-9f6b-34d311098d3f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:02:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60890b0d-f554-4551-9f6b-34d311098d3f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:02:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60890b0d-f554-4551-9f6b-34d311098d3f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:02:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60890b0d-f554-4551-9f6b-34d311098d3f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:02:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60890b0d-f554-4551-9f6b-34d311098d3f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:02:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60890b0d-f554-4551-9f6b-34d311098d3f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:02:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60890b0d-f554-4551-9f6b-34d311098d3f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:02:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60890b0d-f554-4551-9f6b-34d311098d3f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:02:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60890b0d-f554-4551-9f6b-34d311098d3f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:02:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60890b0d-f554-4551-9f6b-34d311098d3f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60890b0d-f554-4551-9f6b-34d311098d3f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60890b0d-f554-4551-9f6b-34d311098d3f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:02:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60890b0d-f554-4551-9f6b-34d311098d3f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:19Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60890b0d-f554-4551-9f6b-34d311098d3f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:02:19Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e5a9cf8c-3dfe-4ce5-a5a3-addf64cc7b2e","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:02:19Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e5a9cf8c-3dfe-4ce5-a5a3-addf64cc7b2e","name":"redhat-ods-applications"} {"level":"error","ts":"2026-07-13T05:02:24Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T05:02:31Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2d1466b1-e865-4d59-b04a-8ba1cf97534a"} {"level":"info","ts":"2026-07-13T05:02:31Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2d1466b1-e865-4d59-b04a-8ba1cf97534a"} {"level":"info","ts":"2026-07-13T05:02:31Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2d1466b1-e865-4d59-b04a-8ba1cf97534a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:31Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2d1466b1-e865-4d59-b04a-8ba1cf97534a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:31Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2d1466b1-e865-4d59-b04a-8ba1cf97534a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:02:31Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2d1466b1-e865-4d59-b04a-8ba1cf97534a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:02:31Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2d1466b1-e865-4d59-b04a-8ba1cf97534a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:02:31Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2d1466b1-e865-4d59-b04a-8ba1cf97534a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:02:31Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2d1466b1-e865-4d59-b04a-8ba1cf97534a","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:02:31Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2d1466b1-e865-4d59-b04a-8ba1cf97534a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:31Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2d1466b1-e865-4d59-b04a-8ba1cf97534a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:31Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2d1466b1-e865-4d59-b04a-8ba1cf97534a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:02:31Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2d1466b1-e865-4d59-b04a-8ba1cf97534a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:31Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2d1466b1-e865-4d59-b04a-8ba1cf97534a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:02:41Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-cluster-storage-access-modes","reconcileID":"0ee96ef2-19a4-4ef1-ae9a-4b85d43617bf"} {"level":"info","ts":"2026-07-13T05:02:41Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-cluster-storage-access-modes","reconcileID":"5bee3092-226f-4188-9157-bd38b37d291d"} {"level":"info","ts":"2026-07-13T05:02:41Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-cluster-storage-access-modes","reconcileID":"91dd2038-ecaf-41af-8aac-23958bd85ae8"} {"level":"info","ts":"2026-07-13T05:02:46Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0cc789e5-d614-4f97-b07f-8819e79e387e"} {"level":"info","ts":"2026-07-13T05:02:46Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0cc789e5-d614-4f97-b07f-8819e79e387e"} {"level":"info","ts":"2026-07-13T05:02:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0cc789e5-d614-4f97-b07f-8819e79e387e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0cc789e5-d614-4f97-b07f-8819e79e387e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0cc789e5-d614-4f97-b07f-8819e79e387e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:02:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0cc789e5-d614-4f97-b07f-8819e79e387e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:02:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0cc789e5-d614-4f97-b07f-8819e79e387e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:02:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0cc789e5-d614-4f97-b07f-8819e79e387e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:02:46Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0cc789e5-d614-4f97-b07f-8819e79e387e","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:02:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0cc789e5-d614-4f97-b07f-8819e79e387e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0cc789e5-d614-4f97-b07f-8819e79e387e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0cc789e5-d614-4f97-b07f-8819e79e387e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:02:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0cc789e5-d614-4f97-b07f-8819e79e387e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0cc789e5-d614-4f97-b07f-8819e79e387e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a63a7a05-0faf-49b1-a6d8-fdec4021addd"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a63a7a05-0faf-49b1-a6d8-fdec4021addd"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a63a7a05-0faf-49b1-a6d8-fdec4021addd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a63a7a05-0faf-49b1-a6d8-fdec4021addd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a63a7a05-0faf-49b1-a6d8-fdec4021addd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a63a7a05-0faf-49b1-a6d8-fdec4021addd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a63a7a05-0faf-49b1-a6d8-fdec4021addd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a63a7a05-0faf-49b1-a6d8-fdec4021addd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:02:47Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a63a7a05-0faf-49b1-a6d8-fdec4021addd","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a63a7a05-0faf-49b1-a6d8-fdec4021addd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a63a7a05-0faf-49b1-a6d8-fdec4021addd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a63a7a05-0faf-49b1-a6d8-fdec4021addd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a63a7a05-0faf-49b1-a6d8-fdec4021addd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a63a7a05-0faf-49b1-a6d8-fdec4021addd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df587c9d-469e-4d69-bc6d-304a32dd14a1"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df587c9d-469e-4d69-bc6d-304a32dd14a1"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df587c9d-469e-4d69-bc6d-304a32dd14a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df587c9d-469e-4d69-bc6d-304a32dd14a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df587c9d-469e-4d69-bc6d-304a32dd14a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df587c9d-469e-4d69-bc6d-304a32dd14a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df587c9d-469e-4d69-bc6d-304a32dd14a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df587c9d-469e-4d69-bc6d-304a32dd14a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:02:47Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df587c9d-469e-4d69-bc6d-304a32dd14a1","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df587c9d-469e-4d69-bc6d-304a32dd14a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df587c9d-469e-4d69-bc6d-304a32dd14a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df587c9d-469e-4d69-bc6d-304a32dd14a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df587c9d-469e-4d69-bc6d-304a32dd14a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df587c9d-469e-4d69-bc6d-304a32dd14a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc9608ac-84f0-43c8-b919-4d0616f322ac"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc9608ac-84f0-43c8-b919-4d0616f322ac"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc9608ac-84f0-43c8-b919-4d0616f322ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc9608ac-84f0-43c8-b919-4d0616f322ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc9608ac-84f0-43c8-b919-4d0616f322ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc9608ac-84f0-43c8-b919-4d0616f322ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc9608ac-84f0-43c8-b919-4d0616f322ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc9608ac-84f0-43c8-b919-4d0616f322ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:02:47Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc9608ac-84f0-43c8-b919-4d0616f322ac","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc9608ac-84f0-43c8-b919-4d0616f322ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc9608ac-84f0-43c8-b919-4d0616f322ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc9608ac-84f0-43c8-b919-4d0616f322ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc9608ac-84f0-43c8-b919-4d0616f322ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cc9608ac-84f0-43c8-b919-4d0616f322ac","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77765407-7b10-4f59-a95e-5a177fce37d7"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77765407-7b10-4f59-a95e-5a177fce37d7"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77765407-7b10-4f59-a95e-5a177fce37d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77765407-7b10-4f59-a95e-5a177fce37d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77765407-7b10-4f59-a95e-5a177fce37d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77765407-7b10-4f59-a95e-5a177fce37d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77765407-7b10-4f59-a95e-5a177fce37d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77765407-7b10-4f59-a95e-5a177fce37d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77765407-7b10-4f59-a95e-5a177fce37d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77765407-7b10-4f59-a95e-5a177fce37d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77765407-7b10-4f59-a95e-5a177fce37d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77765407-7b10-4f59-a95e-5a177fce37d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77765407-7b10-4f59-a95e-5a177fce37d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77765407-7b10-4f59-a95e-5a177fce37d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77765407-7b10-4f59-a95e-5a177fce37d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77765407-7b10-4f59-a95e-5a177fce37d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77765407-7b10-4f59-a95e-5a177fce37d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"77765407-7b10-4f59-a95e-5a177fce37d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:02:47Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"712baaa2-06de-4256-860a-a71319518664","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:02:47Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"712baaa2-06de-4256-860a-a71319518664","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:02:48Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"92aaf37a-7e21-46f3-9581-9f1170402677"} {"level":"info","ts":"2026-07-13T05:02:48Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"92aaf37a-7e21-46f3-9581-9f1170402677"} {"level":"info","ts":"2026-07-13T05:02:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"92aaf37a-7e21-46f3-9581-9f1170402677","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"92aaf37a-7e21-46f3-9581-9f1170402677","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:02:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"92aaf37a-7e21-46f3-9581-9f1170402677","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:02:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"92aaf37a-7e21-46f3-9581-9f1170402677","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:02:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"92aaf37a-7e21-46f3-9581-9f1170402677","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:02:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"92aaf37a-7e21-46f3-9581-9f1170402677","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:02:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"92aaf37a-7e21-46f3-9581-9f1170402677","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:02:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"92aaf37a-7e21-46f3-9581-9f1170402677","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:02:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"92aaf37a-7e21-46f3-9581-9f1170402677","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:02:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"92aaf37a-7e21-46f3-9581-9f1170402677","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:02:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"92aaf37a-7e21-46f3-9581-9f1170402677","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:02:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"92aaf37a-7e21-46f3-9581-9f1170402677","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"92aaf37a-7e21-46f3-9581-9f1170402677","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"92aaf37a-7e21-46f3-9581-9f1170402677","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:02:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"92aaf37a-7e21-46f3-9581-9f1170402677","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"92aaf37a-7e21-46f3-9581-9f1170402677","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:02:48Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"bbb50f35-284e-47b6-9247-310bc413b3ce","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:02:48Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"bbb50f35-284e-47b6-9247-310bc413b3ce","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"936ee98b-7c06-4efc-b86d-69163ccb5d07"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"936ee98b-7c06-4efc-b86d-69163ccb5d07"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"936ee98b-7c06-4efc-b86d-69163ccb5d07","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"936ee98b-7c06-4efc-b86d-69163ccb5d07","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"936ee98b-7c06-4efc-b86d-69163ccb5d07","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"936ee98b-7c06-4efc-b86d-69163ccb5d07","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"936ee98b-7c06-4efc-b86d-69163ccb5d07","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"936ee98b-7c06-4efc-b86d-69163ccb5d07","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:02:53Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"936ee98b-7c06-4efc-b86d-69163ccb5d07","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"936ee98b-7c06-4efc-b86d-69163ccb5d07","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"936ee98b-7c06-4efc-b86d-69163ccb5d07","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"936ee98b-7c06-4efc-b86d-69163ccb5d07","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"936ee98b-7c06-4efc-b86d-69163ccb5d07","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"936ee98b-7c06-4efc-b86d-69163ccb5d07","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a7610398-0926-4beb-8390-a0a4117fd1c8"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a7610398-0926-4beb-8390-a0a4117fd1c8"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a7610398-0926-4beb-8390-a0a4117fd1c8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a7610398-0926-4beb-8390-a0a4117fd1c8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a7610398-0926-4beb-8390-a0a4117fd1c8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a7610398-0926-4beb-8390-a0a4117fd1c8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a7610398-0926-4beb-8390-a0a4117fd1c8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a7610398-0926-4beb-8390-a0a4117fd1c8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:02:53Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a7610398-0926-4beb-8390-a0a4117fd1c8","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a7610398-0926-4beb-8390-a0a4117fd1c8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a7610398-0926-4beb-8390-a0a4117fd1c8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a7610398-0926-4beb-8390-a0a4117fd1c8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a7610398-0926-4beb-8390-a0a4117fd1c8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a7610398-0926-4beb-8390-a0a4117fd1c8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e62a68e0-7e1f-40d3-88fb-b60b1f329493"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e62a68e0-7e1f-40d3-88fb-b60b1f329493"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e62a68e0-7e1f-40d3-88fb-b60b1f329493","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e62a68e0-7e1f-40d3-88fb-b60b1f329493","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e62a68e0-7e1f-40d3-88fb-b60b1f329493","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e62a68e0-7e1f-40d3-88fb-b60b1f329493","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e62a68e0-7e1f-40d3-88fb-b60b1f329493","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e62a68e0-7e1f-40d3-88fb-b60b1f329493","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:02:53Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e62a68e0-7e1f-40d3-88fb-b60b1f329493","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e62a68e0-7e1f-40d3-88fb-b60b1f329493","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e62a68e0-7e1f-40d3-88fb-b60b1f329493","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e62a68e0-7e1f-40d3-88fb-b60b1f329493","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e62a68e0-7e1f-40d3-88fb-b60b1f329493","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e62a68e0-7e1f-40d3-88fb-b60b1f329493","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ec2b55b-4f9c-40b8-97f0-0a0b358ed541"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ec2b55b-4f9c-40b8-97f0-0a0b358ed541"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ec2b55b-4f9c-40b8-97f0-0a0b358ed541","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ec2b55b-4f9c-40b8-97f0-0a0b358ed541","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ec2b55b-4f9c-40b8-97f0-0a0b358ed541","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ec2b55b-4f9c-40b8-97f0-0a0b358ed541","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ec2b55b-4f9c-40b8-97f0-0a0b358ed541","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ec2b55b-4f9c-40b8-97f0-0a0b358ed541","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ec2b55b-4f9c-40b8-97f0-0a0b358ed541","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ec2b55b-4f9c-40b8-97f0-0a0b358ed541","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ec2b55b-4f9c-40b8-97f0-0a0b358ed541","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ec2b55b-4f9c-40b8-97f0-0a0b358ed541","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ec2b55b-4f9c-40b8-97f0-0a0b358ed541","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ec2b55b-4f9c-40b8-97f0-0a0b358ed541","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ec2b55b-4f9c-40b8-97f0-0a0b358ed541","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ec2b55b-4f9c-40b8-97f0-0a0b358ed541","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ec2b55b-4f9c-40b8-97f0-0a0b358ed541","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ec2b55b-4f9c-40b8-97f0-0a0b358ed541","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"9094756e-f74d-4f4b-952e-753c9d2960de","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"9094756e-f74d-4f4b-952e-753c9d2960de","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fdb9709d-92ba-4877-bd2e-153095ecb326"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fdb9709d-92ba-4877-bd2e-153095ecb326"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fdb9709d-92ba-4877-bd2e-153095ecb326","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fdb9709d-92ba-4877-bd2e-153095ecb326","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fdb9709d-92ba-4877-bd2e-153095ecb326","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fdb9709d-92ba-4877-bd2e-153095ecb326","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fdb9709d-92ba-4877-bd2e-153095ecb326","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fdb9709d-92ba-4877-bd2e-153095ecb326","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fdb9709d-92ba-4877-bd2e-153095ecb326","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fdb9709d-92ba-4877-bd2e-153095ecb326","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fdb9709d-92ba-4877-bd2e-153095ecb326","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fdb9709d-92ba-4877-bd2e-153095ecb326","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fdb9709d-92ba-4877-bd2e-153095ecb326","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fdb9709d-92ba-4877-bd2e-153095ecb326","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fdb9709d-92ba-4877-bd2e-153095ecb326","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fdb9709d-92ba-4877-bd2e-153095ecb326","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fdb9709d-92ba-4877-bd2e-153095ecb326","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:02:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fdb9709d-92ba-4877-bd2e-153095ecb326","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-13T05:03:10Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T05:03:16Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e6eeda2-12f0-4bef-a904-548e2ef5b44d"} {"level":"info","ts":"2026-07-13T05:03:16Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e6eeda2-12f0-4bef-a904-548e2ef5b44d"} {"level":"info","ts":"2026-07-13T05:03:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e6eeda2-12f0-4bef-a904-548e2ef5b44d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:03:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e6eeda2-12f0-4bef-a904-548e2ef5b44d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:03:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e6eeda2-12f0-4bef-a904-548e2ef5b44d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:03:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e6eeda2-12f0-4bef-a904-548e2ef5b44d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:03:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e6eeda2-12f0-4bef-a904-548e2ef5b44d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:03:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e6eeda2-12f0-4bef-a904-548e2ef5b44d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:03:16Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e6eeda2-12f0-4bef-a904-548e2ef5b44d","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:03:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e6eeda2-12f0-4bef-a904-548e2ef5b44d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e6eeda2-12f0-4bef-a904-548e2ef5b44d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e6eeda2-12f0-4bef-a904-548e2ef5b44d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:03:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e6eeda2-12f0-4bef-a904-548e2ef5b44d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e6eeda2-12f0-4bef-a904-548e2ef5b44d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:03:22Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0accebd3-ef7a-4800-a17a-2db59049cfab"} {"level":"info","ts":"2026-07-13T05:03:22Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0accebd3-ef7a-4800-a17a-2db59049cfab"} {"level":"info","ts":"2026-07-13T05:03:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0accebd3-ef7a-4800-a17a-2db59049cfab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:03:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0accebd3-ef7a-4800-a17a-2db59049cfab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:03:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0accebd3-ef7a-4800-a17a-2db59049cfab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:03:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0accebd3-ef7a-4800-a17a-2db59049cfab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:03:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0accebd3-ef7a-4800-a17a-2db59049cfab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:03:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0accebd3-ef7a-4800-a17a-2db59049cfab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:03:22Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0accebd3-ef7a-4800-a17a-2db59049cfab","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:03:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0accebd3-ef7a-4800-a17a-2db59049cfab","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0accebd3-ef7a-4800-a17a-2db59049cfab","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0accebd3-ef7a-4800-a17a-2db59049cfab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:03:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0accebd3-ef7a-4800-a17a-2db59049cfab","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0accebd3-ef7a-4800-a17a-2db59049cfab","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:03:22Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c014c45f-0ff7-468a-87ef-8b8b7fca4c65"} {"level":"info","ts":"2026-07-13T05:03:22Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c014c45f-0ff7-468a-87ef-8b8b7fca4c65"} {"level":"info","ts":"2026-07-13T05:03:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c014c45f-0ff7-468a-87ef-8b8b7fca4c65","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c014c45f-0ff7-468a-87ef-8b8b7fca4c65","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c014c45f-0ff7-468a-87ef-8b8b7fca4c65","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c014c45f-0ff7-468a-87ef-8b8b7fca4c65","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c014c45f-0ff7-468a-87ef-8b8b7fca4c65","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c014c45f-0ff7-468a-87ef-8b8b7fca4c65","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:03:23Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c014c45f-0ff7-468a-87ef-8b8b7fca4c65","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c014c45f-0ff7-468a-87ef-8b8b7fca4c65","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c014c45f-0ff7-468a-87ef-8b8b7fca4c65","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c014c45f-0ff7-468a-87ef-8b8b7fca4c65","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c014c45f-0ff7-468a-87ef-8b8b7fca4c65","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c014c45f-0ff7-468a-87ef-8b8b7fca4c65","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6f836cda-d1cc-49cc-b366-fa41760b48b1"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6f836cda-d1cc-49cc-b366-fa41760b48b1"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6f836cda-d1cc-49cc-b366-fa41760b48b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6f836cda-d1cc-49cc-b366-fa41760b48b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6f836cda-d1cc-49cc-b366-fa41760b48b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6f836cda-d1cc-49cc-b366-fa41760b48b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6f836cda-d1cc-49cc-b366-fa41760b48b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6f836cda-d1cc-49cc-b366-fa41760b48b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:03:23Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6f836cda-d1cc-49cc-b366-fa41760b48b1","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6f836cda-d1cc-49cc-b366-fa41760b48b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6f836cda-d1cc-49cc-b366-fa41760b48b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6f836cda-d1cc-49cc-b366-fa41760b48b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6f836cda-d1cc-49cc-b366-fa41760b48b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6f836cda-d1cc-49cc-b366-fa41760b48b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f7294fb9-e7da-4005-9cd5-9f014b20110e"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f7294fb9-e7da-4005-9cd5-9f014b20110e"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f7294fb9-e7da-4005-9cd5-9f014b20110e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f7294fb9-e7da-4005-9cd5-9f014b20110e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f7294fb9-e7da-4005-9cd5-9f014b20110e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f7294fb9-e7da-4005-9cd5-9f014b20110e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f7294fb9-e7da-4005-9cd5-9f014b20110e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f7294fb9-e7da-4005-9cd5-9f014b20110e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f7294fb9-e7da-4005-9cd5-9f014b20110e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f7294fb9-e7da-4005-9cd5-9f014b20110e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f7294fb9-e7da-4005-9cd5-9f014b20110e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f7294fb9-e7da-4005-9cd5-9f014b20110e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f7294fb9-e7da-4005-9cd5-9f014b20110e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f7294fb9-e7da-4005-9cd5-9f014b20110e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f7294fb9-e7da-4005-9cd5-9f014b20110e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f7294fb9-e7da-4005-9cd5-9f014b20110e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f7294fb9-e7da-4005-9cd5-9f014b20110e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f7294fb9-e7da-4005-9cd5-9f014b20110e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:03:23Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"d3acefa3-ea1d-49ad-896f-d199efca48fb","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"d3acefa3-ea1d-49ad-896f-d199efca48fb","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8fc967b-21a5-486e-ae26-87311dca020f"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8fc967b-21a5-486e-ae26-87311dca020f"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8fc967b-21a5-486e-ae26-87311dca020f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8fc967b-21a5-486e-ae26-87311dca020f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8fc967b-21a5-486e-ae26-87311dca020f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8fc967b-21a5-486e-ae26-87311dca020f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8fc967b-21a5-486e-ae26-87311dca020f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8fc967b-21a5-486e-ae26-87311dca020f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8fc967b-21a5-486e-ae26-87311dca020f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8fc967b-21a5-486e-ae26-87311dca020f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8fc967b-21a5-486e-ae26-87311dca020f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8fc967b-21a5-486e-ae26-87311dca020f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8fc967b-21a5-486e-ae26-87311dca020f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8fc967b-21a5-486e-ae26-87311dca020f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8fc967b-21a5-486e-ae26-87311dca020f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8fc967b-21a5-486e-ae26-87311dca020f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8fc967b-21a5-486e-ae26-87311dca020f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:23Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8fc967b-21a5-486e-ae26-87311dca020f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a4dd4af9-919a-4d03-82e1-1d861b4281ab"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a4dd4af9-919a-4d03-82e1-1d861b4281ab"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a4dd4af9-919a-4d03-82e1-1d861b4281ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a4dd4af9-919a-4d03-82e1-1d861b4281ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a4dd4af9-919a-4d03-82e1-1d861b4281ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a4dd4af9-919a-4d03-82e1-1d861b4281ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a4dd4af9-919a-4d03-82e1-1d861b4281ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a4dd4af9-919a-4d03-82e1-1d861b4281ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:03:29Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a4dd4af9-919a-4d03-82e1-1d861b4281ab","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a4dd4af9-919a-4d03-82e1-1d861b4281ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a4dd4af9-919a-4d03-82e1-1d861b4281ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a4dd4af9-919a-4d03-82e1-1d861b4281ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a4dd4af9-919a-4d03-82e1-1d861b4281ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a4dd4af9-919a-4d03-82e1-1d861b4281ab","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"11577f18-d631-42ef-a616-f5ae5728e130"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"11577f18-d631-42ef-a616-f5ae5728e130"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"11577f18-d631-42ef-a616-f5ae5728e130","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"11577f18-d631-42ef-a616-f5ae5728e130","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"11577f18-d631-42ef-a616-f5ae5728e130","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"11577f18-d631-42ef-a616-f5ae5728e130","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"11577f18-d631-42ef-a616-f5ae5728e130","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"11577f18-d631-42ef-a616-f5ae5728e130","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:03:29Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"11577f18-d631-42ef-a616-f5ae5728e130","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"11577f18-d631-42ef-a616-f5ae5728e130","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"11577f18-d631-42ef-a616-f5ae5728e130","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"11577f18-d631-42ef-a616-f5ae5728e130","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"11577f18-d631-42ef-a616-f5ae5728e130","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"11577f18-d631-42ef-a616-f5ae5728e130","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aba39edd-3f05-43a9-9ea6-f6b99ab5a6ae"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aba39edd-3f05-43a9-9ea6-f6b99ab5a6ae"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aba39edd-3f05-43a9-9ea6-f6b99ab5a6ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aba39edd-3f05-43a9-9ea6-f6b99ab5a6ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aba39edd-3f05-43a9-9ea6-f6b99ab5a6ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aba39edd-3f05-43a9-9ea6-f6b99ab5a6ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aba39edd-3f05-43a9-9ea6-f6b99ab5a6ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aba39edd-3f05-43a9-9ea6-f6b99ab5a6ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:03:29Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aba39edd-3f05-43a9-9ea6-f6b99ab5a6ae","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aba39edd-3f05-43a9-9ea6-f6b99ab5a6ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aba39edd-3f05-43a9-9ea6-f6b99ab5a6ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aba39edd-3f05-43a9-9ea6-f6b99ab5a6ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aba39edd-3f05-43a9-9ea6-f6b99ab5a6ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:29Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aba39edd-3f05-43a9-9ea6-f6b99ab5a6ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8dbed671-0d1d-4ad2-b89e-46e7f331f916"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8dbed671-0d1d-4ad2-b89e-46e7f331f916"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8dbed671-0d1d-4ad2-b89e-46e7f331f916","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8dbed671-0d1d-4ad2-b89e-46e7f331f916","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8dbed671-0d1d-4ad2-b89e-46e7f331f916","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8dbed671-0d1d-4ad2-b89e-46e7f331f916","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8dbed671-0d1d-4ad2-b89e-46e7f331f916","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8dbed671-0d1d-4ad2-b89e-46e7f331f916","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8dbed671-0d1d-4ad2-b89e-46e7f331f916","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8dbed671-0d1d-4ad2-b89e-46e7f331f916","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8dbed671-0d1d-4ad2-b89e-46e7f331f916","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8dbed671-0d1d-4ad2-b89e-46e7f331f916","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8dbed671-0d1d-4ad2-b89e-46e7f331f916","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8dbed671-0d1d-4ad2-b89e-46e7f331f916","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8dbed671-0d1d-4ad2-b89e-46e7f331f916","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8dbed671-0d1d-4ad2-b89e-46e7f331f916","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8dbed671-0d1d-4ad2-b89e-46e7f331f916","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8dbed671-0d1d-4ad2-b89e-46e7f331f916","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:03:30Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"f60daf9e-b2bd-44ec-bf51-6e06d6a62be7","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"f60daf9e-b2bd-44ec-bf51-6e06d6a62be7","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b25b10d-382a-407e-927b-cf98d9e4bfa4"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b25b10d-382a-407e-927b-cf98d9e4bfa4"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b25b10d-382a-407e-927b-cf98d9e4bfa4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b25b10d-382a-407e-927b-cf98d9e4bfa4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b25b10d-382a-407e-927b-cf98d9e4bfa4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b25b10d-382a-407e-927b-cf98d9e4bfa4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b25b10d-382a-407e-927b-cf98d9e4bfa4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b25b10d-382a-407e-927b-cf98d9e4bfa4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b25b10d-382a-407e-927b-cf98d9e4bfa4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b25b10d-382a-407e-927b-cf98d9e4bfa4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b25b10d-382a-407e-927b-cf98d9e4bfa4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b25b10d-382a-407e-927b-cf98d9e4bfa4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b25b10d-382a-407e-927b-cf98d9e4bfa4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b25b10d-382a-407e-927b-cf98d9e4bfa4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b25b10d-382a-407e-927b-cf98d9e4bfa4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b25b10d-382a-407e-927b-cf98d9e4bfa4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b25b10d-382a-407e-927b-cf98d9e4bfa4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b25b10d-382a-407e-927b-cf98d9e4bfa4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3813f0c-b622-4a30-a591-63847559cfa2"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3813f0c-b622-4a30-a591-63847559cfa2"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3813f0c-b622-4a30-a591-63847559cfa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3813f0c-b622-4a30-a591-63847559cfa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3813f0c-b622-4a30-a591-63847559cfa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3813f0c-b622-4a30-a591-63847559cfa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3813f0c-b622-4a30-a591-63847559cfa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3813f0c-b622-4a30-a591-63847559cfa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3813f0c-b622-4a30-a591-63847559cfa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3813f0c-b622-4a30-a591-63847559cfa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3813f0c-b622-4a30-a591-63847559cfa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3813f0c-b622-4a30-a591-63847559cfa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3813f0c-b622-4a30-a591-63847559cfa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3813f0c-b622-4a30-a591-63847559cfa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3813f0c-b622-4a30-a591-63847559cfa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3813f0c-b622-4a30-a591-63847559cfa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3813f0c-b622-4a30-a591-63847559cfa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3813f0c-b622-4a30-a591-63847559cfa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43db51fb-9faf-438d-a70a-e880d9ce9f26"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43db51fb-9faf-438d-a70a-e880d9ce9f26"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43db51fb-9faf-438d-a70a-e880d9ce9f26","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43db51fb-9faf-438d-a70a-e880d9ce9f26","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43db51fb-9faf-438d-a70a-e880d9ce9f26","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43db51fb-9faf-438d-a70a-e880d9ce9f26","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43db51fb-9faf-438d-a70a-e880d9ce9f26","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43db51fb-9faf-438d-a70a-e880d9ce9f26","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43db51fb-9faf-438d-a70a-e880d9ce9f26","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43db51fb-9faf-438d-a70a-e880d9ce9f26","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43db51fb-9faf-438d-a70a-e880d9ce9f26","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43db51fb-9faf-438d-a70a-e880d9ce9f26","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43db51fb-9faf-438d-a70a-e880d9ce9f26","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43db51fb-9faf-438d-a70a-e880d9ce9f26","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43db51fb-9faf-438d-a70a-e880d9ce9f26","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43db51fb-9faf-438d-a70a-e880d9ce9f26","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43db51fb-9faf-438d-a70a-e880d9ce9f26","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:30Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"43db51fb-9faf-438d-a70a-e880d9ce9f26","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:03:31Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-test-connection-type-185825","reconcileID":"c1b91e92-b7bc-4e5d-ab4f-7cff19254999"} {"level":"info","ts":"2026-07-13T05:03:31Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-test-connection-type-185825","reconcileID":"cb0cbaa7-808a-4216-b0d9-4625478ad5d7"} {"level":"info","ts":"2026-07-13T05:03:31Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cypress-test-connection-type-185825","reconcileID":"8739af30-5125-40b4-8e9e-ece07c3ee808"} {"level":"info","ts":"2026-07-13T05:03:40Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1df29f1b-3a47-483d-a31b-a551befc1091"} {"level":"info","ts":"2026-07-13T05:03:40Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1df29f1b-3a47-483d-a31b-a551befc1091"} {"level":"info","ts":"2026-07-13T05:03:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1df29f1b-3a47-483d-a31b-a551befc1091","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1df29f1b-3a47-483d-a31b-a551befc1091","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:03:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1df29f1b-3a47-483d-a31b-a551befc1091","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:03:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1df29f1b-3a47-483d-a31b-a551befc1091","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:03:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1df29f1b-3a47-483d-a31b-a551befc1091","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:03:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1df29f1b-3a47-483d-a31b-a551befc1091","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:03:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1df29f1b-3a47-483d-a31b-a551befc1091","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:03:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1df29f1b-3a47-483d-a31b-a551befc1091","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:03:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1df29f1b-3a47-483d-a31b-a551befc1091","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:03:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1df29f1b-3a47-483d-a31b-a551befc1091","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:03:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1df29f1b-3a47-483d-a31b-a551befc1091","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:03:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1df29f1b-3a47-483d-a31b-a551befc1091","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1df29f1b-3a47-483d-a31b-a551befc1091","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1df29f1b-3a47-483d-a31b-a551befc1091","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:03:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1df29f1b-3a47-483d-a31b-a551befc1091","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1df29f1b-3a47-483d-a31b-a551befc1091","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:03:40Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"4286ad0b-c35e-4f0c-9f0e-302fd06ce6af","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:03:40Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"4286ad0b-c35e-4f0c-9f0e-302fd06ce6af","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:03:46Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a631fe93-e041-4605-a272-bd65d6d0c5fa"} {"level":"info","ts":"2026-07-13T05:03:46Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a631fe93-e041-4605-a272-bd65d6d0c5fa"} {"level":"info","ts":"2026-07-13T05:03:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a631fe93-e041-4605-a272-bd65d6d0c5fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:03:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a631fe93-e041-4605-a272-bd65d6d0c5fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:03:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a631fe93-e041-4605-a272-bd65d6d0c5fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:03:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a631fe93-e041-4605-a272-bd65d6d0c5fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:03:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a631fe93-e041-4605-a272-bd65d6d0c5fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:03:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a631fe93-e041-4605-a272-bd65d6d0c5fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:03:46Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a631fe93-e041-4605-a272-bd65d6d0c5fa","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:03:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a631fe93-e041-4605-a272-bd65d6d0c5fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a631fe93-e041-4605-a272-bd65d6d0c5fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a631fe93-e041-4605-a272-bd65d6d0c5fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:03:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a631fe93-e041-4605-a272-bd65d6d0c5fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a631fe93-e041-4605-a272-bd65d6d0c5fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:03:48Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9a63588c-d375-469d-ab90-3cf5ad07e32a"} {"level":"info","ts":"2026-07-13T05:03:48Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9a63588c-d375-469d-ab90-3cf5ad07e32a"} {"level":"info","ts":"2026-07-13T05:03:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9a63588c-d375-469d-ab90-3cf5ad07e32a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9a63588c-d375-469d-ab90-3cf5ad07e32a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:03:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9a63588c-d375-469d-ab90-3cf5ad07e32a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:03:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9a63588c-d375-469d-ab90-3cf5ad07e32a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:03:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9a63588c-d375-469d-ab90-3cf5ad07e32a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:03:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9a63588c-d375-469d-ab90-3cf5ad07e32a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:03:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9a63588c-d375-469d-ab90-3cf5ad07e32a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:03:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9a63588c-d375-469d-ab90-3cf5ad07e32a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:03:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9a63588c-d375-469d-ab90-3cf5ad07e32a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:03:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9a63588c-d375-469d-ab90-3cf5ad07e32a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:03:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9a63588c-d375-469d-ab90-3cf5ad07e32a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:03:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9a63588c-d375-469d-ab90-3cf5ad07e32a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9a63588c-d375-469d-ab90-3cf5ad07e32a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9a63588c-d375-469d-ab90-3cf5ad07e32a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:03:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9a63588c-d375-469d-ab90-3cf5ad07e32a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9a63588c-d375-469d-ab90-3cf5ad07e32a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:03:48Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"20f75630-4e20-4756-84c5-48cc451f3fda","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:03:48Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"20f75630-4e20-4756-84c5-48cc451f3fda","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:03:58Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b86b4c13-db03-4e54-a3bd-ec30237f35be"} {"level":"info","ts":"2026-07-13T05:03:58Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b86b4c13-db03-4e54-a3bd-ec30237f35be"} {"level":"info","ts":"2026-07-13T05:03:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b86b4c13-db03-4e54-a3bd-ec30237f35be","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b86b4c13-db03-4e54-a3bd-ec30237f35be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:03:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b86b4c13-db03-4e54-a3bd-ec30237f35be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:03:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b86b4c13-db03-4e54-a3bd-ec30237f35be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:03:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b86b4c13-db03-4e54-a3bd-ec30237f35be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:03:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b86b4c13-db03-4e54-a3bd-ec30237f35be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:03:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b86b4c13-db03-4e54-a3bd-ec30237f35be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:03:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b86b4c13-db03-4e54-a3bd-ec30237f35be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:03:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b86b4c13-db03-4e54-a3bd-ec30237f35be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:03:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b86b4c13-db03-4e54-a3bd-ec30237f35be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:03:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b86b4c13-db03-4e54-a3bd-ec30237f35be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:03:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b86b4c13-db03-4e54-a3bd-ec30237f35be","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b86b4c13-db03-4e54-a3bd-ec30237f35be","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b86b4c13-db03-4e54-a3bd-ec30237f35be","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:03:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b86b4c13-db03-4e54-a3bd-ec30237f35be","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b86b4c13-db03-4e54-a3bd-ec30237f35be","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:03:58Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"84ec511b-256a-48f5-ae85-083effa5ed40","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:03:58Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"84ec511b-256a-48f5-ae85-083effa5ed40","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:03:59Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e389587d-f5a8-424b-bee6-8bd08c79bfb6"} {"level":"info","ts":"2026-07-13T05:03:59Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e389587d-f5a8-424b-bee6-8bd08c79bfb6"} {"level":"info","ts":"2026-07-13T05:03:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e389587d-f5a8-424b-bee6-8bd08c79bfb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e389587d-f5a8-424b-bee6-8bd08c79bfb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:03:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e389587d-f5a8-424b-bee6-8bd08c79bfb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:03:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e389587d-f5a8-424b-bee6-8bd08c79bfb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:03:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e389587d-f5a8-424b-bee6-8bd08c79bfb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:03:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e389587d-f5a8-424b-bee6-8bd08c79bfb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:03:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e389587d-f5a8-424b-bee6-8bd08c79bfb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:03:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e389587d-f5a8-424b-bee6-8bd08c79bfb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:03:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e389587d-f5a8-424b-bee6-8bd08c79bfb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:03:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e389587d-f5a8-424b-bee6-8bd08c79bfb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:03:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e389587d-f5a8-424b-bee6-8bd08c79bfb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:03:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e389587d-f5a8-424b-bee6-8bd08c79bfb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e389587d-f5a8-424b-bee6-8bd08c79bfb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e389587d-f5a8-424b-bee6-8bd08c79bfb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:03:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e389587d-f5a8-424b-bee6-8bd08c79bfb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:03:59Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e389587d-f5a8-424b-bee6-8bd08c79bfb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:03:59Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"9328269d-16be-43d7-ae3f-0253677ff06a","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:03:59Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"9328269d-16be-43d7-ae3f-0253677ff06a","name":"redhat-ods-applications"} {"level":"error","ts":"2026-07-13T05:04:00Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T05:04:01Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b79b697b-49dc-47cd-903f-e11d35f28d0e"} {"level":"info","ts":"2026-07-13T05:04:01Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b79b697b-49dc-47cd-903f-e11d35f28d0e"} {"level":"info","ts":"2026-07-13T05:04:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b79b697b-49dc-47cd-903f-e11d35f28d0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b79b697b-49dc-47cd-903f-e11d35f28d0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b79b697b-49dc-47cd-903f-e11d35f28d0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:04:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b79b697b-49dc-47cd-903f-e11d35f28d0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:04:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b79b697b-49dc-47cd-903f-e11d35f28d0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:04:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b79b697b-49dc-47cd-903f-e11d35f28d0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:04:01Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b79b697b-49dc-47cd-903f-e11d35f28d0e","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:04:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b79b697b-49dc-47cd-903f-e11d35f28d0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b79b697b-49dc-47cd-903f-e11d35f28d0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b79b697b-49dc-47cd-903f-e11d35f28d0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:04:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b79b697b-49dc-47cd-903f-e11d35f28d0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b79b697b-49dc-47cd-903f-e11d35f28d0e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:06Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"61d37ebf-e6d7-45cd-aaad-403b62ce97ce"} {"level":"info","ts":"2026-07-13T05:04:06Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"61d37ebf-e6d7-45cd-aaad-403b62ce97ce"} {"level":"info","ts":"2026-07-13T05:04:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"61d37ebf-e6d7-45cd-aaad-403b62ce97ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"61d37ebf-e6d7-45cd-aaad-403b62ce97ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:04:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"61d37ebf-e6d7-45cd-aaad-403b62ce97ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:04:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"61d37ebf-e6d7-45cd-aaad-403b62ce97ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:04:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"61d37ebf-e6d7-45cd-aaad-403b62ce97ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:04:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"61d37ebf-e6d7-45cd-aaad-403b62ce97ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:04:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"61d37ebf-e6d7-45cd-aaad-403b62ce97ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:04:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"61d37ebf-e6d7-45cd-aaad-403b62ce97ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:04:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"61d37ebf-e6d7-45cd-aaad-403b62ce97ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:04:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"61d37ebf-e6d7-45cd-aaad-403b62ce97ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:04:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"61d37ebf-e6d7-45cd-aaad-403b62ce97ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:04:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"61d37ebf-e6d7-45cd-aaad-403b62ce97ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"61d37ebf-e6d7-45cd-aaad-403b62ce97ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"61d37ebf-e6d7-45cd-aaad-403b62ce97ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:04:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"61d37ebf-e6d7-45cd-aaad-403b62ce97ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"61d37ebf-e6d7-45cd-aaad-403b62ce97ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:06Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"04bcd7b1-6605-499e-9711-8dba1628c6a9","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:04:06Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"04bcd7b1-6605-499e-9711-8dba1628c6a9","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:04:15Z","logger":"controller-runtime.cache","msg":"Warning: This version is deprecated. Use v1beta2 instead."} {"level":"info","ts":"2026-07-13T05:04:17Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7cead39d-0bdd-42d6-bf53-215737389c15"} {"level":"info","ts":"2026-07-13T05:04:17Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7cead39d-0bdd-42d6-bf53-215737389c15"} {"level":"info","ts":"2026-07-13T05:04:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7cead39d-0bdd-42d6-bf53-215737389c15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7cead39d-0bdd-42d6-bf53-215737389c15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7cead39d-0bdd-42d6-bf53-215737389c15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:04:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7cead39d-0bdd-42d6-bf53-215737389c15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:04:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7cead39d-0bdd-42d6-bf53-215737389c15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:04:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7cead39d-0bdd-42d6-bf53-215737389c15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:04:17Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7cead39d-0bdd-42d6-bf53-215737389c15","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:04:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7cead39d-0bdd-42d6-bf53-215737389c15","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7cead39d-0bdd-42d6-bf53-215737389c15","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7cead39d-0bdd-42d6-bf53-215737389c15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:04:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7cead39d-0bdd-42d6-bf53-215737389c15","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7cead39d-0bdd-42d6-bf53-215737389c15","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"01a41f29-1ce7-44eb-990b-a1e66fdabb8c"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"01a41f29-1ce7-44eb-990b-a1e66fdabb8c"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"01a41f29-1ce7-44eb-990b-a1e66fdabb8c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"01a41f29-1ce7-44eb-990b-a1e66fdabb8c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"01a41f29-1ce7-44eb-990b-a1e66fdabb8c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"01a41f29-1ce7-44eb-990b-a1e66fdabb8c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"01a41f29-1ce7-44eb-990b-a1e66fdabb8c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"01a41f29-1ce7-44eb-990b-a1e66fdabb8c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:04:32Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"01a41f29-1ce7-44eb-990b-a1e66fdabb8c","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"01a41f29-1ce7-44eb-990b-a1e66fdabb8c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"01a41f29-1ce7-44eb-990b-a1e66fdabb8c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"01a41f29-1ce7-44eb-990b-a1e66fdabb8c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"01a41f29-1ce7-44eb-990b-a1e66fdabb8c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"01a41f29-1ce7-44eb-990b-a1e66fdabb8c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1e9802bd-3750-4366-a4c4-a29a61f7984c"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1e9802bd-3750-4366-a4c4-a29a61f7984c"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1e9802bd-3750-4366-a4c4-a29a61f7984c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1e9802bd-3750-4366-a4c4-a29a61f7984c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1e9802bd-3750-4366-a4c4-a29a61f7984c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1e9802bd-3750-4366-a4c4-a29a61f7984c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1e9802bd-3750-4366-a4c4-a29a61f7984c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1e9802bd-3750-4366-a4c4-a29a61f7984c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:04:32Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1e9802bd-3750-4366-a4c4-a29a61f7984c","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1e9802bd-3750-4366-a4c4-a29a61f7984c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1e9802bd-3750-4366-a4c4-a29a61f7984c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1e9802bd-3750-4366-a4c4-a29a61f7984c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1e9802bd-3750-4366-a4c4-a29a61f7984c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1e9802bd-3750-4366-a4c4-a29a61f7984c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"eb624da8-0561-4e8c-a194-8cbdbb20dab2"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"eb624da8-0561-4e8c-a194-8cbdbb20dab2"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"eb624da8-0561-4e8c-a194-8cbdbb20dab2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"eb624da8-0561-4e8c-a194-8cbdbb20dab2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"eb624da8-0561-4e8c-a194-8cbdbb20dab2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"eb624da8-0561-4e8c-a194-8cbdbb20dab2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"eb624da8-0561-4e8c-a194-8cbdbb20dab2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"eb624da8-0561-4e8c-a194-8cbdbb20dab2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:04:32Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"eb624da8-0561-4e8c-a194-8cbdbb20dab2","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"eb624da8-0561-4e8c-a194-8cbdbb20dab2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"eb624da8-0561-4e8c-a194-8cbdbb20dab2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"eb624da8-0561-4e8c-a194-8cbdbb20dab2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"eb624da8-0561-4e8c-a194-8cbdbb20dab2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"eb624da8-0561-4e8c-a194-8cbdbb20dab2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"21c1155a-2f11-4ab9-ba59-0a71c30b484d"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"21c1155a-2f11-4ab9-ba59-0a71c30b484d"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"21c1155a-2f11-4ab9-ba59-0a71c30b484d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"21c1155a-2f11-4ab9-ba59-0a71c30b484d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"21c1155a-2f11-4ab9-ba59-0a71c30b484d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"21c1155a-2f11-4ab9-ba59-0a71c30b484d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"21c1155a-2f11-4ab9-ba59-0a71c30b484d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"21c1155a-2f11-4ab9-ba59-0a71c30b484d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:04:32Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"21c1155a-2f11-4ab9-ba59-0a71c30b484d","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"21c1155a-2f11-4ab9-ba59-0a71c30b484d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"21c1155a-2f11-4ab9-ba59-0a71c30b484d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"21c1155a-2f11-4ab9-ba59-0a71c30b484d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"21c1155a-2f11-4ab9-ba59-0a71c30b484d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"21c1155a-2f11-4ab9-ba59-0a71c30b484d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcdb4016-115f-49f3-8f5b-ae4860a50138"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcdb4016-115f-49f3-8f5b-ae4860a50138"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcdb4016-115f-49f3-8f5b-ae4860a50138","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcdb4016-115f-49f3-8f5b-ae4860a50138","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcdb4016-115f-49f3-8f5b-ae4860a50138","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcdb4016-115f-49f3-8f5b-ae4860a50138","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcdb4016-115f-49f3-8f5b-ae4860a50138","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcdb4016-115f-49f3-8f5b-ae4860a50138","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcdb4016-115f-49f3-8f5b-ae4860a50138","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcdb4016-115f-49f3-8f5b-ae4860a50138","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcdb4016-115f-49f3-8f5b-ae4860a50138","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcdb4016-115f-49f3-8f5b-ae4860a50138","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcdb4016-115f-49f3-8f5b-ae4860a50138","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcdb4016-115f-49f3-8f5b-ae4860a50138","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcdb4016-115f-49f3-8f5b-ae4860a50138","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcdb4016-115f-49f3-8f5b-ae4860a50138","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcdb4016-115f-49f3-8f5b-ae4860a50138","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"fcdb4016-115f-49f3-8f5b-ae4860a50138","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"715c16e8-c2f3-465b-8409-928397eb0ad8"} {"level":"info","ts":"2026-07-13T05:04:32Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"dac1e707-ffb0-416a-bc3b-a46f424499a6","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"715c16e8-c2f3-465b-8409-928397eb0ad8"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"715c16e8-c2f3-465b-8409-928397eb0ad8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"715c16e8-c2f3-465b-8409-928397eb0ad8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"715c16e8-c2f3-465b-8409-928397eb0ad8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"715c16e8-c2f3-465b-8409-928397eb0ad8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"715c16e8-c2f3-465b-8409-928397eb0ad8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"715c16e8-c2f3-465b-8409-928397eb0ad8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"715c16e8-c2f3-465b-8409-928397eb0ad8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"715c16e8-c2f3-465b-8409-928397eb0ad8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"dac1e707-ffb0-416a-bc3b-a46f424499a6","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"715c16e8-c2f3-465b-8409-928397eb0ad8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"715c16e8-c2f3-465b-8409-928397eb0ad8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"715c16e8-c2f3-465b-8409-928397eb0ad8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"715c16e8-c2f3-465b-8409-928397eb0ad8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"715c16e8-c2f3-465b-8409-928397eb0ad8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"715c16e8-c2f3-465b-8409-928397eb0ad8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"715c16e8-c2f3-465b-8409-928397eb0ad8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:32Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"715c16e8-c2f3-465b-8409-928397eb0ad8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:38Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-workbench-storage-preset-167984","reconcileID":"f11db48a-009c-4b8f-9494-be1a74e92558"} {"level":"info","ts":"2026-07-13T05:04:38Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-workbench-storage-preset-167984","reconcileID":"48969571-c51b-416a-a329-38a4dfbc4041"} {"level":"info","ts":"2026-07-13T05:04:38Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-workbench-storage-preset-167984","reconcileID":"84e5e743-166a-49a9-992b-a22ab990df61"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e846373e-f2b7-4444-b735-f75d256c936e"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e846373e-f2b7-4444-b735-f75d256c936e"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e846373e-f2b7-4444-b735-f75d256c936e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e846373e-f2b7-4444-b735-f75d256c936e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e846373e-f2b7-4444-b735-f75d256c936e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e846373e-f2b7-4444-b735-f75d256c936e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e846373e-f2b7-4444-b735-f75d256c936e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e846373e-f2b7-4444-b735-f75d256c936e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:04:43Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e846373e-f2b7-4444-b735-f75d256c936e","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e846373e-f2b7-4444-b735-f75d256c936e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e846373e-f2b7-4444-b735-f75d256c936e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e846373e-f2b7-4444-b735-f75d256c936e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e846373e-f2b7-4444-b735-f75d256c936e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e846373e-f2b7-4444-b735-f75d256c936e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b33117f5-b5eb-4fba-8ae0-b41fc03da60b"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b33117f5-b5eb-4fba-8ae0-b41fc03da60b"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b33117f5-b5eb-4fba-8ae0-b41fc03da60b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b33117f5-b5eb-4fba-8ae0-b41fc03da60b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b33117f5-b5eb-4fba-8ae0-b41fc03da60b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b33117f5-b5eb-4fba-8ae0-b41fc03da60b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b33117f5-b5eb-4fba-8ae0-b41fc03da60b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b33117f5-b5eb-4fba-8ae0-b41fc03da60b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:04:43Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b33117f5-b5eb-4fba-8ae0-b41fc03da60b","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b33117f5-b5eb-4fba-8ae0-b41fc03da60b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b33117f5-b5eb-4fba-8ae0-b41fc03da60b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b33117f5-b5eb-4fba-8ae0-b41fc03da60b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b33117f5-b5eb-4fba-8ae0-b41fc03da60b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b33117f5-b5eb-4fba-8ae0-b41fc03da60b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"021ef724-37a6-44f9-ba64-58ae11218be0"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"021ef724-37a6-44f9-ba64-58ae11218be0"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"021ef724-37a6-44f9-ba64-58ae11218be0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"021ef724-37a6-44f9-ba64-58ae11218be0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"021ef724-37a6-44f9-ba64-58ae11218be0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"021ef724-37a6-44f9-ba64-58ae11218be0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"021ef724-37a6-44f9-ba64-58ae11218be0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"021ef724-37a6-44f9-ba64-58ae11218be0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:04:43Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"021ef724-37a6-44f9-ba64-58ae11218be0","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"021ef724-37a6-44f9-ba64-58ae11218be0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"021ef724-37a6-44f9-ba64-58ae11218be0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"021ef724-37a6-44f9-ba64-58ae11218be0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"021ef724-37a6-44f9-ba64-58ae11218be0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"021ef724-37a6-44f9-ba64-58ae11218be0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eb337ade-8d48-4734-97de-053949c0b8f4"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eb337ade-8d48-4734-97de-053949c0b8f4"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eb337ade-8d48-4734-97de-053949c0b8f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eb337ade-8d48-4734-97de-053949c0b8f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eb337ade-8d48-4734-97de-053949c0b8f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eb337ade-8d48-4734-97de-053949c0b8f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eb337ade-8d48-4734-97de-053949c0b8f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eb337ade-8d48-4734-97de-053949c0b8f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eb337ade-8d48-4734-97de-053949c0b8f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eb337ade-8d48-4734-97de-053949c0b8f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eb337ade-8d48-4734-97de-053949c0b8f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eb337ade-8d48-4734-97de-053949c0b8f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eb337ade-8d48-4734-97de-053949c0b8f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eb337ade-8d48-4734-97de-053949c0b8f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eb337ade-8d48-4734-97de-053949c0b8f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eb337ade-8d48-4734-97de-053949c0b8f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eb337ade-8d48-4734-97de-053949c0b8f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eb337ade-8d48-4734-97de-053949c0b8f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:44Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"928e96dc-c8d4-4e13-8c5e-e5d44ff10614","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"928e96dc-c8d4-4e13-8c5e-e5d44ff10614","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"97d1f957-889b-4643-8824-fec80ca1c2a2"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"97d1f957-889b-4643-8824-fec80ca1c2a2"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"97d1f957-889b-4643-8824-fec80ca1c2a2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"97d1f957-889b-4643-8824-fec80ca1c2a2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"97d1f957-889b-4643-8824-fec80ca1c2a2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"97d1f957-889b-4643-8824-fec80ca1c2a2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"97d1f957-889b-4643-8824-fec80ca1c2a2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"97d1f957-889b-4643-8824-fec80ca1c2a2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"97d1f957-889b-4643-8824-fec80ca1c2a2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"97d1f957-889b-4643-8824-fec80ca1c2a2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"97d1f957-889b-4643-8824-fec80ca1c2a2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"97d1f957-889b-4643-8824-fec80ca1c2a2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"97d1f957-889b-4643-8824-fec80ca1c2a2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"97d1f957-889b-4643-8824-fec80ca1c2a2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"97d1f957-889b-4643-8824-fec80ca1c2a2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"97d1f957-889b-4643-8824-fec80ca1c2a2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"97d1f957-889b-4643-8824-fec80ca1c2a2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"97d1f957-889b-4643-8824-fec80ca1c2a2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e763e20b-38cf-4b8b-873a-39693cbe17c5"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e763e20b-38cf-4b8b-873a-39693cbe17c5"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e763e20b-38cf-4b8b-873a-39693cbe17c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e763e20b-38cf-4b8b-873a-39693cbe17c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e763e20b-38cf-4b8b-873a-39693cbe17c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e763e20b-38cf-4b8b-873a-39693cbe17c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e763e20b-38cf-4b8b-873a-39693cbe17c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e763e20b-38cf-4b8b-873a-39693cbe17c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e763e20b-38cf-4b8b-873a-39693cbe17c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e763e20b-38cf-4b8b-873a-39693cbe17c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e763e20b-38cf-4b8b-873a-39693cbe17c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e763e20b-38cf-4b8b-873a-39693cbe17c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e763e20b-38cf-4b8b-873a-39693cbe17c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e763e20b-38cf-4b8b-873a-39693cbe17c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e763e20b-38cf-4b8b-873a-39693cbe17c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e763e20b-38cf-4b8b-873a-39693cbe17c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e763e20b-38cf-4b8b-873a-39693cbe17c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e763e20b-38cf-4b8b-873a-39693cbe17c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b9faaddd-528f-4bfd-bac1-03a84019ad98"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b9faaddd-528f-4bfd-bac1-03a84019ad98"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b9faaddd-528f-4bfd-bac1-03a84019ad98","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b9faaddd-528f-4bfd-bac1-03a84019ad98","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b9faaddd-528f-4bfd-bac1-03a84019ad98","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b9faaddd-528f-4bfd-bac1-03a84019ad98","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b9faaddd-528f-4bfd-bac1-03a84019ad98","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b9faaddd-528f-4bfd-bac1-03a84019ad98","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b9faaddd-528f-4bfd-bac1-03a84019ad98","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b9faaddd-528f-4bfd-bac1-03a84019ad98","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b9faaddd-528f-4bfd-bac1-03a84019ad98","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b9faaddd-528f-4bfd-bac1-03a84019ad98","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b9faaddd-528f-4bfd-bac1-03a84019ad98","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b9faaddd-528f-4bfd-bac1-03a84019ad98","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b9faaddd-528f-4bfd-bac1-03a84019ad98","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b9faaddd-528f-4bfd-bac1-03a84019ad98","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b9faaddd-528f-4bfd-bac1-03a84019ad98","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b9faaddd-528f-4bfd-bac1-03a84019ad98","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"000b7744-cb57-4ac4-a3c2-957893113f51"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"000b7744-cb57-4ac4-a3c2-957893113f51"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"000b7744-cb57-4ac4-a3c2-957893113f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"000b7744-cb57-4ac4-a3c2-957893113f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"000b7744-cb57-4ac4-a3c2-957893113f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"000b7744-cb57-4ac4-a3c2-957893113f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"000b7744-cb57-4ac4-a3c2-957893113f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"000b7744-cb57-4ac4-a3c2-957893113f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"000b7744-cb57-4ac4-a3c2-957893113f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"000b7744-cb57-4ac4-a3c2-957893113f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"000b7744-cb57-4ac4-a3c2-957893113f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:04:45Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"2a07b202-5a6c-4da0-93e6-21e1d656f403","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"2a07b202-5a6c-4da0-93e6-21e1d656f403","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"000b7744-cb57-4ac4-a3c2-957893113f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"000b7744-cb57-4ac4-a3c2-957893113f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"000b7744-cb57-4ac4-a3c2-957893113f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"000b7744-cb57-4ac4-a3c2-957893113f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"000b7744-cb57-4ac4-a3c2-957893113f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"000b7744-cb57-4ac4-a3c2-957893113f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"000b7744-cb57-4ac4-a3c2-957893113f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"469e25ce-cf55-4f9f-84e4-58451c2218b1"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"469e25ce-cf55-4f9f-84e4-58451c2218b1"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"469e25ce-cf55-4f9f-84e4-58451c2218b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"469e25ce-cf55-4f9f-84e4-58451c2218b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"469e25ce-cf55-4f9f-84e4-58451c2218b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"469e25ce-cf55-4f9f-84e4-58451c2218b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"469e25ce-cf55-4f9f-84e4-58451c2218b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"469e25ce-cf55-4f9f-84e4-58451c2218b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"469e25ce-cf55-4f9f-84e4-58451c2218b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"469e25ce-cf55-4f9f-84e4-58451c2218b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"469e25ce-cf55-4f9f-84e4-58451c2218b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"469e25ce-cf55-4f9f-84e4-58451c2218b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"469e25ce-cf55-4f9f-84e4-58451c2218b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"469e25ce-cf55-4f9f-84e4-58451c2218b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"469e25ce-cf55-4f9f-84e4-58451c2218b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"469e25ce-cf55-4f9f-84e4-58451c2218b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"469e25ce-cf55-4f9f-84e4-58451c2218b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"469e25ce-cf55-4f9f-84e4-58451c2218b1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:47Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1328bae2-377f-4b08-b308-c3bd7b0d83fc"} {"level":"info","ts":"2026-07-13T05:04:47Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1328bae2-377f-4b08-b308-c3bd7b0d83fc"} {"level":"info","ts":"2026-07-13T05:04:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1328bae2-377f-4b08-b308-c3bd7b0d83fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1328bae2-377f-4b08-b308-c3bd7b0d83fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1328bae2-377f-4b08-b308-c3bd7b0d83fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:04:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1328bae2-377f-4b08-b308-c3bd7b0d83fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:04:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1328bae2-377f-4b08-b308-c3bd7b0d83fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:04:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1328bae2-377f-4b08-b308-c3bd7b0d83fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:04:47Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1328bae2-377f-4b08-b308-c3bd7b0d83fc","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:04:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1328bae2-377f-4b08-b308-c3bd7b0d83fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1328bae2-377f-4b08-b308-c3bd7b0d83fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1328bae2-377f-4b08-b308-c3bd7b0d83fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:04:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1328bae2-377f-4b08-b308-c3bd7b0d83fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1328bae2-377f-4b08-b308-c3bd7b0d83fc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-13T05:04:55Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d20e1335-edb4-4c24-93b6-e05f1397c2b6"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d20e1335-edb4-4c24-93b6-e05f1397c2b6"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d20e1335-edb4-4c24-93b6-e05f1397c2b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d20e1335-edb4-4c24-93b6-e05f1397c2b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d20e1335-edb4-4c24-93b6-e05f1397c2b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d20e1335-edb4-4c24-93b6-e05f1397c2b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d20e1335-edb4-4c24-93b6-e05f1397c2b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d20e1335-edb4-4c24-93b6-e05f1397c2b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:04:56Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d20e1335-edb4-4c24-93b6-e05f1397c2b6","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d20e1335-edb4-4c24-93b6-e05f1397c2b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d20e1335-edb4-4c24-93b6-e05f1397c2b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d20e1335-edb4-4c24-93b6-e05f1397c2b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d20e1335-edb4-4c24-93b6-e05f1397c2b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d20e1335-edb4-4c24-93b6-e05f1397c2b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"56eb0ddb-dc05-48cf-8db8-ac7b385e6251"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"56eb0ddb-dc05-48cf-8db8-ac7b385e6251"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"56eb0ddb-dc05-48cf-8db8-ac7b385e6251","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"56eb0ddb-dc05-48cf-8db8-ac7b385e6251","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"56eb0ddb-dc05-48cf-8db8-ac7b385e6251","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"56eb0ddb-dc05-48cf-8db8-ac7b385e6251","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"56eb0ddb-dc05-48cf-8db8-ac7b385e6251","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"56eb0ddb-dc05-48cf-8db8-ac7b385e6251","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:04:56Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"56eb0ddb-dc05-48cf-8db8-ac7b385e6251","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"56eb0ddb-dc05-48cf-8db8-ac7b385e6251","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"56eb0ddb-dc05-48cf-8db8-ac7b385e6251","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"56eb0ddb-dc05-48cf-8db8-ac7b385e6251","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"56eb0ddb-dc05-48cf-8db8-ac7b385e6251","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"56eb0ddb-dc05-48cf-8db8-ac7b385e6251","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"98f42d44-cee0-451c-9b1c-ff7fdc671319"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"98f42d44-cee0-451c-9b1c-ff7fdc671319"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"98f42d44-cee0-451c-9b1c-ff7fdc671319","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"98f42d44-cee0-451c-9b1c-ff7fdc671319","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"98f42d44-cee0-451c-9b1c-ff7fdc671319","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"98f42d44-cee0-451c-9b1c-ff7fdc671319","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"98f42d44-cee0-451c-9b1c-ff7fdc671319","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"98f42d44-cee0-451c-9b1c-ff7fdc671319","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:04:56Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"98f42d44-cee0-451c-9b1c-ff7fdc671319","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"98f42d44-cee0-451c-9b1c-ff7fdc671319","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"98f42d44-cee0-451c-9b1c-ff7fdc671319","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"98f42d44-cee0-451c-9b1c-ff7fdc671319","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"98f42d44-cee0-451c-9b1c-ff7fdc671319","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"98f42d44-cee0-451c-9b1c-ff7fdc671319","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bac733ea-d950-45a4-84af-8e0e693a5225"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bac733ea-d950-45a4-84af-8e0e693a5225"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bac733ea-d950-45a4-84af-8e0e693a5225","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bac733ea-d950-45a4-84af-8e0e693a5225","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bac733ea-d950-45a4-84af-8e0e693a5225","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bac733ea-d950-45a4-84af-8e0e693a5225","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bac733ea-d950-45a4-84af-8e0e693a5225","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bac733ea-d950-45a4-84af-8e0e693a5225","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:04:56Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bac733ea-d950-45a4-84af-8e0e693a5225","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bac733ea-d950-45a4-84af-8e0e693a5225","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bac733ea-d950-45a4-84af-8e0e693a5225","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bac733ea-d950-45a4-84af-8e0e693a5225","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bac733ea-d950-45a4-84af-8e0e693a5225","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bac733ea-d950-45a4-84af-8e0e693a5225","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce782a88-6c1a-4dca-9804-03087bd8b8c5"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce782a88-6c1a-4dca-9804-03087bd8b8c5"} {"level":"info","ts":"2026-07-13T05:04:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce782a88-6c1a-4dca-9804-03087bd8b8c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce782a88-6c1a-4dca-9804-03087bd8b8c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce782a88-6c1a-4dca-9804-03087bd8b8c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce782a88-6c1a-4dca-9804-03087bd8b8c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce782a88-6c1a-4dca-9804-03087bd8b8c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce782a88-6c1a-4dca-9804-03087bd8b8c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:04:57Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce782a88-6c1a-4dca-9804-03087bd8b8c5","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce782a88-6c1a-4dca-9804-03087bd8b8c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce782a88-6c1a-4dca-9804-03087bd8b8c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce782a88-6c1a-4dca-9804-03087bd8b8c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce782a88-6c1a-4dca-9804-03087bd8b8c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce782a88-6c1a-4dca-9804-03087bd8b8c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"802539a1-97ea-48ff-b2cf-a09b372e189a"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"802539a1-97ea-48ff-b2cf-a09b372e189a"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"802539a1-97ea-48ff-b2cf-a09b372e189a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"802539a1-97ea-48ff-b2cf-a09b372e189a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"802539a1-97ea-48ff-b2cf-a09b372e189a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"802539a1-97ea-48ff-b2cf-a09b372e189a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"802539a1-97ea-48ff-b2cf-a09b372e189a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"802539a1-97ea-48ff-b2cf-a09b372e189a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"802539a1-97ea-48ff-b2cf-a09b372e189a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"802539a1-97ea-48ff-b2cf-a09b372e189a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"802539a1-97ea-48ff-b2cf-a09b372e189a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"802539a1-97ea-48ff-b2cf-a09b372e189a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"802539a1-97ea-48ff-b2cf-a09b372e189a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"802539a1-97ea-48ff-b2cf-a09b372e189a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"802539a1-97ea-48ff-b2cf-a09b372e189a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"802539a1-97ea-48ff-b2cf-a09b372e189a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"802539a1-97ea-48ff-b2cf-a09b372e189a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"802539a1-97ea-48ff-b2cf-a09b372e189a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:57Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e10a628e-e31f-4157-8aac-c828c8a0f2a7","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e10a628e-e31f-4157-8aac-c828c8a0f2a7","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8bfbee1-c049-49c9-975d-eef9a76426f4"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8bfbee1-c049-49c9-975d-eef9a76426f4"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8bfbee1-c049-49c9-975d-eef9a76426f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8bfbee1-c049-49c9-975d-eef9a76426f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8bfbee1-c049-49c9-975d-eef9a76426f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8bfbee1-c049-49c9-975d-eef9a76426f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8bfbee1-c049-49c9-975d-eef9a76426f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8bfbee1-c049-49c9-975d-eef9a76426f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8bfbee1-c049-49c9-975d-eef9a76426f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8bfbee1-c049-49c9-975d-eef9a76426f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8bfbee1-c049-49c9-975d-eef9a76426f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8bfbee1-c049-49c9-975d-eef9a76426f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8bfbee1-c049-49c9-975d-eef9a76426f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8bfbee1-c049-49c9-975d-eef9a76426f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8bfbee1-c049-49c9-975d-eef9a76426f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8bfbee1-c049-49c9-975d-eef9a76426f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8bfbee1-c049-49c9-975d-eef9a76426f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:57Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b8bfbee1-c049-49c9-975d-eef9a76426f4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:58Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2343fcc-2b84-4fb8-a474-df8fede75448"} {"level":"info","ts":"2026-07-13T05:04:58Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2343fcc-2b84-4fb8-a474-df8fede75448"} {"level":"info","ts":"2026-07-13T05:04:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2343fcc-2b84-4fb8-a474-df8fede75448","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2343fcc-2b84-4fb8-a474-df8fede75448","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:04:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2343fcc-2b84-4fb8-a474-df8fede75448","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:04:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2343fcc-2b84-4fb8-a474-df8fede75448","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:04:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2343fcc-2b84-4fb8-a474-df8fede75448","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:04:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2343fcc-2b84-4fb8-a474-df8fede75448","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:04:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2343fcc-2b84-4fb8-a474-df8fede75448","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:04:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2343fcc-2b84-4fb8-a474-df8fede75448","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:04:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2343fcc-2b84-4fb8-a474-df8fede75448","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:04:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2343fcc-2b84-4fb8-a474-df8fede75448","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:04:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2343fcc-2b84-4fb8-a474-df8fede75448","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:04:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2343fcc-2b84-4fb8-a474-df8fede75448","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2343fcc-2b84-4fb8-a474-df8fede75448","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2343fcc-2b84-4fb8-a474-df8fede75448","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:04:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2343fcc-2b84-4fb8-a474-df8fede75448","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:04:58Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2343fcc-2b84-4fb8-a474-df8fede75448","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:04:58Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"4ee9d06c-6199-449a-9e59-5b6b3f2e93e4","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:04:58Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"4ee9d06c-6199-449a-9e59-5b6b3f2e93e4","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:05:01Z","logger":"controller-runtime.cache","msg":"Warning: This version is deprecated. Use v1beta2 instead."} {"level":"info","ts":"2026-07-13T05:05:02Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"23eac0b2-91fd-4e0f-8bae-3f99ed4956b8"} {"level":"info","ts":"2026-07-13T05:05:02Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"23eac0b2-91fd-4e0f-8bae-3f99ed4956b8"} {"level":"info","ts":"2026-07-13T05:05:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"23eac0b2-91fd-4e0f-8bae-3f99ed4956b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:05:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"23eac0b2-91fd-4e0f-8bae-3f99ed4956b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:05:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"23eac0b2-91fd-4e0f-8bae-3f99ed4956b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:05:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"23eac0b2-91fd-4e0f-8bae-3f99ed4956b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:05:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"23eac0b2-91fd-4e0f-8bae-3f99ed4956b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:05:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"23eac0b2-91fd-4e0f-8bae-3f99ed4956b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:05:02Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"23eac0b2-91fd-4e0f-8bae-3f99ed4956b8","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:05:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"23eac0b2-91fd-4e0f-8bae-3f99ed4956b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"23eac0b2-91fd-4e0f-8bae-3f99ed4956b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"23eac0b2-91fd-4e0f-8bae-3f99ed4956b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:05:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"23eac0b2-91fd-4e0f-8bae-3f99ed4956b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"23eac0b2-91fd-4e0f-8bae-3f99ed4956b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:05:17Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7f98bf2b-23fb-4fd7-bcb2-9a366eb195b5"} {"level":"info","ts":"2026-07-13T05:05:17Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7f98bf2b-23fb-4fd7-bcb2-9a366eb195b5"} {"level":"info","ts":"2026-07-13T05:05:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7f98bf2b-23fb-4fd7-bcb2-9a366eb195b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:05:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7f98bf2b-23fb-4fd7-bcb2-9a366eb195b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:05:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7f98bf2b-23fb-4fd7-bcb2-9a366eb195b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:05:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7f98bf2b-23fb-4fd7-bcb2-9a366eb195b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:05:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7f98bf2b-23fb-4fd7-bcb2-9a366eb195b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:05:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7f98bf2b-23fb-4fd7-bcb2-9a366eb195b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:05:17Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7f98bf2b-23fb-4fd7-bcb2-9a366eb195b5","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:05:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7f98bf2b-23fb-4fd7-bcb2-9a366eb195b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7f98bf2b-23fb-4fd7-bcb2-9a366eb195b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7f98bf2b-23fb-4fd7-bcb2-9a366eb195b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:05:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7f98bf2b-23fb-4fd7-bcb2-9a366eb195b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7f98bf2b-23fb-4fd7-bcb2-9a366eb195b5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:05:21Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-register-store-662874","reconcileID":"8f0da333-7a19-47de-a9cb-2919eb006748"} {"level":"info","ts":"2026-07-13T05:05:21Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-register-store-662874","reconcileID":"81dc3370-e014-426a-bc06-2b553325e89f"} {"level":"info","ts":"2026-07-13T05:05:22Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-register-store-662874","reconcileID":"a0d3bee2-94fb-4bd3-b692-dc3f8a6b992a"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b8a2c815-5c77-4b79-bf26-fc6651737e14"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b8a2c815-5c77-4b79-bf26-fc6651737e14"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b8a2c815-5c77-4b79-bf26-fc6651737e14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b8a2c815-5c77-4b79-bf26-fc6651737e14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b8a2c815-5c77-4b79-bf26-fc6651737e14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b8a2c815-5c77-4b79-bf26-fc6651737e14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b8a2c815-5c77-4b79-bf26-fc6651737e14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b8a2c815-5c77-4b79-bf26-fc6651737e14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:05:24Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b8a2c815-5c77-4b79-bf26-fc6651737e14","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b8a2c815-5c77-4b79-bf26-fc6651737e14","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b8a2c815-5c77-4b79-bf26-fc6651737e14","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b8a2c815-5c77-4b79-bf26-fc6651737e14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b8a2c815-5c77-4b79-bf26-fc6651737e14","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b8a2c815-5c77-4b79-bf26-fc6651737e14","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6e5496b-b984-4368-8722-f0fbc6d464c9"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6e5496b-b984-4368-8722-f0fbc6d464c9"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6e5496b-b984-4368-8722-f0fbc6d464c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6e5496b-b984-4368-8722-f0fbc6d464c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6e5496b-b984-4368-8722-f0fbc6d464c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6e5496b-b984-4368-8722-f0fbc6d464c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6e5496b-b984-4368-8722-f0fbc6d464c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6e5496b-b984-4368-8722-f0fbc6d464c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6e5496b-b984-4368-8722-f0fbc6d464c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6e5496b-b984-4368-8722-f0fbc6d464c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6e5496b-b984-4368-8722-f0fbc6d464c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6e5496b-b984-4368-8722-f0fbc6d464c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6e5496b-b984-4368-8722-f0fbc6d464c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6e5496b-b984-4368-8722-f0fbc6d464c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6e5496b-b984-4368-8722-f0fbc6d464c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6e5496b-b984-4368-8722-f0fbc6d464c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6e5496b-b984-4368-8722-f0fbc6d464c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6e5496b-b984-4368-8722-f0fbc6d464c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:05:24Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8e705ac0-d4cc-4d10-9f1e-ee834ed33c9b","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:05:24Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8e705ac0-d4cc-4d10-9f1e-ee834ed33c9b","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b15b5daf-ed4d-4287-8b4b-6739a590256a"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b15b5daf-ed4d-4287-8b4b-6739a590256a"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b15b5daf-ed4d-4287-8b4b-6739a590256a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b15b5daf-ed4d-4287-8b4b-6739a590256a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b15b5daf-ed4d-4287-8b4b-6739a590256a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b15b5daf-ed4d-4287-8b4b-6739a590256a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b15b5daf-ed4d-4287-8b4b-6739a590256a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b15b5daf-ed4d-4287-8b4b-6739a590256a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:05:26Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b15b5daf-ed4d-4287-8b4b-6739a590256a","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b15b5daf-ed4d-4287-8b4b-6739a590256a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b15b5daf-ed4d-4287-8b4b-6739a590256a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b15b5daf-ed4d-4287-8b4b-6739a590256a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b15b5daf-ed4d-4287-8b4b-6739a590256a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b15b5daf-ed4d-4287-8b4b-6739a590256a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"26a59dde-c39b-40f0-b38f-8f22e45d353b"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"26a59dde-c39b-40f0-b38f-8f22e45d353b"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"26a59dde-c39b-40f0-b38f-8f22e45d353b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"26a59dde-c39b-40f0-b38f-8f22e45d353b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"26a59dde-c39b-40f0-b38f-8f22e45d353b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"26a59dde-c39b-40f0-b38f-8f22e45d353b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"26a59dde-c39b-40f0-b38f-8f22e45d353b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"26a59dde-c39b-40f0-b38f-8f22e45d353b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:05:26Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"26a59dde-c39b-40f0-b38f-8f22e45d353b","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"26a59dde-c39b-40f0-b38f-8f22e45d353b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"26a59dde-c39b-40f0-b38f-8f22e45d353b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"26a59dde-c39b-40f0-b38f-8f22e45d353b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"26a59dde-c39b-40f0-b38f-8f22e45d353b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"26a59dde-c39b-40f0-b38f-8f22e45d353b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d85d5914-8ac7-47c3-8fd4-3ff3f7e73c39"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d85d5914-8ac7-47c3-8fd4-3ff3f7e73c39"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d85d5914-8ac7-47c3-8fd4-3ff3f7e73c39","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d85d5914-8ac7-47c3-8fd4-3ff3f7e73c39","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d85d5914-8ac7-47c3-8fd4-3ff3f7e73c39","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d85d5914-8ac7-47c3-8fd4-3ff3f7e73c39","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d85d5914-8ac7-47c3-8fd4-3ff3f7e73c39","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d85d5914-8ac7-47c3-8fd4-3ff3f7e73c39","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:05:26Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d85d5914-8ac7-47c3-8fd4-3ff3f7e73c39","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d85d5914-8ac7-47c3-8fd4-3ff3f7e73c39","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d85d5914-8ac7-47c3-8fd4-3ff3f7e73c39","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d85d5914-8ac7-47c3-8fd4-3ff3f7e73c39","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d85d5914-8ac7-47c3-8fd4-3ff3f7e73c39","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d85d5914-8ac7-47c3-8fd4-3ff3f7e73c39","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5d87a3f9-3ab4-4a20-af68-000587701c48"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5d87a3f9-3ab4-4a20-af68-000587701c48"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5d87a3f9-3ab4-4a20-af68-000587701c48","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5d87a3f9-3ab4-4a20-af68-000587701c48","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5d87a3f9-3ab4-4a20-af68-000587701c48","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5d87a3f9-3ab4-4a20-af68-000587701c48","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5d87a3f9-3ab4-4a20-af68-000587701c48","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5d87a3f9-3ab4-4a20-af68-000587701c48","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5d87a3f9-3ab4-4a20-af68-000587701c48","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5d87a3f9-3ab4-4a20-af68-000587701c48","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5d87a3f9-3ab4-4a20-af68-000587701c48","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"lifecycle-test-141919","reconcileID":"7539c436-3868-4d32-86f0-5c7057160ed9"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5d87a3f9-3ab4-4a20-af68-000587701c48","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5d87a3f9-3ab4-4a20-af68-000587701c48","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5d87a3f9-3ab4-4a20-af68-000587701c48","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5d87a3f9-3ab4-4a20-af68-000587701c48","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5d87a3f9-3ab4-4a20-af68-000587701c48","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5d87a3f9-3ab4-4a20-af68-000587701c48","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5d87a3f9-3ab4-4a20-af68-000587701c48","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:05:26Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"lifecycle-test-141919","reconcileID":"55894622-57e8-455a-88c2-ddb7c3ebe792"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"lifecycle-test-141919","reconcileID":"a6e4899b-9fa3-4d3e-85f9-6bc813eb1c4b"} {"level":"info","ts":"2026-07-13T05:05:27Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8e1673a0-f7c9-48e4-b734-d180096e95e9","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8e1673a0-f7c9-48e4-b734-d180096e95e9","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"057b3e4a-9677-45e2-8079-6caeb5b855d2"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"057b3e4a-9677-45e2-8079-6caeb5b855d2"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"057b3e4a-9677-45e2-8079-6caeb5b855d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"057b3e4a-9677-45e2-8079-6caeb5b855d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"057b3e4a-9677-45e2-8079-6caeb5b855d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"057b3e4a-9677-45e2-8079-6caeb5b855d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"057b3e4a-9677-45e2-8079-6caeb5b855d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"057b3e4a-9677-45e2-8079-6caeb5b855d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"057b3e4a-9677-45e2-8079-6caeb5b855d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"057b3e4a-9677-45e2-8079-6caeb5b855d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"057b3e4a-9677-45e2-8079-6caeb5b855d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"057b3e4a-9677-45e2-8079-6caeb5b855d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"057b3e4a-9677-45e2-8079-6caeb5b855d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"057b3e4a-9677-45e2-8079-6caeb5b855d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"057b3e4a-9677-45e2-8079-6caeb5b855d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"057b3e4a-9677-45e2-8079-6caeb5b855d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"057b3e4a-9677-45e2-8079-6caeb5b855d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"057b3e4a-9677-45e2-8079-6caeb5b855d2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:05:27Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"6d4b8176-33cf-4ab6-9bee-731b40471292","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"6d4b8176-33cf-4ab6-9bee-731b40471292","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ef2f967-bb8b-4f2e-9a41-b52226d09c44"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ef2f967-bb8b-4f2e-9a41-b52226d09c44"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ef2f967-bb8b-4f2e-9a41-b52226d09c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ef2f967-bb8b-4f2e-9a41-b52226d09c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ef2f967-bb8b-4f2e-9a41-b52226d09c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ef2f967-bb8b-4f2e-9a41-b52226d09c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ef2f967-bb8b-4f2e-9a41-b52226d09c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ef2f967-bb8b-4f2e-9a41-b52226d09c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ef2f967-bb8b-4f2e-9a41-b52226d09c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ef2f967-bb8b-4f2e-9a41-b52226d09c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ef2f967-bb8b-4f2e-9a41-b52226d09c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ef2f967-bb8b-4f2e-9a41-b52226d09c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ef2f967-bb8b-4f2e-9a41-b52226d09c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ef2f967-bb8b-4f2e-9a41-b52226d09c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ef2f967-bb8b-4f2e-9a41-b52226d09c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ef2f967-bb8b-4f2e-9a41-b52226d09c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ef2f967-bb8b-4f2e-9a41-b52226d09c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:27Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"1ef2f967-bb8b-4f2e-9a41-b52226d09c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"549843f7-6dbc-4e8b-b381-bc14be36f1e0"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"549843f7-6dbc-4e8b-b381-bc14be36f1e0"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"549843f7-6dbc-4e8b-b381-bc14be36f1e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"549843f7-6dbc-4e8b-b381-bc14be36f1e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"549843f7-6dbc-4e8b-b381-bc14be36f1e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"549843f7-6dbc-4e8b-b381-bc14be36f1e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"549843f7-6dbc-4e8b-b381-bc14be36f1e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"549843f7-6dbc-4e8b-b381-bc14be36f1e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"549843f7-6dbc-4e8b-b381-bc14be36f1e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"549843f7-6dbc-4e8b-b381-bc14be36f1e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"549843f7-6dbc-4e8b-b381-bc14be36f1e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"549843f7-6dbc-4e8b-b381-bc14be36f1e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"549843f7-6dbc-4e8b-b381-bc14be36f1e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"549843f7-6dbc-4e8b-b381-bc14be36f1e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"549843f7-6dbc-4e8b-b381-bc14be36f1e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"549843f7-6dbc-4e8b-b381-bc14be36f1e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"549843f7-6dbc-4e8b-b381-bc14be36f1e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"549843f7-6dbc-4e8b-b381-bc14be36f1e0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:05:28Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"5e6d33bc-71b0-4e88-a5c5-d5f51286b927","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"5e6d33bc-71b0-4e88-a5c5-d5f51286b927","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"40bf4018-84e2-4529-ab8f-167471f21b10"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"40bf4018-84e2-4529-ab8f-167471f21b10"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"40bf4018-84e2-4529-ab8f-167471f21b10","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"40bf4018-84e2-4529-ab8f-167471f21b10","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"40bf4018-84e2-4529-ab8f-167471f21b10","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"40bf4018-84e2-4529-ab8f-167471f21b10","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"40bf4018-84e2-4529-ab8f-167471f21b10","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"40bf4018-84e2-4529-ab8f-167471f21b10","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"40bf4018-84e2-4529-ab8f-167471f21b10","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"40bf4018-84e2-4529-ab8f-167471f21b10","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"40bf4018-84e2-4529-ab8f-167471f21b10","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"40bf4018-84e2-4529-ab8f-167471f21b10","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"40bf4018-84e2-4529-ab8f-167471f21b10","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"40bf4018-84e2-4529-ab8f-167471f21b10","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"40bf4018-84e2-4529-ab8f-167471f21b10","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"40bf4018-84e2-4529-ab8f-167471f21b10","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"40bf4018-84e2-4529-ab8f-167471f21b10","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:28Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"40bf4018-84e2-4529-ab8f-167471f21b10","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"393c95ef-7bf8-4260-843a-19ae7048c31c"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"apply","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"393c95ef-7bf8-4260-843a-19ae7048c31c"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"393c95ef-7bf8-4260-843a-19ae7048c31c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.checkPreConditions"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"393c95ef-7bf8-4260-843a-19ae7048c31c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.initialize"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"393c95ef-7bf8-4260-843a-19ae7048c31c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"393c95ef-7bf8-4260-843a-19ae7048c31c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"393c95ef-7bf8-4260-843a-19ae7048c31c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageDefaultKueueResourcesAction"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"393c95ef-7bf8-4260-843a-19ae7048c31c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding"} {"level":"info","ts":"2026-07-13T05:05:29Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding","msg":"Successfully managed kueue admin role binding","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"393c95ef-7bf8-4260-843a-19ae7048c31c","adminGroups":["rhods-admins"]} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"393c95ef-7bf8-4260-843a-19ae7048c31c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"393c95ef-7bf8-4260-843a-19ae7048c31c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"393c95ef-7bf8-4260-843a-19ae7048c31c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"393c95ef-7bf8-4260-843a-19ae7048c31c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.configureClusterQueueViewerRoleAction"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"393c95ef-7bf8-4260-843a-19ae7048c31c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"393c95ef-7bf8-4260-843a-19ae7048c31c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4af97e9b-cdf8-4600-8281-65380885bca5"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"apply","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4af97e9b-cdf8-4600-8281-65380885bca5"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4af97e9b-cdf8-4600-8281-65380885bca5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.checkPreConditions"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4af97e9b-cdf8-4600-8281-65380885bca5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.initialize"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4af97e9b-cdf8-4600-8281-65380885bca5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4af97e9b-cdf8-4600-8281-65380885bca5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4af97e9b-cdf8-4600-8281-65380885bca5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageDefaultKueueResourcesAction"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b3532833-cc08-4d41-a6d2-8652b62f0940"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b3532833-cc08-4d41-a6d2-8652b62f0940"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b3532833-cc08-4d41-a6d2-8652b62f0940","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b3532833-cc08-4d41-a6d2-8652b62f0940","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b3532833-cc08-4d41-a6d2-8652b62f0940","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-13T05:05:29Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus.checkMaaSPrerequisites","msg":"MaaS gateway missing required annotations","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b3532833-cc08-4d41-a6d2-8652b62f0940","gateway":"maas-default-gateway","missing":["security.opendatahub.io/authorino-tls-bootstrap=\"true\""]} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b3532833-cc08-4d41-a6d2-8652b62f0940","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b3532833-cc08-4d41-a6d2-8652b62f0940","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4af97e9b-cdf8-4600-8281-65380885bca5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding"} {"level":"info","ts":"2026-07-13T05:05:29Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding","msg":"Successfully managed kueue admin role binding","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4af97e9b-cdf8-4600-8281-65380885bca5","adminGroups":["rhods-admins"]} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4af97e9b-cdf8-4600-8281-65380885bca5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b3532833-cc08-4d41-a6d2-8652b62f0940","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4af97e9b-cdf8-4600-8281-65380885bca5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4af97e9b-cdf8-4600-8281-65380885bca5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4af97e9b-cdf8-4600-8281-65380885bca5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.configureClusterQueueViewerRoleAction"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4af97e9b-cdf8-4600-8281-65380885bca5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4af97e9b-cdf8-4600-8281-65380885bca5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:05:29Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b3532833-cc08-4d41-a6d2-8652b62f0940","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:05:32Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3c75b15b-b058-4fd5-adb4-868633af769d"} {"level":"info","ts":"2026-07-13T05:05:32Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3c75b15b-b058-4fd5-adb4-868633af769d"} {"level":"info","ts":"2026-07-13T05:05:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3c75b15b-b058-4fd5-adb4-868633af769d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:05:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3c75b15b-b058-4fd5-adb4-868633af769d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:05:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3c75b15b-b058-4fd5-adb4-868633af769d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:05:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3c75b15b-b058-4fd5-adb4-868633af769d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:05:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3c75b15b-b058-4fd5-adb4-868633af769d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:05:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3c75b15b-b058-4fd5-adb4-868633af769d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:05:32Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3c75b15b-b058-4fd5-adb4-868633af769d","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:05:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3c75b15b-b058-4fd5-adb4-868633af769d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3c75b15b-b058-4fd5-adb4-868633af769d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3c75b15b-b058-4fd5-adb4-868633af769d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:05:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3c75b15b-b058-4fd5-adb4-868633af769d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3c75b15b-b058-4fd5-adb4-868633af769d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-13T05:05:33Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T05:05:40Z","logger":"controller-runtime.cache","msg":"Warning: This version is deprecated. Use v1beta2 instead."} {"level":"info","ts":"2026-07-13T05:05:47Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c1a56045-2934-4c20-b394-75b8528ebb2d"} {"level":"info","ts":"2026-07-13T05:05:47Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c1a56045-2934-4c20-b394-75b8528ebb2d"} {"level":"info","ts":"2026-07-13T05:05:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c1a56045-2934-4c20-b394-75b8528ebb2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:05:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c1a56045-2934-4c20-b394-75b8528ebb2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:05:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c1a56045-2934-4c20-b394-75b8528ebb2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:05:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c1a56045-2934-4c20-b394-75b8528ebb2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:05:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c1a56045-2934-4c20-b394-75b8528ebb2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:05:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c1a56045-2934-4c20-b394-75b8528ebb2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:05:47Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c1a56045-2934-4c20-b394-75b8528ebb2d","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:05:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c1a56045-2934-4c20-b394-75b8528ebb2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c1a56045-2934-4c20-b394-75b8528ebb2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c1a56045-2934-4c20-b394-75b8528ebb2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:05:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c1a56045-2934-4c20-b394-75b8528ebb2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:05:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c1a56045-2934-4c20-b394-75b8528ebb2d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:06:02Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fa8e4895-46fa-4d7d-b81b-a60e3845b7d4"} {"level":"info","ts":"2026-07-13T05:06:02Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fa8e4895-46fa-4d7d-b81b-a60e3845b7d4"} {"level":"info","ts":"2026-07-13T05:06:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fa8e4895-46fa-4d7d-b81b-a60e3845b7d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:06:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fa8e4895-46fa-4d7d-b81b-a60e3845b7d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:06:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fa8e4895-46fa-4d7d-b81b-a60e3845b7d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:06:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fa8e4895-46fa-4d7d-b81b-a60e3845b7d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:06:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fa8e4895-46fa-4d7d-b81b-a60e3845b7d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:06:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fa8e4895-46fa-4d7d-b81b-a60e3845b7d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:06:02Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fa8e4895-46fa-4d7d-b81b-a60e3845b7d4","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:06:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fa8e4895-46fa-4d7d-b81b-a60e3845b7d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fa8e4895-46fa-4d7d-b81b-a60e3845b7d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fa8e4895-46fa-4d7d-b81b-a60e3845b7d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:06:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fa8e4895-46fa-4d7d-b81b-a60e3845b7d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fa8e4895-46fa-4d7d-b81b-a60e3845b7d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"89a3ba96-8058-4e36-82a8-da6740a2b7a0"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"89a3ba96-8058-4e36-82a8-da6740a2b7a0"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"89a3ba96-8058-4e36-82a8-da6740a2b7a0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"89a3ba96-8058-4e36-82a8-da6740a2b7a0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"89a3ba96-8058-4e36-82a8-da6740a2b7a0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"89a3ba96-8058-4e36-82a8-da6740a2b7a0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"89a3ba96-8058-4e36-82a8-da6740a2b7a0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"89a3ba96-8058-4e36-82a8-da6740a2b7a0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:06:03Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"89a3ba96-8058-4e36-82a8-da6740a2b7a0","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"89a3ba96-8058-4e36-82a8-da6740a2b7a0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"89a3ba96-8058-4e36-82a8-da6740a2b7a0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"89a3ba96-8058-4e36-82a8-da6740a2b7a0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"89a3ba96-8058-4e36-82a8-da6740a2b7a0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"89a3ba96-8058-4e36-82a8-da6740a2b7a0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f74d5500-052f-40e3-89f8-cd06c882870f"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f74d5500-052f-40e3-89f8-cd06c882870f"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f74d5500-052f-40e3-89f8-cd06c882870f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f74d5500-052f-40e3-89f8-cd06c882870f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f74d5500-052f-40e3-89f8-cd06c882870f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f74d5500-052f-40e3-89f8-cd06c882870f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f74d5500-052f-40e3-89f8-cd06c882870f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f74d5500-052f-40e3-89f8-cd06c882870f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:06:03Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f74d5500-052f-40e3-89f8-cd06c882870f","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f74d5500-052f-40e3-89f8-cd06c882870f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f74d5500-052f-40e3-89f8-cd06c882870f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f74d5500-052f-40e3-89f8-cd06c882870f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f74d5500-052f-40e3-89f8-cd06c882870f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f74d5500-052f-40e3-89f8-cd06c882870f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1ab8839-7608-4656-9142-36837c1231c9"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1ab8839-7608-4656-9142-36837c1231c9"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1ab8839-7608-4656-9142-36837c1231c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1ab8839-7608-4656-9142-36837c1231c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1ab8839-7608-4656-9142-36837c1231c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1ab8839-7608-4656-9142-36837c1231c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1ab8839-7608-4656-9142-36837c1231c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1ab8839-7608-4656-9142-36837c1231c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:06:03Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1ab8839-7608-4656-9142-36837c1231c9","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1ab8839-7608-4656-9142-36837c1231c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1ab8839-7608-4656-9142-36837c1231c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1ab8839-7608-4656-9142-36837c1231c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1ab8839-7608-4656-9142-36837c1231c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1ab8839-7608-4656-9142-36837c1231c9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3696a8e9-e9a8-40f0-9520-76124adb0404"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3696a8e9-e9a8-40f0-9520-76124adb0404"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3696a8e9-e9a8-40f0-9520-76124adb0404","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3696a8e9-e9a8-40f0-9520-76124adb0404","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3696a8e9-e9a8-40f0-9520-76124adb0404","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3696a8e9-e9a8-40f0-9520-76124adb0404","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3696a8e9-e9a8-40f0-9520-76124adb0404","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3696a8e9-e9a8-40f0-9520-76124adb0404","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3696a8e9-e9a8-40f0-9520-76124adb0404","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3696a8e9-e9a8-40f0-9520-76124adb0404","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3696a8e9-e9a8-40f0-9520-76124adb0404","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3696a8e9-e9a8-40f0-9520-76124adb0404","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3696a8e9-e9a8-40f0-9520-76124adb0404","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3696a8e9-e9a8-40f0-9520-76124adb0404","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3696a8e9-e9a8-40f0-9520-76124adb0404","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3696a8e9-e9a8-40f0-9520-76124adb0404","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3696a8e9-e9a8-40f0-9520-76124adb0404","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:03Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3696a8e9-e9a8-40f0-9520-76124adb0404","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:06:04Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"2c5abf74-bfe2-49a8-8a88-b23228a3ee9f","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:06:04Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"2c5abf74-bfe2-49a8-8a88-b23228a3ee9f","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:06:04Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8a39eaf-87fb-438c-af72-e338ef934f86"} {"level":"info","ts":"2026-07-13T05:06:04Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8a39eaf-87fb-438c-af72-e338ef934f86"} {"level":"info","ts":"2026-07-13T05:06:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8a39eaf-87fb-438c-af72-e338ef934f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8a39eaf-87fb-438c-af72-e338ef934f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:06:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8a39eaf-87fb-438c-af72-e338ef934f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:06:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8a39eaf-87fb-438c-af72-e338ef934f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:06:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8a39eaf-87fb-438c-af72-e338ef934f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:06:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8a39eaf-87fb-438c-af72-e338ef934f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:06:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8a39eaf-87fb-438c-af72-e338ef934f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:06:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8a39eaf-87fb-438c-af72-e338ef934f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:06:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8a39eaf-87fb-438c-af72-e338ef934f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:06:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8a39eaf-87fb-438c-af72-e338ef934f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:06:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8a39eaf-87fb-438c-af72-e338ef934f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:06:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8a39eaf-87fb-438c-af72-e338ef934f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8a39eaf-87fb-438c-af72-e338ef934f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8a39eaf-87fb-438c-af72-e338ef934f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:06:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8a39eaf-87fb-438c-af72-e338ef934f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8a39eaf-87fb-438c-af72-e338ef934f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:06:04Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8bd09cc3-4657-4846-9a4d-ab433c884223","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:06:04Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8bd09cc3-4657-4846-9a4d-ab433c884223","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"dc465dff-4209-43bc-a348-dcfe9c214e75"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"dc465dff-4209-43bc-a348-dcfe9c214e75"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"dc465dff-4209-43bc-a348-dcfe9c214e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"dc465dff-4209-43bc-a348-dcfe9c214e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"dc465dff-4209-43bc-a348-dcfe9c214e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"dc465dff-4209-43bc-a348-dcfe9c214e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"dc465dff-4209-43bc-a348-dcfe9c214e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"dc465dff-4209-43bc-a348-dcfe9c214e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:06:16Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"dc465dff-4209-43bc-a348-dcfe9c214e75","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"dc465dff-4209-43bc-a348-dcfe9c214e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"dc465dff-4209-43bc-a348-dcfe9c214e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"dc465dff-4209-43bc-a348-dcfe9c214e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"dc465dff-4209-43bc-a348-dcfe9c214e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"dc465dff-4209-43bc-a348-dcfe9c214e75","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"893f86a6-a677-4b48-ab88-cc5923f494e4"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"893f86a6-a677-4b48-ab88-cc5923f494e4"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"893f86a6-a677-4b48-ab88-cc5923f494e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"893f86a6-a677-4b48-ab88-cc5923f494e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"893f86a6-a677-4b48-ab88-cc5923f494e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"893f86a6-a677-4b48-ab88-cc5923f494e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"893f86a6-a677-4b48-ab88-cc5923f494e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"893f86a6-a677-4b48-ab88-cc5923f494e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:06:16Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"893f86a6-a677-4b48-ab88-cc5923f494e4","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"893f86a6-a677-4b48-ab88-cc5923f494e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"893f86a6-a677-4b48-ab88-cc5923f494e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"893f86a6-a677-4b48-ab88-cc5923f494e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"893f86a6-a677-4b48-ab88-cc5923f494e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"893f86a6-a677-4b48-ab88-cc5923f494e4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a8d78225-8d1b-479e-9197-f9fbe9bcab5f"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a8d78225-8d1b-479e-9197-f9fbe9bcab5f"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a8d78225-8d1b-479e-9197-f9fbe9bcab5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a8d78225-8d1b-479e-9197-f9fbe9bcab5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a8d78225-8d1b-479e-9197-f9fbe9bcab5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a8d78225-8d1b-479e-9197-f9fbe9bcab5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a8d78225-8d1b-479e-9197-f9fbe9bcab5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a8d78225-8d1b-479e-9197-f9fbe9bcab5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:06:16Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a8d78225-8d1b-479e-9197-f9fbe9bcab5f","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a8d78225-8d1b-479e-9197-f9fbe9bcab5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a8d78225-8d1b-479e-9197-f9fbe9bcab5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a8d78225-8d1b-479e-9197-f9fbe9bcab5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a8d78225-8d1b-479e-9197-f9fbe9bcab5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:16Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a8d78225-8d1b-479e-9197-f9fbe9bcab5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b69909d3-46c9-498d-86a3-8ef03eedcbd0"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b69909d3-46c9-498d-86a3-8ef03eedcbd0"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b69909d3-46c9-498d-86a3-8ef03eedcbd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b69909d3-46c9-498d-86a3-8ef03eedcbd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b69909d3-46c9-498d-86a3-8ef03eedcbd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b69909d3-46c9-498d-86a3-8ef03eedcbd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b69909d3-46c9-498d-86a3-8ef03eedcbd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b69909d3-46c9-498d-86a3-8ef03eedcbd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:06:17Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b69909d3-46c9-498d-86a3-8ef03eedcbd0","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b69909d3-46c9-498d-86a3-8ef03eedcbd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b69909d3-46c9-498d-86a3-8ef03eedcbd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b69909d3-46c9-498d-86a3-8ef03eedcbd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b69909d3-46c9-498d-86a3-8ef03eedcbd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b69909d3-46c9-498d-86a3-8ef03eedcbd0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a486a5e2-19a3-40d9-ad35-f88da8902cc7"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a486a5e2-19a3-40d9-ad35-f88da8902cc7"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a486a5e2-19a3-40d9-ad35-f88da8902cc7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a486a5e2-19a3-40d9-ad35-f88da8902cc7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a486a5e2-19a3-40d9-ad35-f88da8902cc7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a486a5e2-19a3-40d9-ad35-f88da8902cc7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a486a5e2-19a3-40d9-ad35-f88da8902cc7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a486a5e2-19a3-40d9-ad35-f88da8902cc7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a486a5e2-19a3-40d9-ad35-f88da8902cc7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a486a5e2-19a3-40d9-ad35-f88da8902cc7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a486a5e2-19a3-40d9-ad35-f88da8902cc7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a486a5e2-19a3-40d9-ad35-f88da8902cc7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a486a5e2-19a3-40d9-ad35-f88da8902cc7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a486a5e2-19a3-40d9-ad35-f88da8902cc7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a486a5e2-19a3-40d9-ad35-f88da8902cc7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a486a5e2-19a3-40d9-ad35-f88da8902cc7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a486a5e2-19a3-40d9-ad35-f88da8902cc7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a486a5e2-19a3-40d9-ad35-f88da8902cc7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:06:17Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"3485306e-b483-427d-9db8-8babc8f9fc30","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"3485306e-b483-427d-9db8-8babc8f9fc30","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"020d0156-ff3e-47cc-976f-bb090f9d51ea"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"020d0156-ff3e-47cc-976f-bb090f9d51ea"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"020d0156-ff3e-47cc-976f-bb090f9d51ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"020d0156-ff3e-47cc-976f-bb090f9d51ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"020d0156-ff3e-47cc-976f-bb090f9d51ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"020d0156-ff3e-47cc-976f-bb090f9d51ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"020d0156-ff3e-47cc-976f-bb090f9d51ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"020d0156-ff3e-47cc-976f-bb090f9d51ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"020d0156-ff3e-47cc-976f-bb090f9d51ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"020d0156-ff3e-47cc-976f-bb090f9d51ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"020d0156-ff3e-47cc-976f-bb090f9d51ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"020d0156-ff3e-47cc-976f-bb090f9d51ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"020d0156-ff3e-47cc-976f-bb090f9d51ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"020d0156-ff3e-47cc-976f-bb090f9d51ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"020d0156-ff3e-47cc-976f-bb090f9d51ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"020d0156-ff3e-47cc-976f-bb090f9d51ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"020d0156-ff3e-47cc-976f-bb090f9d51ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"020d0156-ff3e-47cc-976f-bb090f9d51ea","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f91a071c-f043-4a93-99de-cd1a27728656"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f91a071c-f043-4a93-99de-cd1a27728656"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f91a071c-f043-4a93-99de-cd1a27728656","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f91a071c-f043-4a93-99de-cd1a27728656","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f91a071c-f043-4a93-99de-cd1a27728656","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f91a071c-f043-4a93-99de-cd1a27728656","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f91a071c-f043-4a93-99de-cd1a27728656","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f91a071c-f043-4a93-99de-cd1a27728656","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f91a071c-f043-4a93-99de-cd1a27728656","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f91a071c-f043-4a93-99de-cd1a27728656","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f91a071c-f043-4a93-99de-cd1a27728656","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f91a071c-f043-4a93-99de-cd1a27728656","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f91a071c-f043-4a93-99de-cd1a27728656","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f91a071c-f043-4a93-99de-cd1a27728656","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f91a071c-f043-4a93-99de-cd1a27728656","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f91a071c-f043-4a93-99de-cd1a27728656","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f91a071c-f043-4a93-99de-cd1a27728656","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:17Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f91a071c-f043-4a93-99de-cd1a27728656","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f56200ec-9d2d-4899-bfeb-3a700d111f51"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f56200ec-9d2d-4899-bfeb-3a700d111f51"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f56200ec-9d2d-4899-bfeb-3a700d111f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f56200ec-9d2d-4899-bfeb-3a700d111f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f56200ec-9d2d-4899-bfeb-3a700d111f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f56200ec-9d2d-4899-bfeb-3a700d111f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f56200ec-9d2d-4899-bfeb-3a700d111f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f56200ec-9d2d-4899-bfeb-3a700d111f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f56200ec-9d2d-4899-bfeb-3a700d111f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f56200ec-9d2d-4899-bfeb-3a700d111f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f56200ec-9d2d-4899-bfeb-3a700d111f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f56200ec-9d2d-4899-bfeb-3a700d111f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f56200ec-9d2d-4899-bfeb-3a700d111f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f56200ec-9d2d-4899-bfeb-3a700d111f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f56200ec-9d2d-4899-bfeb-3a700d111f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f56200ec-9d2d-4899-bfeb-3a700d111f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f56200ec-9d2d-4899-bfeb-3a700d111f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f56200ec-9d2d-4899-bfeb-3a700d111f51","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d74a48b0-9568-4cfd-8f97-89cc13e3b9f5"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d74a48b0-9568-4cfd-8f97-89cc13e3b9f5"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d74a48b0-9568-4cfd-8f97-89cc13e3b9f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d74a48b0-9568-4cfd-8f97-89cc13e3b9f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d74a48b0-9568-4cfd-8f97-89cc13e3b9f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d74a48b0-9568-4cfd-8f97-89cc13e3b9f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d74a48b0-9568-4cfd-8f97-89cc13e3b9f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d74a48b0-9568-4cfd-8f97-89cc13e3b9f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d74a48b0-9568-4cfd-8f97-89cc13e3b9f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d74a48b0-9568-4cfd-8f97-89cc13e3b9f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d74a48b0-9568-4cfd-8f97-89cc13e3b9f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-13T05:06:18Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"05de1abe-6392-4720-9037-f36145d24cfe","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"05de1abe-6392-4720-9037-f36145d24cfe","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d74a48b0-9568-4cfd-8f97-89cc13e3b9f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d74a48b0-9568-4cfd-8f97-89cc13e3b9f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d74a48b0-9568-4cfd-8f97-89cc13e3b9f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d74a48b0-9568-4cfd-8f97-89cc13e3b9f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d74a48b0-9568-4cfd-8f97-89cc13e3b9f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d74a48b0-9568-4cfd-8f97-89cc13e3b9f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:18Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d74a48b0-9568-4cfd-8f97-89cc13e3b9f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-13T05:06:26Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T05:06:32Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"19be4db3-d859-42e8-8920-0afa1ae1b24c"} {"level":"info","ts":"2026-07-13T05:06:32Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"19be4db3-d859-42e8-8920-0afa1ae1b24c"} {"level":"info","ts":"2026-07-13T05:06:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"19be4db3-d859-42e8-8920-0afa1ae1b24c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:06:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"19be4db3-d859-42e8-8920-0afa1ae1b24c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:06:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"19be4db3-d859-42e8-8920-0afa1ae1b24c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:06:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"19be4db3-d859-42e8-8920-0afa1ae1b24c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:06:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"19be4db3-d859-42e8-8920-0afa1ae1b24c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:06:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"19be4db3-d859-42e8-8920-0afa1ae1b24c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:06:32Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"19be4db3-d859-42e8-8920-0afa1ae1b24c","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:06:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"19be4db3-d859-42e8-8920-0afa1ae1b24c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"19be4db3-d859-42e8-8920-0afa1ae1b24c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"19be4db3-d859-42e8-8920-0afa1ae1b24c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:06:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"19be4db3-d859-42e8-8920-0afa1ae1b24c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"19be4db3-d859-42e8-8920-0afa1ae1b24c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:06:47Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"681ff124-6d12-4fdc-bf28-e468554861f5"} {"level":"info","ts":"2026-07-13T05:06:47Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"681ff124-6d12-4fdc-bf28-e468554861f5"} {"level":"info","ts":"2026-07-13T05:06:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"681ff124-6d12-4fdc-bf28-e468554861f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:06:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"681ff124-6d12-4fdc-bf28-e468554861f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:06:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"681ff124-6d12-4fdc-bf28-e468554861f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:06:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"681ff124-6d12-4fdc-bf28-e468554861f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:06:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"681ff124-6d12-4fdc-bf28-e468554861f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:06:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"681ff124-6d12-4fdc-bf28-e468554861f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:06:47Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"681ff124-6d12-4fdc-bf28-e468554861f5","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:06:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"681ff124-6d12-4fdc-bf28-e468554861f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"681ff124-6d12-4fdc-bf28-e468554861f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"681ff124-6d12-4fdc-bf28-e468554861f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:06:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"681ff124-6d12-4fdc-bf28-e468554861f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:06:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"681ff124-6d12-4fdc-bf28-e468554861f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:07:02Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b437c121-75f4-4f4f-a845-b638d9451068"} {"level":"info","ts":"2026-07-13T05:07:02Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b437c121-75f4-4f4f-a845-b638d9451068"} {"level":"info","ts":"2026-07-13T05:07:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b437c121-75f4-4f4f-a845-b638d9451068","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:07:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b437c121-75f4-4f4f-a845-b638d9451068","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:07:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b437c121-75f4-4f4f-a845-b638d9451068","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:07:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b437c121-75f4-4f4f-a845-b638d9451068","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:07:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b437c121-75f4-4f4f-a845-b638d9451068","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:07:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b437c121-75f4-4f4f-a845-b638d9451068","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:07:02Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b437c121-75f4-4f4f-a845-b638d9451068","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:07:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b437c121-75f4-4f4f-a845-b638d9451068","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:07:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b437c121-75f4-4f4f-a845-b638d9451068","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:07:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b437c121-75f4-4f4f-a845-b638d9451068","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:07:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b437c121-75f4-4f4f-a845-b638d9451068","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:07:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b437c121-75f4-4f4f-a845-b638d9451068","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-13T05:07:22Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-13T05:08:03Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T05:08:07Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"trainer-v2-test-113378","reconcileID":"ea8cc89b-a517-4cc4-8665-f4b3487dd4c0"} {"level":"info","ts":"2026-07-13T05:08:07Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"trainer-v2-test-113378","reconcileID":"15b5c856-9ff2-4e1c-a2c2-dddc8b5e2a7d"} {"level":"info","ts":"2026-07-13T05:08:07Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"trainer-v2-test-113378","reconcileID":"a5858ee8-853f-4b31-98cd-96c6436e55a6"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"56139d56-5ac8-4d45-be78-9d49bb1d768e"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"apply","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"56139d56-5ac8-4d45-be78-9d49bb1d768e"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"56139d56-5ac8-4d45-be78-9d49bb1d768e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.checkPreConditions"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"56139d56-5ac8-4d45-be78-9d49bb1d768e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.initialize"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"56139d56-5ac8-4d45-be78-9d49bb1d768e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"56139d56-5ac8-4d45-be78-9d49bb1d768e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"56139d56-5ac8-4d45-be78-9d49bb1d768e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageDefaultKueueResourcesAction"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"56139d56-5ac8-4d45-be78-9d49bb1d768e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding"} {"level":"info","ts":"2026-07-13T05:08:09Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding","msg":"Successfully managed kueue admin role binding","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"56139d56-5ac8-4d45-be78-9d49bb1d768e","adminGroups":["rhods-admins"]} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"56139d56-5ac8-4d45-be78-9d49bb1d768e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"56139d56-5ac8-4d45-be78-9d49bb1d768e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"56139d56-5ac8-4d45-be78-9d49bb1d768e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"56139d56-5ac8-4d45-be78-9d49bb1d768e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.configureClusterQueueViewerRoleAction"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"56139d56-5ac8-4d45-be78-9d49bb1d768e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"56139d56-5ac8-4d45-be78-9d49bb1d768e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"eca083e2-b5e7-4700-8679-215aec1b9ac5"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"apply","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"eca083e2-b5e7-4700-8679-215aec1b9ac5"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"eca083e2-b5e7-4700-8679-215aec1b9ac5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.checkPreConditions"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"885f4558-b943-4e43-9069-dd912c672d5b"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"eca083e2-b5e7-4700-8679-215aec1b9ac5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.initialize"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"eca083e2-b5e7-4700-8679-215aec1b9ac5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"eca083e2-b5e7-4700-8679-215aec1b9ac5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"eca083e2-b5e7-4700-8679-215aec1b9ac5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageDefaultKueueResourcesAction"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"885f4558-b943-4e43-9069-dd912c672d5b"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"885f4558-b943-4e43-9069-dd912c672d5b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"885f4558-b943-4e43-9069-dd912c672d5b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"885f4558-b943-4e43-9069-dd912c672d5b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-13T05:08:09Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus.checkMaaSPrerequisites","msg":"MaaS gateway missing required annotations","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"885f4558-b943-4e43-9069-dd912c672d5b","gateway":"maas-default-gateway","missing":["security.opendatahub.io/authorino-tls-bootstrap=\"true\""]} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"885f4558-b943-4e43-9069-dd912c672d5b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"885f4558-b943-4e43-9069-dd912c672d5b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"eca083e2-b5e7-4700-8679-215aec1b9ac5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding"} {"level":"info","ts":"2026-07-13T05:08:09Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding","msg":"Successfully managed kueue admin role binding","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"eca083e2-b5e7-4700-8679-215aec1b9ac5","adminGroups":["rhods-admins"]} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"eca083e2-b5e7-4700-8679-215aec1b9ac5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"885f4558-b943-4e43-9069-dd912c672d5b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"eca083e2-b5e7-4700-8679-215aec1b9ac5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"eca083e2-b5e7-4700-8679-215aec1b9ac5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"eca083e2-b5e7-4700-8679-215aec1b9ac5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.configureClusterQueueViewerRoleAction"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"eca083e2-b5e7-4700-8679-215aec1b9ac5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"eca083e2-b5e7-4700-8679-215aec1b9ac5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:08:09Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"885f4558-b943-4e43-9069-dd912c672d5b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4a32e56b-5ba4-4810-bd89-4cfb003394b6"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"apply","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4a32e56b-5ba4-4810-bd89-4cfb003394b6"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4a32e56b-5ba4-4810-bd89-4cfb003394b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.checkPreConditions"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4a32e56b-5ba4-4810-bd89-4cfb003394b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.initialize"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4a32e56b-5ba4-4810-bd89-4cfb003394b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4a32e56b-5ba4-4810-bd89-4cfb003394b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4a32e56b-5ba4-4810-bd89-4cfb003394b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageDefaultKueueResourcesAction"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4a32e56b-5ba4-4810-bd89-4cfb003394b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding"} {"level":"info","ts":"2026-07-13T05:08:12Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding","msg":"Successfully managed kueue admin role binding","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4a32e56b-5ba4-4810-bd89-4cfb003394b6","adminGroups":["rhods-admins"]} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4a32e56b-5ba4-4810-bd89-4cfb003394b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4a32e56b-5ba4-4810-bd89-4cfb003394b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4a32e56b-5ba4-4810-bd89-4cfb003394b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4a32e56b-5ba4-4810-bd89-4cfb003394b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.configureClusterQueueViewerRoleAction"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4a32e56b-5ba4-4810-bd89-4cfb003394b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"4a32e56b-5ba4-4810-bd89-4cfb003394b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8b327b06-2942-43e3-aa9e-1a675d5629e1"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"apply","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8b327b06-2942-43e3-aa9e-1a675d5629e1"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8b327b06-2942-43e3-aa9e-1a675d5629e1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.checkPreConditions"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8bd15078-8946-4cc0-83e6-83d1758d73c5"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8b327b06-2942-43e3-aa9e-1a675d5629e1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.initialize"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8b327b06-2942-43e3-aa9e-1a675d5629e1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8b327b06-2942-43e3-aa9e-1a675d5629e1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8b327b06-2942-43e3-aa9e-1a675d5629e1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageDefaultKueueResourcesAction"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8bd15078-8946-4cc0-83e6-83d1758d73c5"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8bd15078-8946-4cc0-83e6-83d1758d73c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8bd15078-8946-4cc0-83e6-83d1758d73c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8bd15078-8946-4cc0-83e6-83d1758d73c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-13T05:08:12Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus.checkMaaSPrerequisites","msg":"MaaS gateway missing required annotations","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8bd15078-8946-4cc0-83e6-83d1758d73c5","gateway":"maas-default-gateway","missing":["security.opendatahub.io/authorino-tls-bootstrap=\"true\""]} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8bd15078-8946-4cc0-83e6-83d1758d73c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8bd15078-8946-4cc0-83e6-83d1758d73c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8bd15078-8946-4cc0-83e6-83d1758d73c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8b327b06-2942-43e3-aa9e-1a675d5629e1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding"} {"level":"info","ts":"2026-07-13T05:08:12Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding","msg":"Successfully managed kueue admin role binding","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8b327b06-2942-43e3-aa9e-1a675d5629e1","adminGroups":["rhods-admins"]} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8b327b06-2942-43e3-aa9e-1a675d5629e1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8b327b06-2942-43e3-aa9e-1a675d5629e1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8b327b06-2942-43e3-aa9e-1a675d5629e1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8b327b06-2942-43e3-aa9e-1a675d5629e1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.configureClusterQueueViewerRoleAction"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8b327b06-2942-43e3-aa9e-1a675d5629e1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8b327b06-2942-43e3-aa9e-1a675d5629e1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:08:12Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"8bd15078-8946-4cc0-83e6-83d1758d73c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"1f95fd0a-bce6-42a2-87a4-ce5dbb5881f1"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"apply","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"1f95fd0a-bce6-42a2-87a4-ce5dbb5881f1"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"1f95fd0a-bce6-42a2-87a4-ce5dbb5881f1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.checkPreConditions"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"1f95fd0a-bce6-42a2-87a4-ce5dbb5881f1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.initialize"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"1f95fd0a-bce6-42a2-87a4-ce5dbb5881f1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"1f95fd0a-bce6-42a2-87a4-ce5dbb5881f1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"1f95fd0a-bce6-42a2-87a4-ce5dbb5881f1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageDefaultKueueResourcesAction"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"1f95fd0a-bce6-42a2-87a4-ce5dbb5881f1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding"} {"level":"info","ts":"2026-07-13T05:08:13Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding","msg":"Successfully managed kueue admin role binding","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"1f95fd0a-bce6-42a2-87a4-ce5dbb5881f1","adminGroups":["rhods-admins"]} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"1f95fd0a-bce6-42a2-87a4-ce5dbb5881f1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"1f95fd0a-bce6-42a2-87a4-ce5dbb5881f1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"1f95fd0a-bce6-42a2-87a4-ce5dbb5881f1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"1f95fd0a-bce6-42a2-87a4-ce5dbb5881f1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.configureClusterQueueViewerRoleAction"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"1f95fd0a-bce6-42a2-87a4-ce5dbb5881f1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"1f95fd0a-bce6-42a2-87a4-ce5dbb5881f1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"023d769d-82e9-4e59-9a75-b023a2eb1982"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"023d769d-82e9-4e59-9a75-b023a2eb1982"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"023d769d-82e9-4e59-9a75-b023a2eb1982","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"023d769d-82e9-4e59-9a75-b023a2eb1982","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"023d769d-82e9-4e59-9a75-b023a2eb1982","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-13T05:08:13Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus.checkMaaSPrerequisites","msg":"MaaS gateway missing required annotations","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"023d769d-82e9-4e59-9a75-b023a2eb1982","gateway":"maas-default-gateway","missing":["security.opendatahub.io/authorino-tls-bootstrap=\"true\""]} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"023d769d-82e9-4e59-9a75-b023a2eb1982","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"023d769d-82e9-4e59-9a75-b023a2eb1982","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"023d769d-82e9-4e59-9a75-b023a2eb1982","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"023d769d-82e9-4e59-9a75-b023a2eb1982","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:08:32Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b531086e-bc90-47fe-9df5-80fc4de82736"} {"level":"info","ts":"2026-07-13T05:08:32Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b531086e-bc90-47fe-9df5-80fc4de82736"} {"level":"info","ts":"2026-07-13T05:08:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b531086e-bc90-47fe-9df5-80fc4de82736","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:08:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b531086e-bc90-47fe-9df5-80fc4de82736","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:08:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b531086e-bc90-47fe-9df5-80fc4de82736","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:08:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b531086e-bc90-47fe-9df5-80fc4de82736","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:08:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b531086e-bc90-47fe-9df5-80fc4de82736","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:08:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b531086e-bc90-47fe-9df5-80fc4de82736","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:08:32Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b531086e-bc90-47fe-9df5-80fc4de82736","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:08:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b531086e-bc90-47fe-9df5-80fc4de82736","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b531086e-bc90-47fe-9df5-80fc4de82736","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b531086e-bc90-47fe-9df5-80fc4de82736","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:08:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b531086e-bc90-47fe-9df5-80fc4de82736","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b531086e-bc90-47fe-9df5-80fc4de82736","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:08:47Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cac2afdf-4874-4ecb-88f2-a297047b0431"} {"level":"info","ts":"2026-07-13T05:08:47Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cac2afdf-4874-4ecb-88f2-a297047b0431"} {"level":"info","ts":"2026-07-13T05:08:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cac2afdf-4874-4ecb-88f2-a297047b0431","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:08:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cac2afdf-4874-4ecb-88f2-a297047b0431","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:08:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cac2afdf-4874-4ecb-88f2-a297047b0431","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:08:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cac2afdf-4874-4ecb-88f2-a297047b0431","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:08:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cac2afdf-4874-4ecb-88f2-a297047b0431","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:08:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cac2afdf-4874-4ecb-88f2-a297047b0431","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:08:47Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cac2afdf-4874-4ecb-88f2-a297047b0431","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:08:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cac2afdf-4874-4ecb-88f2-a297047b0431","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cac2afdf-4874-4ecb-88f2-a297047b0431","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cac2afdf-4874-4ecb-88f2-a297047b0431","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:08:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cac2afdf-4874-4ecb-88f2-a297047b0431","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:08:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cac2afdf-4874-4ecb-88f2-a297047b0431","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:09:02Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10bc9de5-a45e-4ea0-b499-71e64315a9ee"} {"level":"info","ts":"2026-07-13T05:09:02Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10bc9de5-a45e-4ea0-b499-71e64315a9ee"} {"level":"info","ts":"2026-07-13T05:09:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10bc9de5-a45e-4ea0-b499-71e64315a9ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:09:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10bc9de5-a45e-4ea0-b499-71e64315a9ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:09:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10bc9de5-a45e-4ea0-b499-71e64315a9ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:09:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10bc9de5-a45e-4ea0-b499-71e64315a9ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:09:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10bc9de5-a45e-4ea0-b499-71e64315a9ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:09:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10bc9de5-a45e-4ea0-b499-71e64315a9ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:09:02Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10bc9de5-a45e-4ea0-b499-71e64315a9ee","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:09:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10bc9de5-a45e-4ea0-b499-71e64315a9ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:09:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10bc9de5-a45e-4ea0-b499-71e64315a9ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:09:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10bc9de5-a45e-4ea0-b499-71e64315a9ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:09:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10bc9de5-a45e-4ea0-b499-71e64315a9ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:09:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10bc9de5-a45e-4ea0-b499-71e64315a9ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-13T05:09:03Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T05:09:25Z","logger":"controller-runtime.cache","msg":"Warning: This version is deprecated. Use v1beta2 instead."} {"level":"error","ts":"2026-07-13T05:09:52Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"3a29998e-29da-4aa9-980e-84b76c1b2af1"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"apply","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"3a29998e-29da-4aa9-980e-84b76c1b2af1"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"3a29998e-29da-4aa9-980e-84b76c1b2af1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.checkPreConditions"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"3a29998e-29da-4aa9-980e-84b76c1b2af1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.initialize"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"3a29998e-29da-4aa9-980e-84b76c1b2af1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"3a29998e-29da-4aa9-980e-84b76c1b2af1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"3a29998e-29da-4aa9-980e-84b76c1b2af1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageDefaultKueueResourcesAction"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"3a29998e-29da-4aa9-980e-84b76c1b2af1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding"} {"level":"info","ts":"2026-07-13T05:10:15Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding","msg":"Successfully managed kueue admin role binding","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"3a29998e-29da-4aa9-980e-84b76c1b2af1","adminGroups":["rhods-admins"]} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"3a29998e-29da-4aa9-980e-84b76c1b2af1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"3a29998e-29da-4aa9-980e-84b76c1b2af1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"3a29998e-29da-4aa9-980e-84b76c1b2af1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"3a29998e-29da-4aa9-980e-84b76c1b2af1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.configureClusterQueueViewerRoleAction"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"3a29998e-29da-4aa9-980e-84b76c1b2af1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"3a29998e-29da-4aa9-980e-84b76c1b2af1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4e010e0c-b10b-49f0-ad20-214d4be44839"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4e010e0c-b10b-49f0-ad20-214d4be44839"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4e010e0c-b10b-49f0-ad20-214d4be44839","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4e010e0c-b10b-49f0-ad20-214d4be44839","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90e9141b-7e8d-4365-9246-ad677e72145f"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"apply","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90e9141b-7e8d-4365-9246-ad677e72145f"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90e9141b-7e8d-4365-9246-ad677e72145f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.checkPreConditions"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4e010e0c-b10b-49f0-ad20-214d4be44839","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90e9141b-7e8d-4365-9246-ad677e72145f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.initialize"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90e9141b-7e8d-4365-9246-ad677e72145f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90e9141b-7e8d-4365-9246-ad677e72145f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90e9141b-7e8d-4365-9246-ad677e72145f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageDefaultKueueResourcesAction"} {"level":"info","ts":"2026-07-13T05:10:15Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus.checkMaaSPrerequisites","msg":"MaaS gateway missing required annotations","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4e010e0c-b10b-49f0-ad20-214d4be44839","gateway":"maas-default-gateway","missing":["security.opendatahub.io/authorino-tls-bootstrap=\"true\""]} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4e010e0c-b10b-49f0-ad20-214d4be44839","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4e010e0c-b10b-49f0-ad20-214d4be44839","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4e010e0c-b10b-49f0-ad20-214d4be44839","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90e9141b-7e8d-4365-9246-ad677e72145f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding"} {"level":"info","ts":"2026-07-13T05:10:15Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding","msg":"Successfully managed kueue admin role binding","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90e9141b-7e8d-4365-9246-ad677e72145f","adminGroups":["rhods-admins"]} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90e9141b-7e8d-4365-9246-ad677e72145f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90e9141b-7e8d-4365-9246-ad677e72145f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90e9141b-7e8d-4365-9246-ad677e72145f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90e9141b-7e8d-4365-9246-ad677e72145f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.configureClusterQueueViewerRoleAction"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90e9141b-7e8d-4365-9246-ad677e72145f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"90e9141b-7e8d-4365-9246-ad677e72145f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:10:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"4e010e0c-b10b-49f0-ad20-214d4be44839","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8123a038-eef1-4e42-8b12-7bf31c8d70d5"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"apply","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8123a038-eef1-4e42-8b12-7bf31c8d70d5"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8123a038-eef1-4e42-8b12-7bf31c8d70d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.checkPreConditions"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8123a038-eef1-4e42-8b12-7bf31c8d70d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.initialize"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8123a038-eef1-4e42-8b12-7bf31c8d70d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8123a038-eef1-4e42-8b12-7bf31c8d70d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8123a038-eef1-4e42-8b12-7bf31c8d70d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageDefaultKueueResourcesAction"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8123a038-eef1-4e42-8b12-7bf31c8d70d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding"} {"level":"info","ts":"2026-07-13T05:10:19Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.manageKueueAdminRoleBinding","msg":"Successfully managed kueue admin role binding","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8123a038-eef1-4e42-8b12-7bf31c8d70d5","adminGroups":["rhods-admins"]} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8123a038-eef1-4e42-8b12-7bf31c8d70d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8123a038-eef1-4e42-8b12-7bf31c8d70d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8123a038-eef1-4e42-8b12-7bf31c8d70d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8123a038-eef1-4e42-8b12-7bf31c8d70d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kueue.configureClusterQueueViewerRoleAction"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8123a038-eef1-4e42-8b12-7bf31c8d70d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"Executing action","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"8123a038-eef1-4e42-8b12-7bf31c8d70d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2d7559ff-c58e-42fa-b5f3-34ce1a392004"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2d7559ff-c58e-42fa-b5f3-34ce1a392004"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2d7559ff-c58e-42fa-b5f3-34ce1a392004","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2d7559ff-c58e-42fa-b5f3-34ce1a392004","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2d7559ff-c58e-42fa-b5f3-34ce1a392004","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-13T05:10:19Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus.checkMaaSPrerequisites","msg":"MaaS gateway missing required annotations","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2d7559ff-c58e-42fa-b5f3-34ce1a392004","gateway":"maas-default-gateway","missing":["security.opendatahub.io/authorino-tls-bootstrap=\"true\""]} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2d7559ff-c58e-42fa-b5f3-34ce1a392004","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2d7559ff-c58e-42fa-b5f3-34ce1a392004","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2d7559ff-c58e-42fa-b5f3-34ce1a392004","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:19Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2d7559ff-c58e-42fa-b5f3-34ce1a392004","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-13T05:10:42Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T05:10:47Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2aa2e270-dd53-4248-a420-bd3cab106506"} {"level":"info","ts":"2026-07-13T05:10:47Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2aa2e270-dd53-4248-a420-bd3cab106506"} {"level":"info","ts":"2026-07-13T05:10:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2aa2e270-dd53-4248-a420-bd3cab106506","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:10:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2aa2e270-dd53-4248-a420-bd3cab106506","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:10:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2aa2e270-dd53-4248-a420-bd3cab106506","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:10:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2aa2e270-dd53-4248-a420-bd3cab106506","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:10:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2aa2e270-dd53-4248-a420-bd3cab106506","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:10:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2aa2e270-dd53-4248-a420-bd3cab106506","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:10:47Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2aa2e270-dd53-4248-a420-bd3cab106506","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:10:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2aa2e270-dd53-4248-a420-bd3cab106506","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2aa2e270-dd53-4248-a420-bd3cab106506","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2aa2e270-dd53-4248-a420-bd3cab106506","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:10:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2aa2e270-dd53-4248-a420-bd3cab106506","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:10:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2aa2e270-dd53-4248-a420-bd3cab106506","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-13T05:11:02Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5d45c2fb-a041-4fe2-91e3-928f74140b68"} {"level":"info","ts":"2026-07-13T05:11:02Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5d45c2fb-a041-4fe2-91e3-928f74140b68"} {"level":"info","ts":"2026-07-13T05:11:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5d45c2fb-a041-4fe2-91e3-928f74140b68","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:11:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5d45c2fb-a041-4fe2-91e3-928f74140b68","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:11:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5d45c2fb-a041-4fe2-91e3-928f74140b68","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:11:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5d45c2fb-a041-4fe2-91e3-928f74140b68","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:11:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5d45c2fb-a041-4fe2-91e3-928f74140b68","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:11:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5d45c2fb-a041-4fe2-91e3-928f74140b68","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:11:02Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5d45c2fb-a041-4fe2-91e3-928f74140b68","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:11:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5d45c2fb-a041-4fe2-91e3-928f74140b68","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:11:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5d45c2fb-a041-4fe2-91e3-928f74140b68","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:11:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5d45c2fb-a041-4fe2-91e3-928f74140b68","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:11:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5d45c2fb-a041-4fe2-91e3-928f74140b68","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:11:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5d45c2fb-a041-4fe2-91e3-928f74140b68","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-13T05:11:16Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-13T05:11:32Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"763ecf5e-80b5-4f95-96f5-3ed33260c05b"} {"level":"info","ts":"2026-07-13T05:11:32Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"763ecf5e-80b5-4f95-96f5-3ed33260c05b"} {"level":"info","ts":"2026-07-13T05:11:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"763ecf5e-80b5-4f95-96f5-3ed33260c05b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-13T05:11:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"763ecf5e-80b5-4f95-96f5-3ed33260c05b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-13T05:11:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"763ecf5e-80b5-4f95-96f5-3ed33260c05b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-13T05:11:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"763ecf5e-80b5-4f95-96f5-3ed33260c05b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-13T05:11:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"763ecf5e-80b5-4f95-96f5-3ed33260c05b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-13T05:11:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"763ecf5e-80b5-4f95-96f5-3ed33260c05b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-13T05:11:32Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"763ecf5e-80b5-4f95-96f5-3ed33260c05b","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-13T05:11:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"763ecf5e-80b5-4f95-96f5-3ed33260c05b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:11:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"763ecf5e-80b5-4f95-96f5-3ed33260c05b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:11:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"763ecf5e-80b5-4f95-96f5-3ed33260c05b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-13T05:11:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"763ecf5e-80b5-4f95-96f5-3ed33260c05b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-13T05:11:32Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"763ecf5e-80b5-4f95-96f5-3ed33260c05b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} ==================== OPERATOR POD LOG: rhods-operator-56f596f98f-mwq9d.log ==================== ==================== WORKLOAD POD LOG: redhat-ods-applications/dashboard-redirect-85dbcf645f-d4qb8.log ==================== ==================== WORKLOAD POD LOG: redhat-ods-applications/data-science-pipelines-operator-controller-manager-9647f4bn6jgm.log ==================== ==================== WORKLOAD POD LOG: redhat-ods-applications/feast-operator-controller-manager-5f8c4cc64d-rwgrp.log ==================== 2026-07-13T05:00:17Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "ba11857f-0f0d-4e4c-89c4-c05c7bc31b74", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:00:17Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "fdffc781-5d3e-4db1-b0bc-fc5122d168bb", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:00:17Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "a9ea33a2-1717-4b48-b625-0bd52ae8fecb", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:00:18Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "68b67dd5-ebcf-49ab-b189-4d838e9d705c", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:00:18Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "6267d3ee-9bb1-4386-a820-382f9bfe7c13", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:00:18Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "42801691-8a5e-4805-be5b-ca18a81b9c91", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:00:25Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "d0c3f635-450c-419d-8f4a-6017991433b6", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:00:27Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "340a15b6-8b7b-4b7b-bda9-f78dae1fe70f", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:00:33Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "2a83d8f6-3645-42ae-b480-72a2f17bf335", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:00:38Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "a5e522ca-9fb6-496a-a6c2-3ecb482b203d", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:00:38Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "6922615d-2622-43b7-82ad-d25d7370a5e3", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:00:52Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "82e51f0d-ddc6-447c-9c9c-05630b4349ee", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:00:52Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "bfe9f086-b1d5-421f-bb29-9cdcab43282c", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:00:53Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "b52ec063-d208-4b7f-ab91-7a319bab1397", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:00:53Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "09d666a4-8e94-4868-bd0a-5f919336222f", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:00:53Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "d1d57a68-bc1b-4063-81f5-c26a2a318548", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:04:43Z DEBUG Notebook is being deleted, ConfigMap will be cleaned up by owner reference {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "cdeb5247-a75f-41db-9c53-b35814f68fdd"} 2026-07-13T05:04:43Z DEBUG Notebook not found, ConfigMap will be cleaned up by owner reference {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "062570dc-51e3-4bda-af56-4c2a99f02b17"} 2026-07-13T05:04:55Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "3a4c3393-48e4-4da3-a6e5-47125d081b8b", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:04:55Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "9cb0a08e-13ea-4c4a-9428-3d7b27620201", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:04:55Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "01280569-fb75-4b5c-8337-55a9c407ad11", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:04:56Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "95101573-005a-480c-86a8-3469fb3f67c7", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:04:56Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "b8c1d7bd-80bf-43ea-904b-3109f58e5964", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:04:56Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "c750aa74-e429-42bf-9396-f76c1c0d01cf", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:04:56Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "47e9a8f9-b1b6-4430-ae2f-576c3d612c14", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:04:56Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "563fdfcb-d928-4145-a84a-c147fc3bd2e9", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:04:57Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "df45e549-d91f-4865-880c-2c74d2359be4", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:04:57Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "b6cf8f54-9d30-4070-add3-d5219829aa32", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:04:57Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "d5bf8e46-c227-490f-b41d-59f8d5f98928", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:05:20Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "88897133-6247-4410-864f-4b0bd79ce689", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:05:21Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "f138a01b-e7ad-478c-b7ec-cb6ef14b9a21", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:05:21Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "2071f91f-f7bd-4471-9c31-b38db4441488", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:05:25Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "0765d909-ea45-4015-916b-8316bf96456b", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:05:26Z DEBUG Notebook is being deleted, ConfigMap will be cleaned up by owner reference {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "71f195d6-0ee0-4dbe-bf84-693424c7273f"} 2026-07-13T05:05:26Z DEBUG Notebook not found, ConfigMap will be cleaned up by owner reference {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "6132a056-52fa-4457-8e80-bd6c127a0740"} 2026-07-13T05:05:32Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "69d001c1-cd80-43e3-87b3-a1ed90e24878", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:05:34Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "a457b08b-914b-4a7a-809d-7749a214dbc3", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:05:41Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "7448dd57-fe05-4ec5-bc65-5a99a2861db7", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:05:46Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "2e05c52f-89a1-4aab-842b-434256482480", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:05:46Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "027c0705-5e51-4bbb-9a45-ede70efacbfa", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:06:02Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "b5e58d43-ba92-4b8d-b9b6-ac05590b5cb2", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:06:02Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "e988e8d9-13e4-489a-affc-990ed9e03cbe", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:06:02Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "a02d4f15-07cf-4cd5-9b13-1913da630db9", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:06:02Z DEBUG Feast integration not enabled, skipping reconciliation {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "4c031e53-f73a-4b63-a5aa-bc086b6bf901", "label": "opendatahub.io/feast-integration", "value": ""} 2026-07-13T05:06:03Z DEBUG Notebook is being deleted, ConfigMap will be cleaned up by owner reference {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "2e18a7ac-2229-4876-81f6-76080c3f888d"} 2026-07-13T05:06:03Z DEBUG Notebook not found, ConfigMap will be cleaned up by owner reference {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "2656f91d-ea36-46f7-9c7f-5c4787d803ed"} ==================== WORKLOAD POD LOG: redhat-ods-applications/kserve-controller-manager-6c67dcb69c-2vljb.log ==================== ==================== WORKLOAD POD LOG: redhat-ods-applications/kubeflow-trainer-controller-manager-7ccfdd66-wsr4j.log ==================== {"level":"Level(-2)","ts":"2026-07-13T05:05:30.515897899Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"de423efd-3362-4696-94ca-d050b03aee23","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-13T05:05:31.133126281Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:172","msg":"TrainJob create event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:05:31.133254432Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"e2fb1366-001c-4d14-85c2-9513e939af1f","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-13T05:05:31.262995997Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"error","ts":"2026-07-13T05:05:31.265005115Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"e2fb1366-001c-4d14-85c2-9513e939af1f","error":"Operation cannot be fulfilled on trainjobs.trainer.kubeflow.org \"lifecycle-train-job-141919\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-13T05:05:31.265122876Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"0a750336-a1ce-44f0-a56e-7aab2b6b3602","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-13T05:05:31.295685292Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"error","ts":"2026-07-13T05:05:31.314578823Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"0a750336-a1ce-44f0-a56e-7aab2b6b3602","error":"Operation cannot be fulfilled on trainjobs.trainer.kubeflow.org \"lifecycle-train-job-141919\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-13T05:05:31.314681746Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"1255a436-071d-4976-b0e4-5f46a504ad22","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-13T05:05:31.48695625Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"1255a436-071d-4976-b0e4-5f46a504ad22","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no pods found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919"} {"level":"Level(-2)","ts":"2026-07-13T05:05:31.486993685Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"1255a436-071d-4976-b0e4-5f46a504ad22","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:05:31.487087123Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"159b1cb1-b6ba-42aa-914c-8fff308bfb44","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-13T05:05:31.508416044Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-13T05:05:31.693633568Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"159b1cb1-b6ba-42aa-914c-8fff308bfb44","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919; found pods: [lifecycle-train-job-141919-node-0-0-59d85: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-13T05:05:31.69366608Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"159b1cb1-b6ba-42aa-914c-8fff308bfb44","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:05:31.693755298Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"8fe396b2-78b6-4158-a813-80ce497dd24a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-13T05:05:31.711055726Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-13T05:05:31.824493213Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"8fe396b2-78b6-4158-a813-80ce497dd24a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919; found pods: [lifecycle-train-job-141919-node-0-0-59d85: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-13T05:05:31.824527253Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"8fe396b2-78b6-4158-a813-80ce497dd24a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:05:31.824613117Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"08d34acf-e3d1-49d5-83e4-c016dbc92b56","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-13T05:05:32.015471436Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"08d34acf-e3d1-49d5-83e4-c016dbc92b56","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919; found pods: [lifecycle-train-job-141919-node-0-0-59d85: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-13T05:05:32.015505739Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"08d34acf-e3d1-49d5-83e4-c016dbc92b56","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:05:32.133695869Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"b539cdde-a8c7-4770-a059-b6f19aec949a","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:05:32.156706217Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"aad7bad8-1d68-4d14-bc25-53e6170acce2","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:06:01.488102221Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"3770217d-e5f6-4e61-8aaa-e50e7c95e7f3","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-13T05:06:01.535009319Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"3770217d-e5f6-4e61-8aaa-e50e7c95e7f3","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919; found pods: [lifecycle-train-job-141919-node-0-0-59d85: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-13T05:06:01.535053808Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"3770217d-e5f6-4e61-8aaa-e50e7c95e7f3","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:06:06.347295794Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"46c6ce73-2290-4944-9f01-bc255ace5021","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-13T05:06:06.366047214Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-13T05:06:06.395991712Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:06:06.396028491Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"46c6ce73-2290-4944-9f01-bc255ace5021","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:06:06.396064081Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"46c6ce73-2290-4944-9f01-bc255ace5021","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:06:06.396172188Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"1bf2391a-a8ed-42f5-8d8c-d8de6099bbc5","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:06:06.490518081Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"1bf2391a-a8ed-42f5-8d8c-d8de6099bbc5","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:06:06.490552813Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"1bf2391a-a8ed-42f5-8d8c-d8de6099bbc5","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:06:07.367283429Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"13f08c08-3d55-4a1c-8e42-4549e89f17e1","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:06:31.535538926Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"6c13f2a4-ddb1-48dd-bb51-274526f3885a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:06:31.569435728Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"6c13f2a4-ddb1-48dd-bb51-274526f3885a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:06:31.569467781Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"6c13f2a4-ddb1-48dd-bb51-274526f3885a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-13T05:06:31.569637798Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:06:31.569710597Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"a5060011-84a8-4ee4-ad7a-c1015595c2b9","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:06:31.663882473Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"a5060011-84a8-4ee4-ad7a-c1015595c2b9","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:06:31.663922832Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"a5060011-84a8-4ee4-ad7a-c1015595c2b9","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:06:32.569952829Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"e26a7e29-c433-49f3-ae14-308288f64e93","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:07:01.57066383Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"b1c6e0b8-cf61-4a22-82f6-686695aad4be","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:07:01.601986673Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"b1c6e0b8-cf61-4a22-82f6-686695aad4be","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:07:01.602021545Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"b1c6e0b8-cf61-4a22-82f6-686695aad4be","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-13T05:07:01.602123867Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:07:01.60221228Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"5c5fd851-f8fc-4480-a0bc-3911cc5966d6","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:07:01.701231047Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"5c5fd851-f8fc-4480-a0bc-3911cc5966d6","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:07:01.701265251Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"5c5fd851-f8fc-4480-a0bc-3911cc5966d6","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:07:02.60343657Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"1419ae7b-1e18-4653-bf00-b82f36466be7","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:07:31.602195258Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"5c1f598d-7f2e-4959-84c5-b82bbdcc6dd7","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:07:31.633173301Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"5c1f598d-7f2e-4959-84c5-b82bbdcc6dd7","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:07:31.633220004Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"5c1f598d-7f2e-4959-84c5-b82bbdcc6dd7","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"info","ts":"2026-07-13T05:07:31.633355727Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:07:31.633444416Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"e35bc6a8-c365-4bff-b53c-81f6dea6aef0","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:07:31.728947866Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"e35bc6a8-c365-4bff-b53c-81f6dea6aef0","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:07:31.729065378Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"e35bc6a8-c365-4bff-b53c-81f6dea6aef0","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:07:32.636086165Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"9242499a-ff5f-432b-8b46-25971ec92559","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:07:58.02299877Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"29c25b4f-7cf1-439f-8363-73f2f858043e","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-13T05:07:58.042065585Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-13T05:07:58.10324709Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"29c25b4f-7cf1-439f-8363-73f2f858043e","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919; found pods: [lifecycle-train-job-141919-node-0-0-59d85: Running (IP: 10.129.71.139, not ready)]"} {"level":"Level(-2)","ts":"2026-07-13T05:07:58.103280928Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"29c25b4f-7cf1-439f-8363-73f2f858043e","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:07:58.103371821Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"b7071117-1ff5-4a65-8880-5f2ac15cd673","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-13T05:07:58.181559394Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"b7071117-1ff5-4a65-8880-5f2ac15cd673","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919; found pods: [lifecycle-train-job-141919-node-0-0-59d85: Succeeded (IP: 10.129.71.139, not ready)]"} {"level":"Level(-2)","ts":"2026-07-13T05:07:58.181594498Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"b7071117-1ff5-4a65-8880-5f2ac15cd673","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:07:59.034983688Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"9ebf710c-59b9-4634-b511-66d914809ecc","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:07:59.042363383Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"ca1b8fed-88fd-434f-a8c1-5eec3a55d31b","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-13T05:07:59.054073236Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-13T05:07:59.160223518Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"9ebf710c-59b9-4634-b511-66d914809ecc","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob lifecycle-test-141919/lifecycle-train-job-141919; found pods: [lifecycle-train-job-141919-node-0-0-59d85: Succeeded (IP: 10.129.71.139, not ready)]"} {"level":"Level(-2)","ts":"2026-07-13T05:07:59.16025567Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"9ebf710c-59b9-4634-b511-66d914809ecc","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:07:59.160346977Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"814007c3-3898-4d2f-b266-d6213fdfdd0a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-13T05:07:59.177546943Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"debug","ts":"2026-07-13T05:07:59.26125511Z","logger":"progression","caller":"progression/progression.go:616","msg":"Termination message not available, trying HTTP polling","trainjob":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919","error":"termination message is empty for container node"} {"level":"info","ts":"2026-07-13T05:07:59.280404627Z","caller":"progression/progression.go:755","msg":"Captured final training progress","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"814007c3-3898-4d2f-b266-d6213fdfdd0a","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"},"completed":true} {"level":"Level(-2)","ts":"2026-07-13T05:07:59.280519486Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"c20c21ec-f198-40bf-a5d3-954003d2f442","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-13T05:07:59.280570602Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:07:59.286664644Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"lifecycle-test-141919","name":"lifecycle-train-job-141919","reconcileID":"34f0316c-968c-448b-9bb5-fc3cf64e40de","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:08:00.054889338Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"073f5af6-f69d-42a6-84d5-458ee3b4e732","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"info","ts":"2026-07-13T05:08:01.392009641Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:178","msg":"TrainJob delete event","trainJob":{"name":"lifecycle-train-job-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:08:02.39303228Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"4c273493-043f-4756-9e90-3b37b36b2940","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:08:03.09331548Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"lifecycle-test-141919","name":"lifecycle-training-runtime-141919","reconcileID":"c6c05db7-dfb2-4627-b6a4-d0b0ef9dfbb0","trainingRuntime":{"name":"lifecycle-training-runtime-141919","namespace":"lifecycle-test-141919"}} {"level":"Level(-2)","ts":"2026-07-13T05:08:10.244000163Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"1e2deb2b-f2f6-4461-8f60-59cf8ee49b2f","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-13T05:08:10.840593357Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:172","msg":"TrainJob create event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:08:10.840682912Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"656cddf9-fd81-4eb0-b843-217c37aba6bf","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-13T05:08:10.939778804Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-13T05:08:10.963995512Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"error","ts":"2026-07-13T05:08:11.002393418Z","caller":"controller/controller.go:474","msg":"Reconciler error","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"656cddf9-fd81-4eb0-b843-217c37aba6bf","error":"Operation cannot be fulfilled on trainjobs.trainer.kubeflow.org \"test-train-job-113378\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.3/pkg/internal/controller/controller.go:296"} {"level":"Level(-2)","ts":"2026-07-13T05:08:11.002486231Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"d131f9cc-fc00-4082-b01d-fa05432f172c","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-13T05:08:11.172628153Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"d131f9cc-fc00-4082-b01d-fa05432f172c","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no pods found for TrainJob trainer-v2-test-113378/test-train-job-113378"} {"level":"Level(-2)","ts":"2026-07-13T05:08:11.172665064Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"d131f9cc-fc00-4082-b01d-fa05432f172c","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:08:11.172746452Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"a182dc98-89db-4b31-937f-60f18330de11","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-13T05:08:11.361657555Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"a182dc98-89db-4b31-937f-60f18330de11","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no pods found for TrainJob trainer-v2-test-113378/test-train-job-113378"} {"level":"Level(-2)","ts":"2026-07-13T05:08:11.361697412Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"a182dc98-89db-4b31-937f-60f18330de11","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:08:11.361827569Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"73d20d33-e9d3-4231-b8b1-ea124c1a4a75","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-13T05:08:11.386652313Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-13T05:08:11.493414116Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"73d20d33-e9d3-4231-b8b1-ea124c1a4a75","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob trainer-v2-test-113378/test-train-job-113378; found pods: [test-train-job-113378-node-0-0-wrg6v: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-13T05:08:11.493449096Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"73d20d33-e9d3-4231-b8b1-ea124c1a4a75","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:08:11.493555882Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"91ac0b01-a68b-4e33-a0e8-5b318eac4a02","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-13T05:08:11.568243519Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"91ac0b01-a68b-4e33-a0e8-5b318eac4a02","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob trainer-v2-test-113378/test-train-job-113378; found pods: [test-train-job-113378-node-0-0-wrg6v: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-13T05:08:11.568276408Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"91ac0b01-a68b-4e33-a0e8-5b318eac4a02","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:08:11.56835782Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"d492ca9b-10a5-414d-9e43-f80ddb0daf51","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-13T05:08:11.585896552Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-13T05:08:11.614259256Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"d492ca9b-10a5-414d-9e43-f80ddb0daf51","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob trainer-v2-test-113378/test-train-job-113378; found pods: [test-train-job-113378-node-0-0-wrg6v: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-13T05:08:11.614294689Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"d492ca9b-10a5-414d-9e43-f80ddb0daf51","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:08:11.614378349Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"b27adff0-536d-4bf9-b782-15c62dc04786","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-13T05:08:11.649822816Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"b27adff0-536d-4bf9-b782-15c62dc04786","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob trainer-v2-test-113378/test-train-job-113378; found pods: [test-train-job-113378-node-0-0-wrg6v: Pending (IP: , not ready)]"} {"level":"Level(-2)","ts":"2026-07-13T05:08:11.649865793Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"b27adff0-536d-4bf9-b782-15c62dc04786","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:08:11.84122264Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"5c15995a-de10-4c05-b488-74057696e976","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:08:11.860999842Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"02772a82-f7d4-4b0d-842a-ea3def4935af","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:08:15.135849381Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"fdd9d92c-b62d-44ad-8b39-72aa1f4f0de6","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-13T05:08:15.151751303Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-13T05:08:15.178331667Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:08:15.178316852Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"fdd9d92c-b62d-44ad-8b39-72aa1f4f0de6","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:08:15.17837377Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"fdd9d92c-b62d-44ad-8b39-72aa1f4f0de6","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:08:15.178499499Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"307fa823-f4d9-4557-8ca8-ddcfeca9deac","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:08:15.27056201Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"307fa823-f4d9-4557-8ca8-ddcfeca9deac","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:08:15.270608359Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"307fa823-f4d9-4557-8ca8-ddcfeca9deac","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:08:16.152032837Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"bd43f1f0-1bc5-4f09-990e-3c804e10f593","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:08:41.173515387Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"f0ad2d7b-0adb-4d20-976c-4d0c963cdf6d","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:08:41.207169744Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"f0ad2d7b-0adb-4d20-976c-4d0c963cdf6d","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:08:41.207205612Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"f0ad2d7b-0adb-4d20-976c-4d0c963cdf6d","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"info","ts":"2026-07-13T05:08:41.207314145Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:08:41.20740793Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"4b91ad2a-5bc2-4cb3-9999-27ecc78be9f4","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:08:41.302473282Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"4b91ad2a-5bc2-4cb3-9999-27ecc78be9f4","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:08:41.302518443Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"4b91ad2a-5bc2-4cb3-9999-27ecc78be9f4","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:08:42.20850804Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"eb3caa08-df13-4a12-b5bb-77788b75cc7c","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:09:11.208319007Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"a16f1a6b-d59a-4d89-b76f-d55f6b25922c","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:09:11.238207794Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"a16f1a6b-d59a-4d89-b76f-d55f6b25922c","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:09:11.238251957Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"a16f1a6b-d59a-4d89-b76f-d55f6b25922c","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"info","ts":"2026-07-13T05:09:11.23834071Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:09:11.238410229Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"70ab6988-ab8a-4021-b4d9-b70220cb9864","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:09:11.334524324Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"70ab6988-ab8a-4021-b4d9-b70220cb9864","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:09:11.334554208Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"70ab6988-ab8a-4021-b4d9-b70220cb9864","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:09:12.239226349Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"5cf7d139-8fd3-4419-878b-961704d654b4","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:09:41.23900684Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"42dc071d-fe12-4b5d-92c2-7d5337a59572","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-13T05:09:41.271410797Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:09:41.271431828Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"42dc071d-fe12-4b5d-92c2-7d5337a59572","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:09:41.271497994Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"42dc071d-fe12-4b5d-92c2-7d5337a59572","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:09:41.271598804Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"1f18ed03-61b6-468a-8d40-243ffe8a2398","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:09:41.368218284Z","caller":"progression/progression.go:736","msg":"Successfully updated training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"1f18ed03-61b6-468a-8d40-243ffe8a2398","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:09:41.368252886Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"1f18ed03-61b6-468a-8d40-243ffe8a2398","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:09:42.272550667Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"0867b65a-5528-47e6-b03a-fd22e6683429","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:10:06.73006698Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"20b9b026-4eba-4d9b-9a65-6da26cbb2f8b","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-13T05:10:06.746786776Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-13T05:10:06.778005911Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"20b9b026-4eba-4d9b-9a65-6da26cbb2f8b","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob trainer-v2-test-113378/test-train-job-113378; found pods: [test-train-job-113378-node-0-0-wrg6v: Running (IP: 10.129.71.141, not ready)]"} {"level":"Level(-2)","ts":"2026-07-13T05:10:06.778041716Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"20b9b026-4eba-4d9b-9a65-6da26cbb2f8b","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:10:06.778146152Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"daaa6ff6-2262-4086-8807-edc3af82fbc7","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-13T05:10:06.860144522Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"daaa6ff6-2262-4086-8807-edc3af82fbc7","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob trainer-v2-test-113378/test-train-job-113378; found pods: [test-train-job-113378-node-0-0-wrg6v: Running (IP: 10.129.71.141, not ready)]"} {"level":"Level(-2)","ts":"2026-07-13T05:10:06.86018029Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"daaa6ff6-2262-4086-8807-edc3af82fbc7","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:10:07.741769605Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"96f6805c-531c-49e4-9f3c-beffd8ca4afd","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:10:07.747829066Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"9f0893c7-a46e-4ba5-8a95-e153dd0aeb03","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-13T05:10:07.761662515Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-13T05:10:07.874239176Z","caller":"progression/progression.go:734","msg":"Failed to poll training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"96f6805c-531c-49e4-9f3c-beffd8ca4afd","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"error":"primary pod not available: no running and ready pod with IP found for TrainJob trainer-v2-test-113378/test-train-job-113378; found pods: [test-train-job-113378-node-0-0-wrg6v: Succeeded (IP: 10.129.71.141, not ready)]"} {"level":"Level(-2)","ts":"2026-07-13T05:10:07.87427551Z","caller":"progression/progression.go:740","msg":"Requeuing for metrics polling","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"96f6805c-531c-49e4-9f3c-beffd8ca4afd","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"interval":30} {"level":"Level(-2)","ts":"2026-07-13T05:10:07.874378553Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"caf1afc8-f9c2-45fc-8d13-940ce42a2e34","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-13T05:10:07.891524514Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"debug","ts":"2026-07-13T05:10:07.96721386Z","logger":"progression","caller":"progression/progression.go:616","msg":"Termination message not available, trying HTTP polling","trainjob":"test-train-job-113378","namespace":"trainer-v2-test-113378","error":"termination message is empty for container node"} {"level":"info","ts":"2026-07-13T05:10:07.983524847Z","caller":"progression/progression.go:755","msg":"Captured final training progress","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"caf1afc8-f9c2-45fc-8d13-940ce42a2e34","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"},"completed":true} {"level":"info","ts":"2026-07-13T05:10:07.983554699Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:184","msg":"TrainJob update event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:10:07.98361702Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"85b2304c-167e-4015-a3cd-09343cf5489a","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:10:07.989463022Z","caller":"controller/trainjob_controller.go:107","msg":"Reconciling TrainJob","controller":"trainjob_controller","namespace":"trainer-v2-test-113378","name":"test-train-job-113378","reconcileID":"6debaccf-eee0-468c-a573-e6a3978a4c44","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:10:08.762887248Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"7666d286-660d-4ad6-b453-ed1c1998f90b","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"info","ts":"2026-07-13T05:10:08.939290729Z","logger":"trainjob-controller","caller":"controller/trainjob_controller.go:178","msg":"TrainJob delete event","trainJob":{"name":"test-train-job-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:10:09.939689611Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"f9062b5a-35be-49dc-bfa9-934f3c97f4a7","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} {"level":"Level(-2)","ts":"2026-07-13T05:10:10.331989563Z","caller":"controller/trainingruntime_controller.go:79","msg":"Reconciling TrainingRuntime","controller":"trainingruntime_controller","namespace":"trainer-v2-test-113378","name":"test-training-runtime-113378","reconcileID":"94509fe9-5229-4e82-963e-ef0a9e2c1d89","trainingRuntime":{"name":"test-training-runtime-113378","namespace":"trainer-v2-test-113378"}} ==================== WORKLOAD POD LOG: redhat-ods-applications/kubeflow-training-operator-ffc4898b5-pstdb.log ==================== ==================== WORKLOAD POD LOG: redhat-ods-applications/kuberay-operator-76bf477f5-hqsvn.log ==================== ==================== WORKLOAD POD LOG: redhat-ods-applications/llmisvc-controller-manager-5d65df97bb-q4pnf.log ==================== {"level":"info","ts":"2026-07-13T04:47:49Z","logger":"controller-runtime.cache","msg":"Warning: VariantAutoscaling is deprecated and will be removed in a future release. Migrate to the annotation-based path (add llm-d.ai/managed=true to your HPA or ScaledObject). See docs/developer-guide/migrating-from-va-crd.md for migration steps."} {"level":"info","ts":"2026-07-13T04:51:09Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-decode-template","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-decode-template","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"cb9e6c17-39e0-443b-93f4-916288dd0cfe","name":"v3-5-0-ea-2-kserve-config-llm-decode-template","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:51:09Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-decode-worker-data-parallel","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-decode-worker-data-parallel","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"9972ae96-fdcb-4f61-bce0-c80f9df2a36a","name":"v3-5-0-ea-2-kserve-config-llm-decode-worker-data-parallel","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:51:09Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-prefill-template","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-prefill-template","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"34edf5e5-4058-4f82-b69c-f1a2117df216","name":"v3-5-0-ea-2-kserve-config-llm-prefill-template","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:51:09Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-prefill-worker-data-parallel","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-prefill-worker-data-parallel","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"091d8d87-da04-44e0-b592-97c0150f8579","name":"v3-5-0-ea-2-kserve-config-llm-prefill-worker-data-parallel","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:51:09Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-router-route","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-router-route","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"d9aede5c-36f3-4790-aa1b-ba737a048a89","name":"v3-5-0-ea-2-kserve-config-llm-router-route","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:51:09Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-scheduler","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-scheduler","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"247478a0-e340-4e17-8ce7-dd6b92be8b86","name":"v3-5-0-ea-2-kserve-config-llm-scheduler","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:51:09Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"d66dd9d1-a63e-4c8a-915c-ddc289591a4d","name":"v3-5-0-ea-2-kserve-config-llm-template","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:51:09Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template-amd-rocm","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template-amd-rocm","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"03d3cf0b-4723-4e03-8017-691e49c017cb","name":"v3-5-0-ea-2-kserve-config-llm-template-amd-rocm","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:51:09Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-ppc64le","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-ppc64le","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"5cbc1a8e-d1ee-46ba-8f25-34b0c8b1f4f5","name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-ppc64le","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:51:09Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-s390x","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-s390x","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"cdd7c8d6-bdb6-4545-b36e-c782b7267beb","name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-s390x","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:51:09Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-x86","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-x86","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"9c18dcec-f483-4b5a-8e12-e71d5c13a0c1","name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-x86","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:51:09Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template-intel-gaudi","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template-intel-gaudi","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"86a28444-5ad4-4671-a27f-4d638d4ab637","name":"v3-5-0-ea-2-kserve-config-llm-template-intel-gaudi","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:51:09Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template-nvidia-cuda","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template-nvidia-cuda","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"20135e7e-0645-4e61-a232-93d5a229c6d6","name":"v3-5-0-ea-2-kserve-config-llm-template-nvidia-cuda","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:51:09Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-tracing","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-tracing","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"e8543117-eb78-4b66-b4a1-c320da15127b","name":"v3-5-0-ea-2-kserve-config-llm-tracing","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:51:09Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-worker-data-parallel","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-worker-data-parallel","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"1707ed9b-794b-4e09-ba35-b0a81a50a4dc","name":"v3-5-0-ea-2-kserve-config-llm-worker-data-parallel","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:52:51Z","logger":"controller-runtime.cache","msg":"Warning: VariantAutoscaling is deprecated and will be removed in a future release. Migrate to the annotation-based path (add llm-d.ai/managed=true to your HPA or ScaledObject). See docs/developer-guide/migrating-from-va-crd.md for migration steps."} {"level":"info","ts":"2026-07-13T04:58:42Z","logger":"controller-runtime.cache","msg":"Warning: VariantAutoscaling is deprecated and will be removed in a future release. Migrate to the annotation-based path (add llm-d.ai/managed=true to your HPA or ScaledObject). See docs/developer-guide/migrating-from-va-crd.md for migration steps."} {"level":"info","ts":"2026-07-13T05:05:44Z","logger":"controller-runtime.cache","msg":"Warning: VariantAutoscaling is deprecated and will be removed in a future release. Migrate to the annotation-based path (add llm-d.ai/managed=true to your HPA or ScaledObject). See docs/developer-guide/migrating-from-va-crd.md for migration steps."} ==================== WORKLOAD POD LOG: redhat-ods-applications/maas-api-84449bdd5d-nsks2.log ==================== [GIN] 2026/07/13 - 04:45:59 | 200 | 39.99µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:46:01 | 200 | 38.062µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:46:06 | 200 | 39.494µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:46:09 | 200 | 39.704µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:46:11 | 200 | 40.304µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:46:16 | 200 | 36.91µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:46:19 | 200 | 38.173µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:46:21 | 200 | 57.361µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:46:26 | 200 | 36.809µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:46:29 | 200 | 39.931µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:46:31 | 200 | 38.681µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:46:36 | 200 | 39.108µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:46:39 | 200 | 38.629µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:46:41 | 200 | 39.103µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:46:46 | 200 | 41.181µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:46:49 | 200 | 41.863µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:46:51 | 200 | 38.013µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:46:56 | 200 | 31.19µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:46:59 | 200 | 31.114µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:47:01 | 200 | 31.932µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:47:06 | 200 | 32.08µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:47:09 | 200 | 32.061µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:47:11 | 200 | 31.552µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:47:16 | 200 | 31.337µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:47:19 | 200 | 50.603µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:47:21 | 200 | 33.179µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:47:26 | 200 | 32.182µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:47:29 | 200 | 33.272µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:47:31 | 200 | 30.724µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:47:36 | 200 | 33.728µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:47:39 | 200 | 33.75µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:47:41 | 200 | 40.543µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:47:46 | 200 | 37.185µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:47:49 | 200 | 32.021µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:47:51 | 200 | 30.677µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:47:56 | 200 | 52.589µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:47:59 | 200 | 32.997µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:48:01 | 200 | 43.199µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:48:06 | 200 | 42.367µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:48:09 | 200 | 32.854µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:48:11 | 200 | 42.437µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:48:16 | 200 | 39.182µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:48:19 | 200 | 30.62µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:48:21 | 200 | 32.607µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:48:26 | 200 | 32.176µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:48:29 | 200 | 35.699µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:48:31 | 200 | 31.632µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:48:36 | 200 | 32.641µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:48:39 | 200 | 39.575µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:48:41 | 200 | 34.45µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:48:46 | 200 | 31.536µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:48:49 | 200 | 31.708µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:48:51 | 200 | 55.67µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:48:56 | 200 | 31.739µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:48:59 | 200 | 35.413µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:49:01 | 200 | 44.319µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:49:06 | 200 | 37.941µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:49:09 | 200 | 41.506µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:49:11 | 200 | 31.617µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:49:16 | 200 | 35.009µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:49:19 | 200 | 37.742µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:49:21 | 200 | 32.502µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:49:26 | 200 | 33.395µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:49:29 | 200 | 31.017µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:49:31 | 200 | 31.968µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:49:36 | 200 | 31.88µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:49:39 | 200 | 31.641µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:49:41 | 200 | 33.713µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:49:46 | 200 | 32.925µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:49:49 | 200 | 32.731µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:49:51 | 200 | 50.473µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:49:56 | 200 | 31.522µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:49:59 | 200 | 49.874µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:50:01 | 200 | 32.048µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:50:06 | 200 | 33.877µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:50:09 | 200 | 31.661µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:50:11 | 200 | 32.949µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:50:16 | 200 | 34.311µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:50:19 | 200 | 34.475µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:50:21 | 200 | 31.365µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:50:26 | 200 | 41.301µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:50:29 | 200 | 36.031µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:50:31 | 200 | 33.559µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:50:36 | 200 | 36.885µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:50:39 | 200 | 33.223µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:50:41 | 200 | 31.555µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:50:46 | 200 | 31.683µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:50:49 | 200 | 31.521µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:50:51 | 200 | 32.709µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:50:56 | 200 | 31.567µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:50:59 | 200 | 46.885µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:51:01 | 200 | 38.907µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:51:06 | 200 | 37.787µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:51:09 | 200 | 40.808µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:51:11 | 200 | 45.466µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:51:16 | 200 | 43.539µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:51:19 | 200 | 38.184µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:51:21 | 200 | 40.845µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:51:26 | 200 | 36.733µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:51:29 | 200 | 41.274µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:51:31 | 200 | 40.062µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:51:36 | 200 | 42.762µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:51:39 | 200 | 68.493µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:51:41 | 200 | 38.329µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:51:46 | 200 | 37.696µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:51:49 | 200 | 37.053µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:51:51 | 200 | 41.273µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:51:56 | 200 | 40.914µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:51:59 | 200 | 40.294µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:52:01 | 200 | 41.28µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:52:06 | 200 | 45.317µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:52:09 | 200 | 41.79µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:52:11 | 200 | 38.871µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:52:16 | 200 | 66.528µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:52:19 | 200 | 38.469µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:52:21 | 200 | 39.234µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:52:26 | 200 | 39.798µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:52:29 | 200 | 38.772µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:52:31 | 200 | 41.504µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:52:36 | 200 | 40.289µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:52:39 | 200 | 53.247µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:52:41 | 200 | 37.4µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:52:46 | 200 | 38.137µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:52:49 | 200 | 47.166µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:52:51 | 200 | 63.147µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:52:56 | 200 | 37.799µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:52:59 | 200 | 35.213µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:53:01 | 200 | 31.532µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:53:06 | 200 | 31.184µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:53:09 | 200 | 31.915µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:53:11 | 200 | 30.667µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:53:16 | 200 | 34.014µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:53:19 | 200 | 36.383µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:53:21 | 200 | 34.113µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:53:26 | 200 | 34.31µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:53:29 | 200 | 37.382µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:53:31 | 200 | 31.047µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:53:36 | 200 | 29.645µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:53:39 | 200 | 38.552µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:53:41 | 200 | 31.741µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:53:46 | 200 | 32.068µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:53:49 | 200 | 31.766µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:53:51 | 200 | 32.183µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:53:56 | 200 | 32.315µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:53:59 | 200 | 32.427µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:54:01 | 200 | 30.595µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:54:06 | 200 | 35.883µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:54:09 | 200 | 40.833µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:54:11 | 200 | 34.525µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:54:16 | 200 | 32.311µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:54:19 | 200 | 51.584µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:54:21 | 200 | 31.122µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:54:26 | 200 | 30.487µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:54:29 | 200 | 37.228µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:54:31 | 200 | 30.82µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:54:36 | 200 | 32.369µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:54:39 | 200 | 34.704µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:54:41 | 200 | 42.86µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:54:46 | 200 | 33.075µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:54:49 | 200 | 30.435µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:54:51 | 200 | 40.576µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:54:56 | 200 | 33.725µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:54:59 | 200 | 36.313µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:55:01 | 200 | 31.08µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:55:06 | 200 | 32.08µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:55:09 | 200 | 33.234µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:55:11 | 200 | 32.37µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:55:16 | 200 | 37.851µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:55:19 | 200 | 32.983µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:55:21 | 200 | 33.608µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:55:26 | 200 | 37.117µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:55:29 | 200 | 32.046µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:55:31 | 200 | 31.636µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:55:36 | 200 | 31.601µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:55:39 | 200 | 30.61µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:55:41 | 200 | 32.981µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:55:46 | 200 | 33.358µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:55:49 | 200 | 34.569µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:55:51 | 200 | 36.747µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:55:56 | 200 | 33.086µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:55:59 | 200 | 37.315µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:56:01 | 200 | 32.942µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:56:06 | 200 | 39.325µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:56:09 | 200 | 32.335µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:56:11 | 200 | 32.168µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:56:16 | 200 | 30.729µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:56:19 | 200 | 32.382µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:56:21 | 200 | 30.631µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:56:26 | 200 | 40.898µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:56:29 | 200 | 32.368µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:56:31 | 200 | 30.589µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:56:36 | 200 | 33.402µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:56:39 | 200 | 42.638µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:56:41 | 200 | 36.666µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:56:46 | 200 | 30.93µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:56:49 | 200 | 40.56µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:56:51 | 200 | 38.218µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:56:56 | 200 | 41.404µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:56:59 | 200 | 35.141µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:57:01 | 200 | 31.06µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:57:06 | 200 | 34.465µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:57:09 | 200 | 31.097µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:57:11 | 200 | 29.904µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:57:16 | 200 | 31.817µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:57:19 | 200 | 56.612µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:57:21 | 200 | 31.642µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:57:26 | 200 | 31.041µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:57:29 | 200 | 31.575µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:57:31 | 200 | 51.897µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:57:36 | 200 | 31.277µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:57:39 | 200 | 42.767µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:57:41 | 200 | 36.708µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:57:46 | 200 | 32.636µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:57:49 | 200 | 32.778µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:57:51 | 200 | 34.667µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:57:56 | 200 | 31.947µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:57:59 | 200 | 34.012µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:58:01 | 200 | 32.85µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:58:06 | 200 | 31.352µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:58:09 | 200 | 33.336µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:58:11 | 200 | 36.934µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:58:16 | 200 | 33.921µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:58:19 | 200 | 36.81µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:58:21 | 200 | 52.1µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:58:26 | 200 | 34.397µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:58:29 | 200 | 33.743µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:58:31 | 200 | 37.383µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:58:36 | 200 | 32.773µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:58:39 | 200 | 38.773µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:58:41 | 200 | 37.565µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:58:46 | 200 | 35.836µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:58:49 | 200 | 32.392µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:58:51 | 200 | 33.508µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:58:56 | 200 | 38.118µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:58:59 | 200 | 30.931µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:59:01 | 200 | 46.355µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:59:06 | 200 | 32.458µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:59:09 | 200 | 33.538µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:59:11 | 200 | 33.297µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:59:16 | 200 | 32.152µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:59:19 | 200 | 33.232µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:59:21 | 200 | 32.552µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:59:26 | 200 | 32.16µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:59:29 | 200 | 42.407µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:59:31 | 200 | 30.677µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:59:36 | 200 | 31.297µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:59:39 | 200 | 31.18µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:59:41 | 200 | 32.591µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:59:46 | 200 | 29.732µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:59:49 | 200 | 36.862µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:59:51 | 200 | 32.341µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:59:56 | 200 | 31.634µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 04:59:59 | 200 | 35.079µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:00:01 | 200 | 35.1µs | 10.130.10.2 | GET "/health" {"level":"info","timestamp":"2026-07-13T05:00:02.135Z","caller":"api_keys/service.go:324","message":"Ephemeral key cleanup completed","deletedCount":0} [GIN] 2026/07/13 - 05:00:02 | 200 | 12.94093ms | 10.129.71.130 | POST "/internal/v1/api-keys/cleanup" [GIN] 2026/07/13 - 05:00:06 | 200 | 37.656µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:00:09 | 200 | 34.273µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:00:11 | 200 | 39.83µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:00:16 | 200 | 32.388µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:00:19 | 200 | 36.254µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:00:21 | 200 | 33.11µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:00:26 | 200 | 39.781µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:00:29 | 200 | 31.551µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:00:31 | 200 | 35.175µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:00:36 | 200 | 38.508µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:00:39 | 200 | 38.76µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:00:41 | 200 | 36.936µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:00:46 | 200 | 35.824µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:00:49 | 200 | 33.023µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:00:51 | 200 | 32.269µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:00:56 | 200 | 32.07µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:00:59 | 200 | 33.844µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:01:01 | 200 | 35.497µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:01:06 | 200 | 30.297µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:01:09 | 200 | 37.606µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:01:11 | 200 | 39.973µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:01:16 | 200 | 35.39µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:01:19 | 200 | 31.634µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:01:21 | 200 | 33.118µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:01:26 | 200 | 31.812µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:01:29 | 200 | 33.18µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:01:31 | 200 | 32.61µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:01:36 | 200 | 34.446µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:01:39 | 200 | 31.813µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:01:41 | 200 | 38.124µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:01:46 | 200 | 36.387µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:01:49 | 200 | 30.946µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:01:51 | 200 | 33.763µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:01:56 | 200 | 31.324µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:01:59 | 200 | 40.199µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:02:01 | 200 | 42.459µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:02:06 | 200 | 35.589µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:02:09 | 200 | 32.132µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:02:11 | 200 | 32.345µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:02:16 | 200 | 41.493µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:02:19 | 200 | 44.812µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:02:21 | 200 | 30.704µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:02:26 | 200 | 37.167µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:02:29 | 200 | 33.548µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:02:31 | 200 | 31.202µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:02:36 | 200 | 33.073µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:02:39 | 200 | 34.484µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:02:41 | 200 | 32.913µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:02:46 | 200 | 33.016µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:02:49 | 200 | 32.505µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:02:51 | 200 | 30.346µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:02:56 | 200 | 32.879µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:02:59 | 200 | 33.106µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:03:01 | 200 | 33.299µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:03:06 | 200 | 40.532µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:03:09 | 200 | 31.617µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:03:11 | 200 | 32.589µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:03:16 | 200 | 33.197µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:03:19 | 200 | 31.819µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:03:21 | 200 | 33.197µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:03:26 | 200 | 34.828µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:03:29 | 200 | 39.603µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:03:31 | 200 | 32.878µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:03:36 | 200 | 32.685µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:03:39 | 200 | 31.699µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:03:41 | 200 | 39.445µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:03:46 | 200 | 31.067µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:03:49 | 200 | 32.715µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:03:51 | 200 | 34.968µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:03:56 | 200 | 30.941µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:03:59 | 200 | 35.112µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:04:01 | 200 | 34.328µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:04:06 | 200 | 32.856µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:04:09 | 200 | 50.559µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:04:11 | 200 | 34.631µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:04:16 | 200 | 33.84µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:04:19 | 200 | 29.813µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:04:21 | 200 | 36.409µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:04:26 | 200 | 43.896µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:04:29 | 200 | 32.753µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:04:31 | 200 | 33.18µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:04:36 | 200 | 34.809µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:04:39 | 200 | 33.537µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:04:41 | 200 | 40.664µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:04:46 | 200 | 45.246µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:04:49 | 200 | 43.889µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:04:51 | 200 | 36.811µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:04:56 | 200 | 35.141µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:04:59 | 200 | 31.283µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:05:01 | 200 | 31.509µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:05:06 | 200 | 38.844µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:05:09 | 200 | 38.451µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:05:11 | 200 | 31.051µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:05:16 | 200 | 32.206µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:05:19 | 200 | 31.729µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:05:21 | 200 | 35.322µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:05:26 | 200 | 41.092µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:05:29 | 200 | 36.67µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:05:31 | 200 | 33.826µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:05:36 | 200 | 32.164µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:05:39 | 200 | 38.471µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:05:41 | 200 | 33.941µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:05:46 | 200 | 33.107µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:05:49 | 200 | 33.653µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:05:51 | 200 | 32.316µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:05:56 | 200 | 30.656µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:05:59 | 200 | 32.847µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:06:01 | 200 | 32.809µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:06:06 | 200 | 32.263µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:06:09 | 200 | 32.638µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:06:11 | 200 | 31.851µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:06:16 | 200 | 32.209µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:06:19 | 200 | 53.019µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:06:21 | 200 | 34.111µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:06:26 | 200 | 31.634µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:06:29 | 200 | 32.208µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:06:31 | 200 | 33.864µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:06:36 | 200 | 33.994µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:06:39 | 200 | 36.845µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:06:41 | 200 | 34.667µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:06:46 | 200 | 35.286µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:06:49 | 200 | 31.041µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:06:51 | 200 | 32.973µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:06:56 | 200 | 31.308µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:06:59 | 200 | 36.587µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:07:01 | 200 | 29.398µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:07:06 | 200 | 32.102µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:07:09 | 200 | 31.339µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:07:11 | 200 | 33.622µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:07:16 | 200 | 35.533µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:07:19 | 200 | 38.195µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:07:21 | 200 | 30.82µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:07:26 | 200 | 42.214µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:07:29 | 200 | 35.244µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:07:31 | 200 | 44.7µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:07:36 | 200 | 67.766µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:07:39 | 200 | 42.105µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:07:41 | 200 | 31.773µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:07:46 | 200 | 34.21µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:07:49 | 200 | 38.636µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:07:51 | 200 | 35.744µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:07:56 | 200 | 30.801µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:07:59 | 200 | 31.1µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:08:01 | 200 | 30.296µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:08:06 | 200 | 33.916µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:08:09 | 200 | 31.051µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:08:11 | 200 | 31.795µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:08:16 | 200 | 32.533µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:08:19 | 200 | 33.528µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:08:21 | 200 | 34.188µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:08:26 | 200 | 36.343µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:08:29 | 200 | 31.474µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:08:31 | 200 | 31.299µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:08:36 | 200 | 33.61µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:08:39 | 200 | 36.568µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:08:41 | 200 | 32.011µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:08:46 | 200 | 34.582µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:08:49 | 200 | 35.056µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:08:51 | 200 | 43.271µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:08:56 | 200 | 31.432µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:08:59 | 200 | 32.311µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:09:01 | 200 | 44.029µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:09:06 | 200 | 33.355µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:09:09 | 200 | 32.27µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:09:11 | 200 | 41.706µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:09:16 | 200 | 40.93µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:09:19 | 200 | 53.74µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:09:21 | 200 | 39.362µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:09:26 | 200 | 38.281µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:09:29 | 200 | 53.99µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:09:31 | 200 | 41.009µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:09:36 | 200 | 38.905µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:09:39 | 200 | 38.268µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:09:41 | 200 | 40.936µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:09:46 | 200 | 38.948µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:09:49 | 200 | 39.971µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:09:51 | 200 | 38.639µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:09:56 | 200 | 40.494µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:09:59 | 200 | 40.524µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:10:01 | 200 | 38.135µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:10:06 | 200 | 42.996µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:10:09 | 200 | 39.324µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:10:11 | 200 | 39.244µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:10:16 | 200 | 39.317µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:10:19 | 200 | 45.865µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:10:21 | 200 | 37.605µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:10:26 | 200 | 63.426µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:10:29 | 200 | 38.409µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:10:31 | 200 | 37.948µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:10:36 | 200 | 46.365µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:10:39 | 200 | 42.115µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:10:41 | 200 | 38.029µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:10:46 | 200 | 43.858µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:10:49 | 200 | 39.914µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:10:51 | 200 | 48.911µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:10:56 | 200 | 40.252µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:10:59 | 200 | 50.854µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:11:01 | 200 | 36.523µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:11:06 | 200 | 38.472µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:11:09 | 200 | 41.677µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:11:11 | 200 | 29.969µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:11:16 | 200 | 54.027µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:11:19 | 200 | 32.17µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:11:21 | 200 | 30.43µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:11:26 | 200 | 33.78µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:11:29 | 200 | 36.9µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:11:31 | 200 | 31.097µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:11:36 | 200 | 42.324µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:11:39 | 200 | 32.106µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:11:41 | 200 | 31.839µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:11:46 | 200 | 40.28µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:11:49 | 200 | 42.022µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:11:51 | 200 | 32.19µs | 10.130.10.2 | GET "/health" [GIN] 2026/07/13 - 05:11:56 | 200 | 42.743µs | 10.130.10.2 | GET "/health" ==================== WORKLOAD POD LOG: redhat-ods-applications/maas-api-key-cleanup-29731950-cmvbt.log ==================== ==================== WORKLOAD POD LOG: redhat-ods-applications/maas-api-key-cleanup-29731965-dn2jv.log ==================== ==================== WORKLOAD POD LOG: redhat-ods-applications/maas-api-key-cleanup-29731980-447qf.log ==================== {"deletedCount":0,"message":"Successfully deleted 0 expired ephemeral key(s)"} ==================== WORKLOAD POD LOG: redhat-ods-applications/maas-controller-85bdcf9988-ckcwv.log ==================== {"level":"info","ts":"2026-07-13T04:46:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:46:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:46:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:46:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:47:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:47:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:47:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:47:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:47:56Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-13T04:47:56Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-13T04:47:56Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"449f35a3-f376-4724-b28f-79bb4d9187ec","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-13T04:47:56Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-13T04:47:56Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-13T04:47:56Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-13T04:47:57Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"449f35a3-f376-4724-b28f-79bb4d9187ec","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:47:57Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"449f35a3-f376-4724-b28f-79bb4d9187ec","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:47:57Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-13T04:47:57Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-13T04:48:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:48:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:48:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:48:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:49:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:49:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:49:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:49:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:50:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:50:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:50:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:50:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:51:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:51:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:51:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:51:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:52:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:52:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:52:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:52:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:52:57Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-13T04:52:57Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-13T04:52:57Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"bf9f2013-8c15-489e-a18b-d8afa8e8464e","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-13T04:52:57Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-13T04:52:57Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-13T04:52:57Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-13T04:52:58Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"bf9f2013-8c15-489e-a18b-d8afa8e8464e","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:52:58Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"bf9f2013-8c15-489e-a18b-d8afa8e8464e","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:52:58Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-13T04:52:58Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-13T04:53:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:53:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:53:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:53:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:54:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:54:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:54:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:54:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:55:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:55:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:55:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:55:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:56:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:56:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:56:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:56:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:57:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:57:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:57:22Z","msg":"set Config owner reference on maas-controller Deployment","controller":"deployment","controllerGroup":"apps","controllerKind":"Deployment","Deployment":{"name":"maas-controller","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"maas-controller","reconcileID":"fd1798e1-7d80-4f0f-bb02-f2272a072e22","deployment":{"name":"maas-controller","namespace":"redhat-ods-applications"}} {"level":"info","ts":"2026-07-13T04:57:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:57:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:57:58Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-13T04:57:58Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-13T04:57:58Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"d704e4d3-9f46-4260-b1d9-782cd5f2b0b3","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-13T04:57:58Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-13T04:57:58Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-13T04:57:58Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-13T04:57:58Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"d704e4d3-9f46-4260-b1d9-782cd5f2b0b3","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:57:58Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"d704e4d3-9f46-4260-b1d9-782cd5f2b0b3","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T04:57:58Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-13T04:57:58Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-13T04:58:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:58:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:58:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:58:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:59:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:59:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T04:59:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T04:59:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:00:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:00:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:00:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:00:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:01:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:01:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:01:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:01:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:02:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:02:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:02:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:02:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:02:58Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-13T05:02:58Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-13T05:02:58Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"14d65c8b-616a-4529-ad9a-4d87792eca03","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-13T05:02:58Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-13T05:02:58Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-13T05:02:58Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-13T05:02:59Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"14d65c8b-616a-4529-ad9a-4d87792eca03","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:02:59Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"14d65c8b-616a-4529-ad9a-4d87792eca03","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:02:59Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-13T05:02:59Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-13T05:03:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:03:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:03:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:03:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:04:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:04:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:04:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:04:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:05:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:05:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:05:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:05:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:06:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:06:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:06:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:06:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:07:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:07:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:07:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:07:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:07:59Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-13T05:07:59Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-13T05:07:59Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"6e277c35-944c-4c27-9dd1-11b135da5699","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-13T05:07:59Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-13T05:07:59Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-13T05:07:59Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-13T05:08:00Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"6e277c35-944c-4c27-9dd1-11b135da5699","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:08:00Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"6e277c35-944c-4c27-9dd1-11b135da5699","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-13T05:08:00Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-13T05:08:00Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-13T05:08:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:08:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:08:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:08:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:09:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:09:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:09:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:09:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:10:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:10:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:10:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:10:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:11:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-13T05:11:08Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:11:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-13T05:11:38Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} ==================== WORKLOAD POD LOG: redhat-ods-applications/maas-postgres-d66f546cf-zpn8w.log ==================== ==================== WORKLOAD POD LOG: redhat-ods-applications/mlflow-operator-controller-manager-5b97b7ddcf-kjdkm.log ==================== ==================== WORKLOAD POD LOG: redhat-ods-applications/model-registry-operator-controller-manager-7bddf46955-gh8c5.log ==================== 2026-07-13T04:48:24Z INFO controller-runtime.cache Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-07-13T04:55:30Z INFO controller-runtime.cache Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-07-13T05:02:18Z INFO admission default {"object": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:rhods-dashboard", "requestID": "7be81310-0436-4f69-97e4-3d9c674726b7", "name": "e2e-test-registry"} 2026-07-13T05:02:18Z INFO modelregistry-resource default {"name": "e2e-test-registry", "status.specDefaults": ""} 2026-07-13T05:02:18Z INFO admission validate create {"object": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:rhods-dashboard", "requestID": "16c73476-8d59-438d-be8a-d3b54761cb4c", "name": "e2e-test-registry"} 2026-07-13T05:02:18Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:18Z INFO admission default {"object": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:rhods-dashboard", "requestID": "3666b1ba-15ba-4948-97be-2b6253833b65", "name": "e2e-test-registry"} 2026-07-13T05:02:18Z INFO modelregistry-resource default {"name": "e2e-test-registry", "status.specDefaults": ""} 2026-07-13T05:02:18Z INFO admission validate create {"object": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:rhods-dashboard", "requestID": "b209c63e-5517-4cb1-ba40-68cc13a91e26", "name": "e2e-test-registry"} 2026-07-13T05:02:18Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:18Z INFO Adding Finalizer for ModelRegistry {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "e3eb4045-70c6-47bc-972a-86a4a4a4ed6d"} 2026-07-13T05:02:18Z INFO admission default {"object": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:model-registry-operator-controller-manager", "requestID": "ece6c1c0-7591-4051-bb34-1a7fae6b6b85", "name": "e2e-test-registry"} 2026-07-13T05:02:18Z INFO modelregistry-resource default {"name": "e2e-test-registry", "status.specDefaults": ""} 2026-07-13T05:02:18Z INFO admission validate update {"object": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:model-registry-operator-controller-manager", "requestID": "014095f0-5d47-4e24-86e6-915fa385822b", "name": "e2e-test-registry"} 2026-07-13T05:02:18Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:18Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:18Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:18Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:18Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:18Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "e3eb4045-70c6-47bc-972a-86a4a4a4ed6d", "kind": "/v1, Kind=ServiceAccount", "name": "e2e-test-registry"} 2026-07-13T05:02:18Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:18Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "e3eb4045-70c6-47bc-972a-86a4a4a4ed6d", "kind": "/v1, Kind=Service", "name": "e2e-test-registry"} 2026-07-13T05:02:18Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "e3eb4045-70c6-47bc-972a-86a4a4a4ed6d", "kind": "apps/v1, Kind=Deployment", "name": "e2e-test-registry"} 2026-07-13T05:02:18Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "e3eb4045-70c6-47bc-972a-86a4a4a4ed6d", "kind": "rbac.authorization.k8s.io/v1, Kind=Role", "name": "registry-user-e2e-test-registry"} 2026-07-13T05:02:18Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "e3eb4045-70c6-47bc-972a-86a4a4a4ed6d", "kind": "user.openshift.io/v1, Kind=Group", "name": "e2e-test-registry-users"} 2026-07-13T05:02:18Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "e3eb4045-70c6-47bc-972a-86a4a4a4ed6d", "kind": "rbac.authorization.k8s.io/v1, Kind=RoleBinding", "name": "e2e-test-registry-users"} 2026-07-13T05:02:18Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "e3eb4045-70c6-47bc-972a-86a4a4a4ed6d", "kind": "gateway.networking.k8s.io/v1, Kind=HTTPRoute", "name": "model-registry-e2e-test-registry"} 2026-07-13T05:02:18Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "e3eb4045-70c6-47bc-972a-86a4a4a4ed6d", "kind": "/v1, Kind=ConfigMap", "name": "e2e-test-registry-kube-rbac-proxy-config"} 2026-07-13T05:02:18Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "e3eb4045-70c6-47bc-972a-86a4a4a4ed6d", "kind": "route.openshift.io/v1, Kind=Route", "name": "e2e-test-registry-https"} 2026-07-13T05:02:18Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "e3eb4045-70c6-47bc-972a-86a4a4a4ed6d", "kind": "networking.k8s.io/v1, Kind=NetworkPolicy", "name": "e2e-test-registry-https-route"} 2026-07-13T05:02:18Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "e3eb4045-70c6-47bc-972a-86a4a4a4ed6d", "status": 1} 2026-07-13T05:02:18Z DEBUG events Event occurred {"object": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "kind": "ModelRegistry", "apiVersion": "modelregistry.opendatahub.io/v1beta1", "type": "Normal", "reason": "ServiceCreated", "action": "ServiceCreated", "note": "Created service for custom resource e2e-test-registry in namespace rhoai-model-registries"} 2026-07-13T05:02:18Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:18Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "e3eb4045-70c6-47bc-972a-86a4a4a4ed6d"} 2026-07-13T05:02:18Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:18Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:18Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "04180b0e-4e50-4fe4-b006-b17d59dd042e", "status": 0} 2026-07-13T05:02:18Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "04180b0e-4e50-4fe4-b006-b17d59dd042e"} 2026-07-13T05:02:18Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:18Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:18Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:18Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "8a371211-025b-4886-b12a-5c77db462de5", "status": 0} 2026-07-13T05:02:18Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "8a371211-025b-4886-b12a-5c77db462de5"} 2026-07-13T05:02:18Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:18Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "7f6f9482-1eb1-4644-80c6-63532fa76391", "status": 0} 2026-07-13T05:02:18Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "7f6f9482-1eb1-4644-80c6-63532fa76391"} 2026-07-13T05:02:18Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:18Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "ac0b0e06-c6b6-4357-a4f6-d342e42406e8", "status": 0} 2026-07-13T05:02:18Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "ac0b0e06-c6b6-4357-a4f6-d342e42406e8"} 2026-07-13T05:02:18Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:19Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "23e0af89-58c8-40a4-b36d-e61f862b8f46", "status": 0} 2026-07-13T05:02:19Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "23e0af89-58c8-40a4-b36d-e61f862b8f46"} 2026-07-13T05:02:19Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:19Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:19Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:19Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "9b105cfd-7286-4282-b578-cdb809c91e63", "status": 0} 2026-07-13T05:02:19Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "9b105cfd-7286-4282-b578-cdb809c91e63"} 2026-07-13T05:02:19Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:19Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:19Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:19Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "b04ffbe9-0d04-4b52-89c3-cd90a6b00895", "status": 0} 2026-07-13T05:02:19Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "b04ffbe9-0d04-4b52-89c3-cd90a6b00895"} 2026-07-13T05:02:19Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:19Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "f9063e2b-410e-4223-b1d0-d2024cc0589b", "status": 0} 2026-07-13T05:02:19Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "f9063e2b-410e-4223-b1d0-d2024cc0589b"} 2026-07-13T05:02:21Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:21Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "b563ffd2-c497-4c43-a76c-6479edcd61a4", "status": 0} 2026-07-13T05:02:21Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "b563ffd2-c497-4c43-a76c-6479edcd61a4"} 2026-07-13T05:02:21Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:21Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:21Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:21Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "b9a2787f-811d-4798-a04e-9d0e02845be4", "status": 0} 2026-07-13T05:02:21Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "b9a2787f-811d-4798-a04e-9d0e02845be4"} 2026-07-13T05:02:26Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:26Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "de901d49-104b-4b10-8046-daf160872a8d", "status": 0} 2026-07-13T05:02:26Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "de901d49-104b-4b10-8046-daf160872a8d"} 2026-07-13T05:02:33Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:33Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "f8fbc259-d2c7-42fa-855b-66eb52c005fc", "status": 0} 2026-07-13T05:02:33Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "f8fbc259-d2c7-42fa-855b-66eb52c005fc"} 2026-07-13T05:02:33Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:33Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:33Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:33Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "3c0e0f1d-f6ec-4c52-9274-6f5baed33dc6", "status": 0} 2026-07-13T05:02:33Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "3c0e0f1d-f6ec-4c52-9274-6f5baed33dc6"} 2026-07-13T05:02:34Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:34Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "9a7ca7f2-1443-420d-8bc3-3f65cb0a417d", "status": 0} 2026-07-13T05:02:34Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "9a7ca7f2-1443-420d-8bc3-3f65cb0a417d"} 2026-07-13T05:02:35Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:35Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "55772150-81ef-4a6c-8c1f-82985a767aa7", "status": 0} 2026-07-13T05:02:35Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "55772150-81ef-4a6c-8c1f-82985a767aa7"} 2026-07-13T05:02:36Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:37Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "6d0e6b05-4175-42c9-b8d3-c1c82110a4c6", "status": 0} 2026-07-13T05:02:37Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "6d0e6b05-4175-42c9-b8d3-c1c82110a4c6"} 2026-07-13T05:02:38Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:38Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "85c82c6c-9366-4257-b37e-ad93fc1f4536", "status": 0} 2026-07-13T05:02:38Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "85c82c6c-9366-4257-b37e-ad93fc1f4536"} 2026-07-13T05:02:38Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:38Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:38Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:38Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "4cdc8aad-7885-46d3-acf6-e6205b0fc9c4", "status": 0} 2026-07-13T05:02:38Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "4cdc8aad-7885-46d3-acf6-e6205b0fc9c4"} 2026-07-13T05:02:47Z INFO Performing Finalizer Operations for modelRegistry before delete CR {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "ae1b788d-1cb3-4e4e-af91-c4c5d37616bd"} 2026-07-13T05:02:47Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:47Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:47Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:47Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:47Z DEBUG events Event occurred {"object": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "kind": "ModelRegistry", "apiVersion": "modelregistry.opendatahub.io/v1beta1", "type": "Warning", "reason": "Deleting", "action": "Deleting", "note": "Custom Resource e2e-test-registry is being deleted from the namespace rhoai-model-registries"} 2026-07-13T05:02:47Z INFO Removing Finalizer for modelRegistry after successfully perform the operations {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "ae1b788d-1cb3-4e4e-af91-c4c5d37616bd"} 2026-07-13T05:02:47Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:47Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:47Z INFO admission default {"object": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:model-registry-operator-controller-manager", "requestID": "9de95d92-e416-47d7-870b-249291669006", "name": "e2e-test-registry"} 2026-07-13T05:02:47Z INFO modelregistry-resource default {"name": "e2e-test-registry", "status.specDefaults": "{\"kubeRBACProxy\":{\"domain\":\"apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com\",\"image\":\"registry.redhat.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:1e614e46799fd020ac18d95c06a463421154ce86e59ccb3fa6007e66fed9910e\",\"tlsCertificateSecret\":{\"key\":\"tls.crt\",\"name\":\"e2e-test-registry-kube-rbac-proxy\"},\"tlsKeySecret\":{\"key\":\"tls.key\",\"name\":\"e2e-test-registry-kube-rbac-proxy\"}},\"rest\":{\"image\":\"registry.redhat.io/rhoai/odh-model-registry-rhel9@sha256:5edad515e70c884b93b1b8cc30a4a17f63f47a36a23808f19b2e8fa28a97a0a2\",\"resources\":{\"limits\":{\"memory\":\"256Mi\"},\"requests\":{\"cpu\":\"100m\",\"memory\":\"256Mi\"}}}}"} 2026-07-13T05:02:47Z INFO admission validate update {"object": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:model-registry-operator-controller-manager", "requestID": "bd0a9d60-f4d7-4eca-b224-f4533ebba27b", "name": "e2e-test-registry"} 2026-07-13T05:02:47Z INFO modelregistry-resource runtime defaults {"name": "e2e-test-registry"} 2026-07-13T05:02:47Z INFO Performing Finalizer Operations for modelRegistry before delete CR {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "26037320-0fa7-4b5f-9111-097c0a69944c"} 2026-07-13T05:02:47Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:47Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/e2e-test-registry"} 2026-07-13T05:02:47Z DEBUG events Event occurred {"object": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "kind": "ModelRegistry", "apiVersion": "modelregistry.opendatahub.io/v1beta1", "type": "Warning", "reason": "Deleting", "action": "Deleting", "note": "Custom Resource e2e-test-registry is being deleted from the namespace rhoai-model-registries"} 2026-07-13T05:02:47Z INFO Removing Finalizer for modelRegistry after successfully perform the operations {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "26037320-0fa7-4b5f-9111-097c0a69944c"} 2026-07-13T05:02:47Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "8065e71f-70c5-4de6-af55-b6c51ad859e1"} 2026-07-13T05:02:47Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"e2e-test-registry","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "e2e-test-registry", "reconcileID": "7d52331e-7f67-4061-8dae-8d08523a6a2e"} 2026-07-13T05:02:52Z INFO admission default {"object": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:rhods-dashboard", "requestID": "c1f378d7-7dad-451d-b337-61060be48bac", "name": "postgres-registry-1783918867047"} 2026-07-13T05:02:52Z INFO modelregistry-resource default {"name": "postgres-registry-1783918867047", "status.specDefaults": ""} 2026-07-13T05:02:52Z INFO admission validate create {"object": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:rhods-dashboard", "requestID": "e5093bb4-df08-487a-aa81-02130c31094b", "name": "postgres-registry-1783918867047"} 2026-07-13T05:02:52Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:02:52Z INFO admission default {"object": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:rhods-dashboard", "requestID": "a38afd66-a28e-4696-b637-f9ff8c88e4af", "name": "postgres-registry-1783918867047"} 2026-07-13T05:02:52Z INFO modelregistry-resource default {"name": "postgres-registry-1783918867047", "status.specDefaults": ""} 2026-07-13T05:02:52Z INFO admission validate create {"object": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:rhods-dashboard", "requestID": "026c75d8-b420-4f93-9f59-16d6f8a2262c", "name": "postgres-registry-1783918867047"} 2026-07-13T05:02:52Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:02:52Z INFO Adding Finalizer for ModelRegistry {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "5226b127-04c2-47ab-b07b-2fe55a722020"} 2026-07-13T05:02:52Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:02:52Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:02:52Z INFO admission default {"object": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:model-registry-operator-controller-manager", "requestID": "20c2b641-6501-49b7-a3eb-e3c399901527", "name": "postgres-registry-1783918867047"} 2026-07-13T05:02:52Z INFO modelregistry-resource default {"name": "postgres-registry-1783918867047", "status.specDefaults": ""} 2026-07-13T05:02:52Z INFO admission validate update {"object": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:model-registry-operator-controller-manager", "requestID": "87f5aec6-b23b-4cde-baec-140b4b1cb9cd", "name": "postgres-registry-1783918867047"} 2026-07-13T05:02:52Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:02:52Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:02:52Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "5226b127-04c2-47ab-b07b-2fe55a722020", "kind": "/v1, Kind=ServiceAccount", "name": "postgres-registry-1783918867047"} 2026-07-13T05:02:52Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:02:52Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:02:52Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "5226b127-04c2-47ab-b07b-2fe55a722020", "kind": "/v1, Kind=Service", "name": "postgres-registry-1783918867047"} 2026-07-13T05:02:52Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "5226b127-04c2-47ab-b07b-2fe55a722020", "kind": "apps/v1, Kind=Deployment", "name": "postgres-registry-1783918867047"} 2026-07-13T05:02:52Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "5226b127-04c2-47ab-b07b-2fe55a722020", "kind": "rbac.authorization.k8s.io/v1, Kind=Role", "name": "registry-user-postgres-registry-1783918867047"} 2026-07-13T05:02:53Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "5226b127-04c2-47ab-b07b-2fe55a722020", "kind": "user.openshift.io/v1, Kind=Group", "name": "postgres-registry-1783918867047-users"} 2026-07-13T05:02:53Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "5226b127-04c2-47ab-b07b-2fe55a722020", "kind": "rbac.authorization.k8s.io/v1, Kind=RoleBinding", "name": "postgres-registry-1783918867047-users"} 2026-07-13T05:02:53Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "5226b127-04c2-47ab-b07b-2fe55a722020", "kind": "gateway.networking.k8s.io/v1, Kind=HTTPRoute", "name": "model-registry-postgres-registry-1783918867047"} 2026-07-13T05:02:53Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "5226b127-04c2-47ab-b07b-2fe55a722020", "kind": "/v1, Kind=ConfigMap", "name": "postgres-registry-1783918867047-kube-rbac-proxy-config"} 2026-07-13T05:02:53Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "5226b127-04c2-47ab-b07b-2fe55a722020", "kind": "rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding", "name": "postgres-registry-1783918867047-auth-delegator"} 2026-07-13T05:02:53Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "5226b127-04c2-47ab-b07b-2fe55a722020", "kind": "route.openshift.io/v1, Kind=Route", "name": "postgres-registry-1783918867047-https"} 2026-07-13T05:02:53Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "5226b127-04c2-47ab-b07b-2fe55a722020", "kind": "networking.k8s.io/v1, Kind=NetworkPolicy", "name": "postgres-registry-1783918867047-https-route"} 2026-07-13T05:02:53Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "5226b127-04c2-47ab-b07b-2fe55a722020", "status": 1} 2026-07-13T05:02:53Z DEBUG events Event occurred {"object": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "kind": "ModelRegistry", "apiVersion": "modelregistry.opendatahub.io/v1beta1", "type": "Normal", "reason": "ServiceCreated", "action": "ServiceCreated", "note": "Created service for custom resource postgres-registry-1783918867047 in namespace rhoai-model-registries"} 2026-07-13T05:02:53Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:02:53Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "5226b127-04c2-47ab-b07b-2fe55a722020"} 2026-07-13T05:02:53Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:02:53Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:02:53Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "11274c4a-06ac-4cb7-8887-149a5b5688cd", "status": 0} 2026-07-13T05:02:53Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "11274c4a-06ac-4cb7-8887-149a5b5688cd"} 2026-07-13T05:02:53Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:02:53Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:02:53Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:02:53Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "dff6f2f2-a3f1-4092-a283-55ebaa7a8d7c", "status": 0} 2026-07-13T05:02:53Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "dff6f2f2-a3f1-4092-a283-55ebaa7a8d7c"} 2026-07-13T05:02:53Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:02:53Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "4f34635c-e069-4c07-a18d-2e3f733a1158", "status": 0} 2026-07-13T05:02:53Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "4f34635c-e069-4c07-a18d-2e3f733a1158"} 2026-07-13T05:02:53Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:02:53Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "e5ae5abf-62ac-4606-8b04-813cc93420e9", "status": 0} 2026-07-13T05:02:53Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "e5ae5abf-62ac-4606-8b04-813cc93420e9"} 2026-07-13T05:02:53Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:02:53Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "a9faccea-6394-4f63-bcf6-fc6320613495", "status": 0} 2026-07-13T05:02:53Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "a9faccea-6394-4f63-bcf6-fc6320613495"} 2026-07-13T05:02:53Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:02:53Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "6f40abfc-1cb9-41a8-a778-458aef316e29", "status": 0} 2026-07-13T05:02:53Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "6f40abfc-1cb9-41a8-a778-458aef316e29"} 2026-07-13T05:02:54Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:02:54Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "a81c0d52-f86f-4134-8db8-d31a6ac3f415", "status": 0} 2026-07-13T05:02:54Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "a81c0d52-f86f-4134-8db8-d31a6ac3f415"} 2026-07-13T05:02:54Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:02:54Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:02:54Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:02:54Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "8b3a0911-f8b0-4170-86bd-5c94904c8e14", "status": 0} 2026-07-13T05:02:54Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "8b3a0911-f8b0-4170-86bd-5c94904c8e14"} 2026-07-13T05:02:55Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:02:55Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "a25caf68-7a93-4805-b880-8b5b755d9664", "status": 0} 2026-07-13T05:02:55Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "a25caf68-7a93-4805-b880-8b5b755d9664"} 2026-07-13T05:02:58Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:02:58Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "d157c2e0-dd40-4c6f-ba35-379b85b3d477", "status": 0} 2026-07-13T05:02:58Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "d157c2e0-dd40-4c6f-ba35-379b85b3d477"} 2026-07-13T05:03:03Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:03:03Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "7692c2b0-6fcf-4360-99ea-d4f08302f49a", "status": 0} 2026-07-13T05:03:03Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:03:03Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "7692c2b0-6fcf-4360-99ea-d4f08302f49a"} 2026-07-13T05:03:03Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:03:03Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:03:03Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "ee5f2681-8a83-4e8a-b1bc-91159810dd99", "status": 0} 2026-07-13T05:03:03Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "ee5f2681-8a83-4e8a-b1bc-91159810dd99"} 2026-07-13T05:03:04Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:03:04Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "af08c74b-a27b-4330-bf72-be662842e1cb", "status": 0} 2026-07-13T05:03:04Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "af08c74b-a27b-4330-bf72-be662842e1cb"} 2026-07-13T05:03:04Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:03:04Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:03:04Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:03:04Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "21c6ff1c-b220-4fa9-8b88-ad983caf00e1", "status": 0} 2026-07-13T05:03:04Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "21c6ff1c-b220-4fa9-8b88-ad983caf00e1"} 2026-07-13T05:03:05Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:03:05Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "abeca3e5-bbd3-497f-bca2-6630eac94adc", "status": 0} 2026-07-13T05:03:05Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "abeca3e5-bbd3-497f-bca2-6630eac94adc"} 2026-07-13T05:03:06Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:03:06Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "dd68b745-8f10-4ddc-883f-3826747eb8a6", "status": 0} 2026-07-13T05:03:06Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "dd68b745-8f10-4ddc-883f-3826747eb8a6"} 2026-07-13T05:03:07Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:03:07Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "76d0914d-b32f-4f9e-b788-0624383f730d", "status": 0} 2026-07-13T05:03:07Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "76d0914d-b32f-4f9e-b788-0624383f730d"} 2026-07-13T05:03:08Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:03:08Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "95e736a2-4589-4a10-91af-def38586f04e", "status": 0} 2026-07-13T05:03:08Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "95e736a2-4589-4a10-91af-def38586f04e"} 2026-07-13T05:03:09Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:03:09Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "8d0796f8-3fde-4fde-99ec-75fe952d230a", "status": 0} 2026-07-13T05:03:09Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "8d0796f8-3fde-4fde-99ec-75fe952d230a"} 2026-07-13T05:03:09Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:03:09Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:03:09Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:03:09Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "9b7934ed-b8b6-497d-ae62-b17e19c08fa3", "status": 0} 2026-07-13T05:03:09Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "9b7934ed-b8b6-497d-ae62-b17e19c08fa3"} 2026-07-13T05:03:20Z INFO controller-runtime.cache Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-07-13T05:03:22Z INFO Performing Finalizer Operations for modelRegistry before delete CR {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "7d86f11f-e8e9-45b0-9063-ad041fa95ce2"} 2026-07-13T05:03:22Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:03:22Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:03:22Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:03:22Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:03:22Z DEBUG events Event occurred {"object": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "kind": "ModelRegistry", "apiVersion": "modelregistry.opendatahub.io/v1beta1", "type": "Warning", "reason": "Deleting", "action": "Deleting", "note": "Custom Resource postgres-registry-1783918867047 is being deleted from the namespace rhoai-model-registries"} 2026-07-13T05:03:22Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:03:22Z INFO Removing Finalizer for modelRegistry after successfully perform the operations {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "7d86f11f-e8e9-45b0-9063-ad041fa95ce2"} 2026-07-13T05:03:22Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:03:22Z INFO admission default {"object": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:model-registry-operator-controller-manager", "requestID": "4a5e7ee5-1d2e-432b-a93d-0b9500a00370", "name": "postgres-registry-1783918867047"} 2026-07-13T05:03:22Z INFO modelregistry-resource default {"name": "postgres-registry-1783918867047", "status.specDefaults": "{\"kubeRBACProxy\":{\"domain\":\"apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com\",\"image\":\"registry.redhat.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:1e614e46799fd020ac18d95c06a463421154ce86e59ccb3fa6007e66fed9910e\",\"tlsCertificateSecret\":{\"key\":\"tls.crt\",\"name\":\"postgres-registry-1783918867047-kube-rbac-proxy\"},\"tlsKeySecret\":{\"key\":\"tls.key\",\"name\":\"postgres-registry-1783918867047-kube-rbac-proxy\"}},\"postgres\":{\"image\":\"registry.redhat.io/rhel9/postgresql-16@sha256:cb66eb4b438ce3f9db194dd1948ce25dc4142e789025f214324b7baa3c915c05\"},\"rest\":{\"image\":\"registry.redhat.io/rhoai/odh-model-registry-rhel9@sha256:5edad515e70c884b93b1b8cc30a4a17f63f47a36a23808f19b2e8fa28a97a0a2\",\"resources\":{\"limits\":{\"memory\":\"256Mi\"},\"requests\":{\"cpu\":\"100m\",\"memory\":\"256Mi\"}}}}"} 2026-07-13T05:03:22Z INFO admission validate update {"object": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:model-registry-operator-controller-manager", "requestID": "9487795d-9a94-4973-9c93-571551bee7f7", "name": "postgres-registry-1783918867047"} 2026-07-13T05:03:22Z INFO modelregistry-resource runtime defaults {"name": "postgres-registry-1783918867047"} 2026-07-13T05:03:22Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "6da4358b-40d8-4a3d-8eca-29bfac623f47"} 2026-07-13T05:03:22Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "6f561dee-d7e5-4909-8bf4-9ef7ee12d57a"} 2026-07-13T05:03:22Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:03:22Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/postgres-registry-1783918867047"} 2026-07-13T05:03:22Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "deae3065-383b-47da-9630-1eb067dcc738"} 2026-07-13T05:03:22Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "c66afdd8-2309-4fb9-b690-f808a15afcc9"} 2026-07-13T05:03:22Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "d9e8a39d-30c3-45fc-b625-8249bc60d300"} 2026-07-13T05:03:22Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "222e00e3-431d-4944-b870-4356991df398"} 2026-07-13T05:03:22Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "92daa65e-2841-4465-8617-658e6abc128b"} 2026-07-13T05:03:22Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "28a2ea42-e5f7-4753-9d5c-c5cdd21f1d06"} 2026-07-13T05:03:22Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"postgres-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "postgres-registry-1783918867047", "reconcileID": "9dd268ab-30d7-4aa0-83ba-80615b4b429d"} 2026-07-13T05:03:29Z INFO admission default {"object": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:rhods-dashboard", "requestID": "23a2c6d5-9ec4-4510-bcf2-95a486c0a3d4", "name": "default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO modelregistry-resource default {"name": "default-db-registry-1783918867047", "status.specDefaults": ""} 2026-07-13T05:03:29Z INFO admission validate create {"object": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:rhods-dashboard", "requestID": "ea84c5ab-488b-4e37-a12f-59f5fdfcccc2", "name": "default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO admission default {"object": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:rhods-dashboard", "requestID": "8513bd09-5730-4ec1-8a4a-ebe651b27271", "name": "default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO modelregistry-resource default {"name": "default-db-registry-1783918867047", "status.specDefaults": ""} 2026-07-13T05:03:29Z INFO admission validate create {"object": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:rhods-dashboard", "requestID": "5d7dfb02-7b84-4618-b64d-1374a42153ad", "name": "default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO Adding Finalizer for ModelRegistry {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249"} 2026-07-13T05:03:29Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO admission default {"object": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:model-registry-operator-controller-manager", "requestID": "64e7323f-119b-4825-b76e-95b8858e5fef", "name": "default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO modelregistry-resource default {"name": "default-db-registry-1783918867047", "status.specDefaults": ""} 2026-07-13T05:03:29Z INFO admission validate update {"object": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:model-registry-operator-controller-manager", "requestID": "6fac0271-dff0-4a3b-a815-a4630ae4e026", "name": "default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249"} 2026-07-13T05:03:29Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO Creating postgres secret {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249", "secret": "default-db-registry-1783918867047-postgres-credentials"} 2026-07-13T05:03:29Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249", "kind": "/, Kind=", "name": "default-db-registry-1783918867047-postgres-credentials"} 2026-07-13T05:03:29Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249"} 2026-07-13T05:03:29Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249", "kind": "/v1, Kind=PersistentVolumeClaim", "name": "default-db-registry-1783918867047-postgres-storage"} 2026-07-13T05:03:29Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249"} 2026-07-13T05:03:29Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249", "kind": "apps/v1, Kind=Deployment", "name": "default-db-registry-1783918867047-postgres"} 2026-07-13T05:03:29Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249"} 2026-07-13T05:03:29Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249", "kind": "/v1, Kind=Service", "name": "default-db-registry-1783918867047-postgres"} 2026-07-13T05:03:29Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249"} 2026-07-13T05:03:29Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249", "kind": "networking.k8s.io/v1, Kind=NetworkPolicy", "name": "default-db-registry-1783918867047-postgres"} 2026-07-13T05:03:29Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249"} 2026-07-13T05:03:29Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249", "kind": "/v1, Kind=ServiceAccount", "name": "default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249", "kind": "/v1, Kind=Service", "name": "default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249", "kind": "apps/v1, Kind=Deployment", "name": "default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249", "kind": "rbac.authorization.k8s.io/v1, Kind=Role", "name": "registry-user-default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249", "kind": "user.openshift.io/v1, Kind=Group", "name": "default-db-registry-1783918867047-users"} 2026-07-13T05:03:29Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249", "kind": "rbac.authorization.k8s.io/v1, Kind=RoleBinding", "name": "default-db-registry-1783918867047-users"} 2026-07-13T05:03:29Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249", "kind": "gateway.networking.k8s.io/v1, Kind=HTTPRoute", "name": "model-registry-default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249", "kind": "/v1, Kind=ConfigMap", "name": "default-db-registry-1783918867047-kube-rbac-proxy-config"} 2026-07-13T05:03:29Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249", "kind": "rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding", "name": "default-db-registry-1783918867047-auth-delegator"} 2026-07-13T05:03:29Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249", "kind": "route.openshift.io/v1, Kind=Route", "name": "default-db-registry-1783918867047-https"} 2026-07-13T05:03:29Z INFO creating {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249", "kind": "networking.k8s.io/v1, Kind=NetworkPolicy", "name": "default-db-registry-1783918867047-https-route"} 2026-07-13T05:03:29Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249", "status": 1} 2026-07-13T05:03:29Z DEBUG events Event occurred {"object": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "kind": "ModelRegistry", "apiVersion": "modelregistry.opendatahub.io/v1beta1", "type": "Normal", "reason": "ServiceCreated", "action": "ServiceCreated", "note": "Created service for custom resource default-db-registry-1783918867047 in namespace rhoai-model-registries"} 2026-07-13T05:03:29Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "eddd893c-748b-4149-996e-d9d76fe29249"} 2026-07-13T05:03:29Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "64772246-b6ef-45c0-8de8-5deb85fa9dcc"} 2026-07-13T05:03:29Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "64772246-b6ef-45c0-8de8-5deb85fa9dcc"} 2026-07-13T05:03:29Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "64772246-b6ef-45c0-8de8-5deb85fa9dcc"} 2026-07-13T05:03:29Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "64772246-b6ef-45c0-8de8-5deb85fa9dcc"} 2026-07-13T05:03:29Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "64772246-b6ef-45c0-8de8-5deb85fa9dcc"} 2026-07-13T05:03:29Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "64772246-b6ef-45c0-8de8-5deb85fa9dcc"} 2026-07-13T05:03:29Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "64772246-b6ef-45c0-8de8-5deb85fa9dcc", "status": 0} 2026-07-13T05:03:29Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "64772246-b6ef-45c0-8de8-5deb85fa9dcc"} 2026-07-13T05:03:29Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "2f64fe21-62cc-44df-bb80-b60f4deec637"} 2026-07-13T05:03:29Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "2f64fe21-62cc-44df-bb80-b60f4deec637"} 2026-07-13T05:03:29Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "2f64fe21-62cc-44df-bb80-b60f4deec637"} 2026-07-13T05:03:29Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "2f64fe21-62cc-44df-bb80-b60f4deec637"} 2026-07-13T05:03:29Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "2f64fe21-62cc-44df-bb80-b60f4deec637"} 2026-07-13T05:03:29Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "2f64fe21-62cc-44df-bb80-b60f4deec637"} 2026-07-13T05:03:29Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "2f64fe21-62cc-44df-bb80-b60f4deec637", "status": 0} 2026-07-13T05:03:29Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "2f64fe21-62cc-44df-bb80-b60f4deec637"} 2026-07-13T05:03:29Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "bab79f14-f5fa-41ab-85f8-11be63be07fb"} 2026-07-13T05:03:29Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "bab79f14-f5fa-41ab-85f8-11be63be07fb"} 2026-07-13T05:03:29Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "bab79f14-f5fa-41ab-85f8-11be63be07fb"} 2026-07-13T05:03:29Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "bab79f14-f5fa-41ab-85f8-11be63be07fb"} 2026-07-13T05:03:29Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "bab79f14-f5fa-41ab-85f8-11be63be07fb"} 2026-07-13T05:03:29Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "bab79f14-f5fa-41ab-85f8-11be63be07fb"} 2026-07-13T05:03:29Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "bab79f14-f5fa-41ab-85f8-11be63be07fb", "status": 0} 2026-07-13T05:03:29Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "bab79f14-f5fa-41ab-85f8-11be63be07fb"} 2026-07-13T05:03:29Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:29Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "d0d63b6c-0b15-4e62-9387-31a27228377a"} 2026-07-13T05:03:29Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "d0d63b6c-0b15-4e62-9387-31a27228377a"} 2026-07-13T05:03:29Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "d0d63b6c-0b15-4e62-9387-31a27228377a"} 2026-07-13T05:03:29Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "d0d63b6c-0b15-4e62-9387-31a27228377a"} 2026-07-13T05:03:29Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "d0d63b6c-0b15-4e62-9387-31a27228377a"} 2026-07-13T05:03:29Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "d0d63b6c-0b15-4e62-9387-31a27228377a"} 2026-07-13T05:03:29Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "d0d63b6c-0b15-4e62-9387-31a27228377a", "status": 0} 2026-07-13T05:03:30Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "d0d63b6c-0b15-4e62-9387-31a27228377a"} 2026-07-13T05:03:30Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:30Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "7c804b6e-e2b2-445a-b250-a86fe3f6f7b0"} 2026-07-13T05:03:30Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "7c804b6e-e2b2-445a-b250-a86fe3f6f7b0"} 2026-07-13T05:03:30Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "7c804b6e-e2b2-445a-b250-a86fe3f6f7b0"} 2026-07-13T05:03:30Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "7c804b6e-e2b2-445a-b250-a86fe3f6f7b0"} 2026-07-13T05:03:30Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "7c804b6e-e2b2-445a-b250-a86fe3f6f7b0"} 2026-07-13T05:03:30Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "7c804b6e-e2b2-445a-b250-a86fe3f6f7b0"} 2026-07-13T05:03:30Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "7c804b6e-e2b2-445a-b250-a86fe3f6f7b0", "status": 0} 2026-07-13T05:03:30Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "7c804b6e-e2b2-445a-b250-a86fe3f6f7b0"} 2026-07-13T05:03:30Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:30Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "6c0dd4c4-9b0a-4fba-b703-48b7d241cbb9"} 2026-07-13T05:03:30Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "6c0dd4c4-9b0a-4fba-b703-48b7d241cbb9"} 2026-07-13T05:03:30Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "6c0dd4c4-9b0a-4fba-b703-48b7d241cbb9"} 2026-07-13T05:03:30Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "6c0dd4c4-9b0a-4fba-b703-48b7d241cbb9"} 2026-07-13T05:03:30Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "6c0dd4c4-9b0a-4fba-b703-48b7d241cbb9"} 2026-07-13T05:03:30Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "6c0dd4c4-9b0a-4fba-b703-48b7d241cbb9"} 2026-07-13T05:03:30Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "6c0dd4c4-9b0a-4fba-b703-48b7d241cbb9", "status": 0} 2026-07-13T05:03:30Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "6c0dd4c4-9b0a-4fba-b703-48b7d241cbb9"} 2026-07-13T05:03:30Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:30Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "8ae0e780-1fe9-4e90-9da3-fd25d4db4e6e"} 2026-07-13T05:03:30Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "8ae0e780-1fe9-4e90-9da3-fd25d4db4e6e"} 2026-07-13T05:03:30Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "8ae0e780-1fe9-4e90-9da3-fd25d4db4e6e"} 2026-07-13T05:03:30Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "8ae0e780-1fe9-4e90-9da3-fd25d4db4e6e"} 2026-07-13T05:03:30Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "8ae0e780-1fe9-4e90-9da3-fd25d4db4e6e"} 2026-07-13T05:03:30Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "8ae0e780-1fe9-4e90-9da3-fd25d4db4e6e"} 2026-07-13T05:03:30Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "8ae0e780-1fe9-4e90-9da3-fd25d4db4e6e", "status": 0} 2026-07-13T05:03:30Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:30Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:30Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "8ae0e780-1fe9-4e90-9da3-fd25d4db4e6e"} 2026-07-13T05:03:30Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:30Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "ab21a6d4-ed79-4c49-a2c0-568b8938b9d0"} 2026-07-13T05:03:30Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "ab21a6d4-ed79-4c49-a2c0-568b8938b9d0"} 2026-07-13T05:03:30Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "ab21a6d4-ed79-4c49-a2c0-568b8938b9d0"} 2026-07-13T05:03:30Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "ab21a6d4-ed79-4c49-a2c0-568b8938b9d0"} 2026-07-13T05:03:30Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "ab21a6d4-ed79-4c49-a2c0-568b8938b9d0"} 2026-07-13T05:03:30Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "ab21a6d4-ed79-4c49-a2c0-568b8938b9d0"} 2026-07-13T05:03:30Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "ab21a6d4-ed79-4c49-a2c0-568b8938b9d0", "status": 0} 2026-07-13T05:03:30Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "ab21a6d4-ed79-4c49-a2c0-568b8938b9d0"} 2026-07-13T05:03:32Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:32Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "4024506e-97e6-4dd7-8b20-50af86558a88"} 2026-07-13T05:03:32Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "4024506e-97e6-4dd7-8b20-50af86558a88"} 2026-07-13T05:03:32Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "4024506e-97e6-4dd7-8b20-50af86558a88"} 2026-07-13T05:03:32Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "4024506e-97e6-4dd7-8b20-50af86558a88"} 2026-07-13T05:03:32Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "4024506e-97e6-4dd7-8b20-50af86558a88"} 2026-07-13T05:03:32Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "4024506e-97e6-4dd7-8b20-50af86558a88"} 2026-07-13T05:03:32Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "4024506e-97e6-4dd7-8b20-50af86558a88", "status": 0} 2026-07-13T05:03:32Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "4024506e-97e6-4dd7-8b20-50af86558a88"} 2026-07-13T05:03:34Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:34Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "2c1401cb-3050-469f-afa6-65f0b089a4e3"} 2026-07-13T05:03:34Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "2c1401cb-3050-469f-afa6-65f0b089a4e3"} 2026-07-13T05:03:34Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "2c1401cb-3050-469f-afa6-65f0b089a4e3"} 2026-07-13T05:03:34Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "2c1401cb-3050-469f-afa6-65f0b089a4e3"} 2026-07-13T05:03:34Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "2c1401cb-3050-469f-afa6-65f0b089a4e3"} 2026-07-13T05:03:34Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "2c1401cb-3050-469f-afa6-65f0b089a4e3"} 2026-07-13T05:03:34Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "2c1401cb-3050-469f-afa6-65f0b089a4e3", "status": 0} 2026-07-13T05:03:34Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "2c1401cb-3050-469f-afa6-65f0b089a4e3"} 2026-07-13T05:03:34Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:34Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:34Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "aa4b0ae1-5b21-4d09-b179-f0aee6da4592"} 2026-07-13T05:03:34Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:34Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "aa4b0ae1-5b21-4d09-b179-f0aee6da4592"} 2026-07-13T05:03:34Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "aa4b0ae1-5b21-4d09-b179-f0aee6da4592"} 2026-07-13T05:03:34Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "aa4b0ae1-5b21-4d09-b179-f0aee6da4592"} 2026-07-13T05:03:34Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "aa4b0ae1-5b21-4d09-b179-f0aee6da4592"} 2026-07-13T05:03:34Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "aa4b0ae1-5b21-4d09-b179-f0aee6da4592"} 2026-07-13T05:03:34Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "aa4b0ae1-5b21-4d09-b179-f0aee6da4592", "status": 0} 2026-07-13T05:03:34Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "aa4b0ae1-5b21-4d09-b179-f0aee6da4592"} 2026-07-13T05:03:45Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:45Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "aef99e96-a9de-4d05-8c5b-adda1d625b46"} 2026-07-13T05:03:45Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "aef99e96-a9de-4d05-8c5b-adda1d625b46"} 2026-07-13T05:03:45Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "aef99e96-a9de-4d05-8c5b-adda1d625b46"} 2026-07-13T05:03:45Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "aef99e96-a9de-4d05-8c5b-adda1d625b46"} 2026-07-13T05:03:45Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "aef99e96-a9de-4d05-8c5b-adda1d625b46"} 2026-07-13T05:03:45Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "aef99e96-a9de-4d05-8c5b-adda1d625b46"} 2026-07-13T05:03:45Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "aef99e96-a9de-4d05-8c5b-adda1d625b46", "status": 0} 2026-07-13T05:03:45Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "aef99e96-a9de-4d05-8c5b-adda1d625b46"} 2026-07-13T05:03:45Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:45Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "278d5dd8-60e1-45f4-a2d8-8ebcd6066643"} 2026-07-13T05:03:45Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:45Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:45Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "278d5dd8-60e1-45f4-a2d8-8ebcd6066643"} 2026-07-13T05:03:45Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "278d5dd8-60e1-45f4-a2d8-8ebcd6066643"} 2026-07-13T05:03:45Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "278d5dd8-60e1-45f4-a2d8-8ebcd6066643"} 2026-07-13T05:03:45Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "278d5dd8-60e1-45f4-a2d8-8ebcd6066643"} 2026-07-13T05:03:45Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "278d5dd8-60e1-45f4-a2d8-8ebcd6066643"} 2026-07-13T05:03:45Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "278d5dd8-60e1-45f4-a2d8-8ebcd6066643", "status": 0} 2026-07-13T05:03:45Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "278d5dd8-60e1-45f4-a2d8-8ebcd6066643"} 2026-07-13T05:03:50Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:50Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "332e1806-c9e3-4970-b5a9-5347e08e78ec"} 2026-07-13T05:03:50Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "332e1806-c9e3-4970-b5a9-5347e08e78ec"} 2026-07-13T05:03:50Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "332e1806-c9e3-4970-b5a9-5347e08e78ec"} 2026-07-13T05:03:50Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "332e1806-c9e3-4970-b5a9-5347e08e78ec"} 2026-07-13T05:03:50Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "332e1806-c9e3-4970-b5a9-5347e08e78ec"} 2026-07-13T05:03:50Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "332e1806-c9e3-4970-b5a9-5347e08e78ec"} 2026-07-13T05:03:50Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "332e1806-c9e3-4970-b5a9-5347e08e78ec", "status": 0} 2026-07-13T05:03:50Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "332e1806-c9e3-4970-b5a9-5347e08e78ec"} 2026-07-13T05:03:50Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:50Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:50Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "88eabdc3-b448-4470-ad39-9d640003ae7f"} 2026-07-13T05:03:50Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:50Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "88eabdc3-b448-4470-ad39-9d640003ae7f"} 2026-07-13T05:03:50Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "88eabdc3-b448-4470-ad39-9d640003ae7f"} 2026-07-13T05:03:50Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "88eabdc3-b448-4470-ad39-9d640003ae7f"} 2026-07-13T05:03:50Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "88eabdc3-b448-4470-ad39-9d640003ae7f"} 2026-07-13T05:03:50Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "88eabdc3-b448-4470-ad39-9d640003ae7f"} 2026-07-13T05:03:50Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "88eabdc3-b448-4470-ad39-9d640003ae7f", "status": 0} 2026-07-13T05:03:50Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "88eabdc3-b448-4470-ad39-9d640003ae7f"} 2026-07-13T05:03:54Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:54Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "863ee63a-1f04-406a-90bd-f697332ca45c"} 2026-07-13T05:03:54Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "863ee63a-1f04-406a-90bd-f697332ca45c"} 2026-07-13T05:03:54Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "863ee63a-1f04-406a-90bd-f697332ca45c"} 2026-07-13T05:03:54Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "863ee63a-1f04-406a-90bd-f697332ca45c"} 2026-07-13T05:03:54Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "863ee63a-1f04-406a-90bd-f697332ca45c"} 2026-07-13T05:03:54Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "863ee63a-1f04-406a-90bd-f697332ca45c"} 2026-07-13T05:03:54Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "863ee63a-1f04-406a-90bd-f697332ca45c", "status": 0} 2026-07-13T05:03:54Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "863ee63a-1f04-406a-90bd-f697332ca45c"} 2026-07-13T05:03:54Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:54Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:54Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "d50222cb-dc12-4b1d-9dad-d27d7666a0b2"} 2026-07-13T05:03:54Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:54Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "d50222cb-dc12-4b1d-9dad-d27d7666a0b2"} 2026-07-13T05:03:54Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "d50222cb-dc12-4b1d-9dad-d27d7666a0b2"} 2026-07-13T05:03:54Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "d50222cb-dc12-4b1d-9dad-d27d7666a0b2"} 2026-07-13T05:03:54Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "d50222cb-dc12-4b1d-9dad-d27d7666a0b2"} 2026-07-13T05:03:54Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "d50222cb-dc12-4b1d-9dad-d27d7666a0b2"} 2026-07-13T05:03:54Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "d50222cb-dc12-4b1d-9dad-d27d7666a0b2", "status": 0} 2026-07-13T05:03:54Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "d50222cb-dc12-4b1d-9dad-d27d7666a0b2"} 2026-07-13T05:03:55Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:55Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "b02b9da8-814a-4c83-8d54-bdb44be788fd"} 2026-07-13T05:03:55Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "b02b9da8-814a-4c83-8d54-bdb44be788fd"} 2026-07-13T05:03:55Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "b02b9da8-814a-4c83-8d54-bdb44be788fd"} 2026-07-13T05:03:55Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "b02b9da8-814a-4c83-8d54-bdb44be788fd"} 2026-07-13T05:03:55Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "b02b9da8-814a-4c83-8d54-bdb44be788fd"} 2026-07-13T05:03:55Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "b02b9da8-814a-4c83-8d54-bdb44be788fd"} 2026-07-13T05:03:55Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "b02b9da8-814a-4c83-8d54-bdb44be788fd", "status": 0} 2026-07-13T05:03:56Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "b02b9da8-814a-4c83-8d54-bdb44be788fd"} 2026-07-13T05:03:57Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:57Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "56af8d11-ef5a-4128-9935-a53d1062c39c"} 2026-07-13T05:03:57Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "56af8d11-ef5a-4128-9935-a53d1062c39c"} 2026-07-13T05:03:57Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "56af8d11-ef5a-4128-9935-a53d1062c39c"} 2026-07-13T05:03:57Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "56af8d11-ef5a-4128-9935-a53d1062c39c"} 2026-07-13T05:03:57Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "56af8d11-ef5a-4128-9935-a53d1062c39c"} 2026-07-13T05:03:57Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "56af8d11-ef5a-4128-9935-a53d1062c39c"} 2026-07-13T05:03:57Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "56af8d11-ef5a-4128-9935-a53d1062c39c", "status": 0} 2026-07-13T05:03:57Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "56af8d11-ef5a-4128-9935-a53d1062c39c"} 2026-07-13T05:03:58Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:58Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "fb13c36d-793c-4457-9728-5f97e0c389c5"} 2026-07-13T05:03:58Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "fb13c36d-793c-4457-9728-5f97e0c389c5"} 2026-07-13T05:03:58Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "fb13c36d-793c-4457-9728-5f97e0c389c5"} 2026-07-13T05:03:58Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "fb13c36d-793c-4457-9728-5f97e0c389c5"} 2026-07-13T05:03:58Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "fb13c36d-793c-4457-9728-5f97e0c389c5"} 2026-07-13T05:03:58Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "fb13c36d-793c-4457-9728-5f97e0c389c5"} 2026-07-13T05:03:58Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "fb13c36d-793c-4457-9728-5f97e0c389c5", "status": 0} 2026-07-13T05:03:58Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "fb13c36d-793c-4457-9728-5f97e0c389c5"} 2026-07-13T05:03:59Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:59Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "c59cfdc4-9c4d-4b1f-8e43-69d6f82b8b1c"} 2026-07-13T05:03:59Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "c59cfdc4-9c4d-4b1f-8e43-69d6f82b8b1c"} 2026-07-13T05:03:59Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "c59cfdc4-9c4d-4b1f-8e43-69d6f82b8b1c"} 2026-07-13T05:03:59Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "c59cfdc4-9c4d-4b1f-8e43-69d6f82b8b1c"} 2026-07-13T05:03:59Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "c59cfdc4-9c4d-4b1f-8e43-69d6f82b8b1c"} 2026-07-13T05:03:59Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "c59cfdc4-9c4d-4b1f-8e43-69d6f82b8b1c"} 2026-07-13T05:03:59Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "c59cfdc4-9c4d-4b1f-8e43-69d6f82b8b1c", "status": 0} 2026-07-13T05:03:59Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "c59cfdc4-9c4d-4b1f-8e43-69d6f82b8b1c"} 2026-07-13T05:03:59Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:03:59Z INFO Creating or updating postgres database {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "1cab65d3-17cd-4a71-a24b-89af86ec6e21"} 2026-07-13T05:03:59Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:59Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:03:59Z INFO Creating or updating postgres PVC {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "1cab65d3-17cd-4a71-a24b-89af86ec6e21"} 2026-07-13T05:03:59Z INFO Creating or updating postgres deployment {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "1cab65d3-17cd-4a71-a24b-89af86ec6e21"} 2026-07-13T05:03:59Z INFO Creating or updating postgres service {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "1cab65d3-17cd-4a71-a24b-89af86ec6e21"} 2026-07-13T05:03:59Z INFO Creating or updating postgres NetworkPolicy {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "1cab65d3-17cd-4a71-a24b-89af86ec6e21"} 2026-07-13T05:03:59Z INFO Updating spec in memory with postgres details {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "1cab65d3-17cd-4a71-a24b-89af86ec6e21"} 2026-07-13T05:03:59Z INFO service reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "1cab65d3-17cd-4a71-a24b-89af86ec6e21", "status": 0} 2026-07-13T05:03:59Z INFO status reconciled {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "1cab65d3-17cd-4a71-a24b-89af86ec6e21"} 2026-07-13T05:04:32Z INFO Performing Finalizer Operations for modelRegistry before delete CR {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "cd0dfa9d-54e1-48a8-98a8-a9e585073bd1"} 2026-07-13T05:04:32Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:04:32Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:04:32Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:04:32Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:04:32Z DEBUG events Event occurred {"object": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "kind": "ModelRegistry", "apiVersion": "modelregistry.opendatahub.io/v1beta1", "type": "Warning", "reason": "Deleting", "action": "Deleting", "note": "Custom Resource default-db-registry-1783918867047 is being deleted from the namespace rhoai-model-registries"} 2026-07-13T05:04:32Z INFO Removing Finalizer for modelRegistry after successfully perform the operations {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "cd0dfa9d-54e1-48a8-98a8-a9e585073bd1"} 2026-07-13T05:04:32Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:04:32Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:04:32Z INFO admission default {"object": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:model-registry-operator-controller-manager", "requestID": "3bbabc78-4cd6-4410-b269-63cff7ea21af", "name": "default-db-registry-1783918867047"} 2026-07-13T05:04:32Z INFO modelregistry-resource default {"name": "default-db-registry-1783918867047", "status.specDefaults": "{\"kubeRBACProxy\":{\"domain\":\"apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com\",\"image\":\"registry.redhat.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:1e614e46799fd020ac18d95c06a463421154ce86e59ccb3fa6007e66fed9910e\",\"tlsCertificateSecret\":{\"key\":\"tls.crt\",\"name\":\"default-db-registry-1783918867047-kube-rbac-proxy\"},\"tlsKeySecret\":{\"key\":\"tls.key\",\"name\":\"default-db-registry-1783918867047-kube-rbac-proxy\"}},\"postgres\":{\"database\":\"model_registry\",\"generateDeployment\":null,\"host\":\"default-db-registry-1783918867047-postgres\",\"passwordSecret\":{\"key\":\"password\",\"name\":\"default-db-registry-1783918867047-postgres-credentials\"},\"sslMode\":null,\"username\":\"modelregistry\"},\"rest\":{\"image\":\"registry.redhat.io/rhoai/odh-model-registry-rhel9@sha256:5edad515e70c884b93b1b8cc30a4a17f63f47a36a23808f19b2e8fa28a97a0a2\",\"resources\":{\"limits\":{\"memory\":\"256Mi\"},\"requests\":{\"cpu\":\"100m\",\"memory\":\"256Mi\"}}}}"} 2026-07-13T05:04:32Z INFO admission validate update {"object": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:model-registry-operator-controller-manager", "requestID": "dada3554-23e6-43ac-b544-fcc4d9ec1221", "name": "default-db-registry-1783918867047"} 2026-07-13T05:04:32Z INFO modelregistry-resource runtime defaults {"name": "default-db-registry-1783918867047"} 2026-07-13T05:04:32Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:04:32Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "18bbf23a-ea16-44ec-89c4-98b41134c296"} 2026-07-13T05:04:32Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/default-db-registry-1783918867047"} 2026-07-13T05:04:32Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "aa644733-09f2-4159-8906-acc91cfad3f2"} 2026-07-13T05:04:32Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "4ab9ddf3-e7db-4995-9a8a-31ba11ebd4a3"} 2026-07-13T05:04:32Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "c3163789-34c4-45cf-be43-ab09f8125e82"} 2026-07-13T05:04:32Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "65f7fa2d-afe7-48d0-82cc-e09c589c119c"} 2026-07-13T05:04:32Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "380f0364-5598-4c99-8eee-96dcecd9587c"} 2026-07-13T05:04:32Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "01df5b26-c65d-4172-89dc-28dd3a964463"} 2026-07-13T05:04:32Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "78b393c1-2688-41ee-8d55-083df24bff0e"} 2026-07-13T05:04:32Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "9a82603b-863a-4401-b3f8-92059bad1bd0"} 2026-07-13T05:04:32Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"default-db-registry-1783918867047","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "default-db-registry-1783918867047", "reconcileID": "e302baf9-1075-4ad3-a16c-55e0900dbe29"} 2026-07-13T05:06:16Z INFO Performing Finalizer Operations for modelRegistry before delete CR {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "9a1fc6f6-4fca-4f6b-ba7a-0bb3ab11e7ca"} 2026-07-13T05:06:16Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-13T05:06:16Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-13T05:06:16Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-13T05:06:16Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-13T05:06:16Z DEBUG events Event occurred {"object": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "kind": "ModelRegistry", "apiVersion": "modelregistry.opendatahub.io/v1beta1", "type": "Warning", "reason": "Deleting", "action": "Deleting", "note": "Custom Resource test-model-registry-662874 is being deleted from the namespace rhoai-model-registries"} 2026-07-13T05:06:16Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-13T05:06:16Z INFO Removing Finalizer for modelRegistry after successfully perform the operations {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "9a1fc6f6-4fca-4f6b-ba7a-0bb3ab11e7ca"} 2026-07-13T05:06:16Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-13T05:06:16Z INFO admission default {"object": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:model-registry-operator-controller-manager", "requestID": "64d0e8db-0b6f-4e10-893e-9767899fb1c7", "name": "test-model-registry-662874"} 2026-07-13T05:06:16Z INFO modelregistry-resource default {"name": "test-model-registry-662874", "status.specDefaults": "{\"kubeRBACProxy\":{\"domain\":\"apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com\",\"image\":\"registry.redhat.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:1e614e46799fd020ac18d95c06a463421154ce86e59ccb3fa6007e66fed9910e\",\"tlsCertificateSecret\":{\"key\":\"tls.crt\",\"name\":\"test-model-registry-662874-kube-rbac-proxy\"},\"tlsKeySecret\":{\"key\":\"tls.key\",\"name\":\"test-model-registry-662874-kube-rbac-proxy\"}},\"rest\":{\"image\":\"registry.redhat.io/rhoai/odh-model-registry-rhel9@sha256:5edad515e70c884b93b1b8cc30a4a17f63f47a36a23808f19b2e8fa28a97a0a2\",\"resources\":{\"limits\":{\"memory\":\"256Mi\"},\"requests\":{\"cpu\":\"100m\",\"memory\":\"256Mi\"}}}}"} 2026-07-13T05:06:16Z INFO admission validate update {"object": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "resource": {"group":"modelregistry.opendatahub.io","version":"v1beta1","resource":"modelregistries"}, "user": "system:serviceaccount:redhat-ods-applications:model-registry-operator-controller-manager", "requestID": "e1ccc5b1-b6e2-433a-b4c3-1b5745347e9c", "name": "test-model-registry-662874"} 2026-07-13T05:06:16Z INFO modelregistry-resource runtime defaults {"name": "test-model-registry-662874"} 2026-07-13T05:06:16Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-13T05:06:16Z INFO conversion converting ModelRegistry from hub v1beta1 to spoke v1alpha1 {"source": "rhoai-model-registries/test-model-registry-662874"} 2026-07-13T05:06:16Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "24d4ac4c-a8f0-425a-be18-7d9518860992"} 2026-07-13T05:06:16Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "b2f22b72-88fc-4cfc-98c0-4f2b99991a26"} 2026-07-13T05:06:16Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "3b1f4e15-9b57-4417-b122-a4a20d041b5c"} 2026-07-13T05:06:16Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "12851643-192b-4b88-8f64-6c4c03c65d5e"} 2026-07-13T05:06:16Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "56d23bb6-0f6c-4a50-a2d5-cfd3a80132a5"} 2026-07-13T05:06:16Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "e68e67e2-9881-4f38-b624-41e1c857fa9b"} 2026-07-13T05:06:16Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "cd054b47-fd19-48d8-ac50-8399d00fe4e8"} 2026-07-13T05:06:17Z INFO modelregistry resource not found. Ignoring since object must be deleted {"controller": "modelregistry", "controllerGroup": "modelregistry.opendatahub.io", "controllerKind": "ModelRegistry", "ModelRegistry": {"name":"test-model-registry-662874","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "test-model-registry-662874", "reconcileID": "0e76e216-9829-4743-be5b-3d08b52472c4"} 2026-07-13T05:11:00Z INFO controller-runtime.cache Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice ==================== WORKLOAD POD LOG: redhat-ods-applications/model-serving-api-6688cd56bd-k8tq7.log ==================== ==================== WORKLOAD POD LOG: redhat-ods-applications/notebook-controller-deployment-5696676547-9lcqv.log ==================== 2026-07-13T05:00:17Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:17Z INFO controllers.Notebook Creating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:17Z INFO controllers.Notebook Creating Service {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:17Z INFO controllers.Notebook No Pods are currently running for Notebook Server: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser in namespace: rhods-notebooks. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:17Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:17Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:17Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:00:17Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:17Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:17Z INFO controllers.Notebook No Pods are currently running for Notebook Server: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser in namespace: rhods-notebooks. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:17Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:17Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:17Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:00:17Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "86a1ef91-0a9f-4adb-bef9-2504e9eddb43", "error": "Operation cannot be fulfilled on notebooks.kubeflow.org \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\": the object has been modified; please apply your changes to the latest version and try again"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:00:17Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:17Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:17Z INFO controllers.Notebook No Pods are currently running for Notebook Server: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser in namespace: rhods-notebooks. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:17Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:17Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:17Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:00:17Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:17Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:17Z INFO controllers.Notebook No Pods are currently running for Notebook Server: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser in namespace: rhods-notebooks. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:17Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:17Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:17Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:00:18Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:18Z INFO controllers.Notebook No Pods are currently running for Notebook Server: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser in namespace: rhods-notebooks. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:00:18Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:18Z INFO controllers.Notebook No Pods are currently running for Notebook Server: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser in namespace: rhods-notebooks. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:00:18Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:18Z INFO controllers.Notebook No Pods are currently running for Notebook Server: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser in namespace: rhods-notebooks. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:00:18Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:18Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z ERROR controllers.Notebook Could not find container with the same name as Notebook in containerStates of Pod. Will not update notebook's status.containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.createNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:358 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.updateNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:305 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:254 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:00:18Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:00:18Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser.18c1c0b6af55d5bc","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser.18c1c0b6af55d5bc","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser.18c1c0b6af55d5bc","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser.18c1c0b6af55d5bc rhods-notebooks 10fb8354-8d6f-4819-b817-b48a65b48b5f 213437266 0 2026-07-13 05:00:18 +0000 UTC map[] map[] [] [] [{kube-controller-manager Update v1 2026-07-13 05:00:18 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:StatefulSet,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser,UID:69e41d5c-57b3-441c-a1d1-5498f224a72c,APIVersion:apps/v1,ResourceVersion:213437263,FieldPath:,},Reason:SuccessfulCreate,Message:create Pod jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0 in StatefulSet jupyter-nb-htpasswd-2dcluster-2dadmin-2duser successful,Source:EventSource{Component:statefulset-controller,Host:,},FirstTimestamp:2026-07-13 05:00:18 +0000 UTC,LastTimestamp:2026-07-13 05:00:18 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:statefulset-controller,ReportingInstance:,}"} 2026-07-13T05:00:18Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z DEBUG events Reissued from statefulset/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser: create Pod jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0 in StatefulSet jupyter-nb-htpasswd-2dcluster-2dadmin-2duser successful {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"20a72e69-c816-49c9-a650-b9ce45586736","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213437262"}, "reason": "SuccessfulCreate"} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:18Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z ERROR controllers.Notebook Could not find container with the same name as Notebook in containerStates of Pod. Will not update notebook's status.containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.createNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:358 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.updateNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:305 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:254 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:00:18Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:00:18Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b6b03e26df","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b6b03e26df","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b6b03e26df","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b6b03e26df rhods-notebooks aa384db5-d38a-4e51-b257-e95c52314cda 213437269 0 2026-07-13 05:00:18 +0000 UTC map[] map[] [] [] [{kube-scheduler Update events.k8s.io/v1 2026-07-13 05:00:18 +0000 UTC FieldsV1 {\"f:action\":{},\"f:eventTime\":{},\"f:note\":{},\"f:reason\":{},\"f:regarding\":{},\"f:reportingController\":{},\"f:reportingInstance\":{},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:674754b3-7073-4cb7-a03b-a8f53759cf23,APIVersion:v1,ResourceVersion:213437264,FieldPath:,},Reason:Scheduled,Message:Successfully assigned rhods-notebooks/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0 to ip-10-0-1-132.us-east-2.compute.internal,Source:EventSource{Component:,Host:,},FirstTimestamp:0001-01-01 00:00:00 +0000 UTC,LastTimestamp:0001-01-01 00:00:00 +0000 UTC,Count:0,Type:Normal,EventTime:2026-07-13 05:00:18.288861 +0000 UTC,Series:nil,Action:Binding,Related:nil,ReportingController:default-scheduler,ReportingInstance:default-scheduler-kube-scheduler-5c68c9c546-8jt75,}"} 2026-07-13T05:00:18Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:18Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Successfully assigned rhods-notebooks/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0 to ip-10-0-1-132.us-east-2.compute.internal {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"20a72e69-c816-49c9-a650-b9ce45586736","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213437262"}, "reason": "Scheduled"} 2026-07-13T05:00:18Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"waiting":{"reason":"ContainerCreating"}}} 2026-07-13T05:00:18Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"False","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":0,"containerState":{"waiting":{"reason":"ContainerCreating"}}}} 2026-07-13T05:00:18Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "4d6a3b34-d9c7-46b3-924b-9a992b27d3d5", "error": "Operation cannot be fulfilled on notebooks.kubeflow.org \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\": the object has been modified; please apply your changes to the latest version and try again"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:00:18Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:18Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"waiting":{"reason":"ContainerCreating"}}} 2026-07-13T05:00:18Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"False","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":0,"containerState":{"waiting":{"reason":"ContainerCreating"}}}} 2026-07-13T05:00:18Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:18Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"waiting":{"reason":"ContainerCreating"}}} 2026-07-13T05:00:18Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"False","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":0,"containerState":{"waiting":{"reason":"ContainerCreating"}}}} 2026-07-13T05:00:18Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b6be7c3e5c","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b6be7c3e5c","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b6be7c3e5c","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b6be7c3e5c rhods-notebooks 3fa3fe5a-6490-4473-a380-fff9bf193cac 213437285 0 2026-07-13 05:00:18 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:00:18 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:674754b3-7073-4cb7-a03b-a8f53759cf23,APIVersion:v1,ResourceVersion:213437267,FieldPath:,},Reason:FailedMount,Message:MountVolume.SetUp failed for volume \"kube-rbac-proxy-tls-certificates\" : secret \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-kube-rbac-proxy-tls\" not found,Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:00:18 +0000 UTC,LastTimestamp:2026-07-13 05:00:18 +0000 UTC,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:00:18Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: MountVolume.SetUp failed for volume "kube-rbac-proxy-tls-certificates" : secret "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-kube-rbac-proxy-tls" not found {"type": "Warning", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"20a72e69-c816-49c9-a650-b9ce45586736","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213437282"}, "reason": "FailedMount"} 2026-07-13T05:00:18Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:18Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"waiting":{"reason":"ContainerCreating"}}} 2026-07-13T05:00:18Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:18Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"False","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:18Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":0,"containerState":{"waiting":{"reason":"ContainerCreating"}}}} 2026-07-13T05:00:20Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b73bfe93da","namespace":"rhods-notebooks"}} 2026-07-13T05:00:20Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b73bfe93da","namespace":"rhods-notebooks"}} 2026-07-13T05:00:20Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b73bfe93da","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b73bfe93da rhods-notebooks fc1ed21f-ed52-4f22-8ba3-fdf5aca456e0 213437327 0 2026-07-13 05:00:20 +0000 UTC map[] map[] [] [] [{kube-controller-manager Update v1 2026-07-13 05:00:20 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:674754b3-7073-4cb7-a03b-a8f53759cf23,APIVersion:v1,ResourceVersion:213437267,FieldPath:,},Reason:SuccessfulAttachVolume,Message:AttachVolume.Attach succeeded for volume \"pvc-dcd84cb9-4197-48d3-b3ed-92090a01fee2\" ,Source:EventSource{Component:attachdetach-controller,Host:,},FirstTimestamp:2026-07-13 05:00:20 +0000 UTC,LastTimestamp:2026-07-13 05:00:20 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:attachdetach-controller,ReportingInstance:,}"} 2026-07-13T05:00:20Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: AttachVolume.Attach succeeded for volume "pvc-dcd84cb9-4197-48d3-b3ed-92090a01fee2" {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"20a72e69-c816-49c9-a650-b9ce45586736","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213437282"}, "reason": "SuccessfulAttachVolume"} 2026-07-13T05:00:25Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b87397b624","namespace":"rhods-notebooks"}} 2026-07-13T05:00:25Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b87397b624","namespace":"rhods-notebooks"}} 2026-07-13T05:00:25Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b87397b624","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b87397b624 rhods-notebooks 61a1df4a-b539-42b9-83f2-4c8842c1b1b4 213437500 0 2026-07-13 05:00:25 +0000 UTC map[] map[] [] [] [{multus-daemon Update v1 2026-07-13 05:00:25 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:674754b3-7073-4cb7-a03b-a8f53759cf23,APIVersion:v1,ResourceVersion:213437274,FieldPath:,},Reason:AddedInterface,Message:Add eth0 [10.129.71.131/23] from ovn-kubernetes,Source:EventSource{Component:multus,Host:,},FirstTimestamp:2026-07-13 05:00:25 +0000 UTC,LastTimestamp:2026-07-13 05:00:25 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:multus,ReportingInstance:,}"} 2026-07-13T05:00:25Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Add eth0 [10.129.71.131/23] from ovn-kubernetes {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"20a72e69-c816-49c9-a650-b9ce45586736","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213437282"}, "reason": "AddedInterface"} 2026-07-13T05:00:25Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:25Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:25Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:25Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:25Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"waiting":{"reason":"ContainerCreating"}}} 2026-07-13T05:00:25Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:25Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"False","lastProbeTime":"2026-07-13T05:00:25Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:25Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:00:25Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:00:25Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:25Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":0,"containerState":{"waiting":{"reason":"ContainerCreating"}}}} 2026-07-13T05:00:25Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b875b278c8","namespace":"rhods-notebooks"}} 2026-07-13T05:00:25Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b875b278c8","namespace":"rhods-notebooks"}} 2026-07-13T05:00:25Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b875b278c8","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b875b278c8 rhods-notebooks f311f2b4-f136-494c-a3de-a22e0e81c867 213437503 0 2026-07-13 05:00:25 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:00:25 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:674754b3-7073-4cb7-a03b-a8f53759cf23,APIVersion:v1,ResourceVersion:213437267,FieldPath:spec.containers{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser},},Reason:Pulling,Message:Pulling image \"image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/code-server-notebook:3.5\",Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:00:25 +0000 UTC,LastTimestamp:2026-07-13 05:00:25 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:00:25Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Pulling image "image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/code-server-notebook:3.5" {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"20a72e69-c816-49c9-a650-b9ce45586736","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213437282"}, "reason": "Pulling"} 2026-07-13T05:00:25Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:25Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:25Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:25Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:25Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"waiting":{"reason":"ContainerCreating"}}} 2026-07-13T05:00:25Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:25Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"False","lastProbeTime":"2026-07-13T05:00:25Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:25Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:00:25Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:00:25Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:25Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":0,"containerState":{"waiting":{"reason":"ContainerCreating"}}}} 2026-07-13T05:00:26Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b887baa90f","namespace":"rhods-notebooks"}} 2026-07-13T05:00:26Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b887baa90f","namespace":"rhods-notebooks"}} 2026-07-13T05:00:26Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b887baa90f","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b887baa90f rhods-notebooks 572ec2f1-b8fe-4d3a-87cd-07dce35c852f 213437510 0 2026-07-13 05:00:26 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:00:26 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:674754b3-7073-4cb7-a03b-a8f53759cf23,APIVersion:v1,ResourceVersion:213437267,FieldPath:spec.containers{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser},},Reason:Pulled,Message:Successfully pulled image \"image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/code-server-notebook:3.5\" in 302ms (302ms including waiting). Image size: 4164572550 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:00:26 +0000 UTC,LastTimestamp:2026-07-13 05:00:26 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:00:26Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Successfully pulled image "image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/code-server-notebook:3.5" in 302ms (302ms including waiting). Image size: 4164572550 bytes. {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"20a72e69-c816-49c9-a650-b9ce45586736","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213437504"}, "reason": "Pulled"} 2026-07-13T05:00:26Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b88ce1729e","namespace":"rhods-notebooks"}} 2026-07-13T05:00:26Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b88ce1729e","namespace":"rhods-notebooks"}} 2026-07-13T05:00:26Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b88ce1729e","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b88ce1729e rhods-notebooks e569bbd4-c79d-4fda-8546-9278b1ec6a94 213437512 0 2026-07-13 05:00:26 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:00:26 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:674754b3-7073-4cb7-a03b-a8f53759cf23,APIVersion:v1,ResourceVersion:213437267,FieldPath:spec.containers{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser},},Reason:Created,Message:Created container: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser,Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:00:26 +0000 UTC,LastTimestamp:2026-07-13 05:00:26 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:00:26Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Created container: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"20a72e69-c816-49c9-a650-b9ce45586736","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213437504"}, "reason": "Created"} 2026-07-13T05:00:26Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b88d6549d5","namespace":"rhods-notebooks"}} 2026-07-13T05:00:26Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b88d6549d5","namespace":"rhods-notebooks"}} 2026-07-13T05:00:26Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b88d6549d5","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b88d6549d5 rhods-notebooks bd33efd3-6234-4ce0-8276-611f83141b3c 213437514 0 2026-07-13 05:00:26 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:00:26 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:674754b3-7073-4cb7-a03b-a8f53759cf23,APIVersion:v1,ResourceVersion:213437267,FieldPath:spec.containers{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser},},Reason:Started,Message:Started container jupyter-nb-htpasswd-2dcluster-2dadmin-2duser,Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:00:26 +0000 UTC,LastTimestamp:2026-07-13 05:00:26 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:00:26Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Started container jupyter-nb-htpasswd-2dcluster-2dadmin-2duser {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"20a72e69-c816-49c9-a650-b9ce45586736","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213437504"}, "reason": "Started"} 2026-07-13T05:00:26Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b88d800378","namespace":"rhods-notebooks"}} 2026-07-13T05:00:26Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b88d800378","namespace":"rhods-notebooks"}} 2026-07-13T05:00:26Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b88d800378","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b88d800378 rhods-notebooks 85f0aeec-3c04-4895-bfa6-e3c15c804e32 213437515 0 2026-07-13 05:00:26 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:00:26 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:674754b3-7073-4cb7-a03b-a8f53759cf23,APIVersion:v1,ResourceVersion:213437267,FieldPath:spec.containers{kube-rbac-proxy},},Reason:Pulling,Message:Pulling image \"quay.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:1e614e46799fd020ac18d95c06a463421154ce86e59ccb3fa6007e66fed9910e\",Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:00:26 +0000 UTC,LastTimestamp:2026-07-13 05:00:26 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:00:26Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Pulling image "quay.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:1e614e46799fd020ac18d95c06a463421154ce86e59ccb3fa6007e66fed9910e" {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"20a72e69-c816-49c9-a650-b9ce45586736","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213437504"}, "reason": "Pulling"} 2026-07-13T05:00:26Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b8aecac009","namespace":"rhods-notebooks"}} 2026-07-13T05:00:26Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b8aecac009","namespace":"rhods-notebooks"}} 2026-07-13T05:00:26Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b8aecac009","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b8aecac009 rhods-notebooks d65dab50-66ac-432b-ad88-2e4f9a53925f 213437527 0 2026-07-13 05:00:26 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:00:26 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:674754b3-7073-4cb7-a03b-a8f53759cf23,APIVersion:v1,ResourceVersion:213437267,FieldPath:spec.containers{kube-rbac-proxy},},Reason:Pulled,Message:Successfully pulled image \"quay.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:1e614e46799fd020ac18d95c06a463421154ce86e59ccb3fa6007e66fed9910e\" in 558ms (558ms including waiting). Image size: 184260462 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:00:26 +0000 UTC,LastTimestamp:2026-07-13 05:00:26 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:00:26Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Successfully pulled image "quay.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:1e614e46799fd020ac18d95c06a463421154ce86e59ccb3fa6007e66fed9910e" in 558ms (558ms including waiting). Image size: 184260462 bytes. {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"20a72e69-c816-49c9-a650-b9ce45586736","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213437504"}, "reason": "Pulled"} 2026-07-13T05:00:26Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b8b473eab7","namespace":"rhods-notebooks"}} 2026-07-13T05:00:26Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b8b473eab7","namespace":"rhods-notebooks"}} 2026-07-13T05:00:26Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b8b473eab7","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b8b473eab7 rhods-notebooks adfc3011-0471-4362-b38f-bef9982a00bd 213437530 0 2026-07-13 05:00:26 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:00:26 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:674754b3-7073-4cb7-a03b-a8f53759cf23,APIVersion:v1,ResourceVersion:213437267,FieldPath:spec.containers{kube-rbac-proxy},},Reason:Created,Message:Created container: kube-rbac-proxy,Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:00:26 +0000 UTC,LastTimestamp:2026-07-13 05:00:26 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:00:26Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Created container: kube-rbac-proxy {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"20a72e69-c816-49c9-a650-b9ce45586736","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213437504"}, "reason": "Created"} 2026-07-13T05:00:26Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b8b4fd47ed","namespace":"rhods-notebooks"}} 2026-07-13T05:00:26Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b8b4fd47ed","namespace":"rhods-notebooks"}} 2026-07-13T05:00:26Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b8b4fd47ed","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0b8b4fd47ed rhods-notebooks d0cc8d57-3f52-4738-86a7-7be426773132 213437532 0 2026-07-13 05:00:26 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:00:26 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:674754b3-7073-4cb7-a03b-a8f53759cf23,APIVersion:v1,ResourceVersion:213437267,FieldPath:spec.containers{kube-rbac-proxy},},Reason:Started,Message:Started container kube-rbac-proxy,Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:00:26 +0000 UTC,LastTimestamp:2026-07-13 05:00:26 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:00:26Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Started container kube-rbac-proxy {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"20a72e69-c816-49c9-a650-b9ce45586736","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213437504"}, "reason": "Started"} 2026-07-13T05:00:27Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:27Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:27Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:27Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:27Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:00:26Z"}}} 2026-07-13T05:00:27Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:27Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:00:27Z","lastTransitionTime":"2026-07-13T05:00:27Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:27Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:00:27Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:00:27Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:27Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":0,"containerState":{"running":{"startedAt":"2026-07-13T05:00:26Z"}}}} 2026-07-13T05:00:27Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:27Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:27Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:27Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:27Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:00:26Z"}}} 2026-07-13T05:00:27Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:27Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:00:27Z","lastTransitionTime":"2026-07-13T05:00:27Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:27Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:00:27Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:00:27Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:27Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":0,"containerState":{"running":{"startedAt":"2026-07-13T05:00:26Z"}}}} 2026-07-13T05:00:33Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:33Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:33Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:33Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:33Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:00:26Z"}}} 2026-07-13T05:00:33Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:33Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:00:33Z","lastTransitionTime":"2026-07-13T05:00:27Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:33Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:00:33Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser]"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:00:33Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser]"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:33Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":0,"containerState":{"running":{"startedAt":"2026-07-13T05:00:26Z"}}}} 2026-07-13T05:00:33Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:33Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:33Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:33Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:33Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:00:26Z"}}} 2026-07-13T05:00:33Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:33Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:00:33Z","lastTransitionTime":"2026-07-13T05:00:27Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:33Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:00:33Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser]"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:00:33Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser]"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:33Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":0,"containerState":{"running":{"startedAt":"2026-07-13T05:00:26Z"}}}} 2026-07-13T05:00:38Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:38Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:38Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:38Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:38Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:00:26Z"}}} 2026-07-13T05:00:38Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:38Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:00:38Z","lastTransitionTime":"2026-07-13T05:00:27Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:38Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Ready","status":"True","lastProbeTime":"2026-07-13T05:00:38Z","lastTransitionTime":"2026-07-13T05:00:38Z"},{"type":"ContainersReady","status":"True","lastProbeTime":"2026-07-13T05:00:38Z","lastTransitionTime":"2026-07-13T05:00:38Z"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:38Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":0,"containerState":{"running":{"startedAt":"2026-07-13T05:00:26Z"}}}} 2026-07-13T05:00:38Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:38Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:38Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:38Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:38Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:00:26Z"}}} 2026-07-13T05:00:38Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:38Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:00:38Z","lastTransitionTime":"2026-07-13T05:00:27Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:38Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Ready","status":"True","lastProbeTime":"2026-07-13T05:00:38Z","lastTransitionTime":"2026-07-13T05:00:38Z"},{"type":"ContainersReady","status":"True","lastProbeTime":"2026-07-13T05:00:38Z","lastTransitionTime":"2026-07-13T05:00:38Z"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:38Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":1,"containerState":{"running":{"startedAt":"2026-07-13T05:00:26Z"}}}} 2026-07-13T05:00:38Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:38Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:38Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:38Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:38Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:00:26Z"}}} 2026-07-13T05:00:38Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:38Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:00:38Z","lastTransitionTime":"2026-07-13T05:00:27Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:38Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Ready","status":"True","lastProbeTime":"2026-07-13T05:00:38Z","lastTransitionTime":"2026-07-13T05:00:38Z"},{"type":"ContainersReady","status":"True","lastProbeTime":"2026-07-13T05:00:38Z","lastTransitionTime":"2026-07-13T05:00:38Z"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:38Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":1,"containerState":{"running":{"startedAt":"2026-07-13T05:00:26Z"}}}} 2026-07-13T05:00:38Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "3d001bf8-862c-4074-9d46-9e06849a2188", "error": "Operation cannot be fulfilled on notebooks.kubeflow.org \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\": the object has been modified; please apply your changes to the latest version and try again"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:00:38Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:38Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:38Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:38Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:38Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:00:26Z"}}} 2026-07-13T05:00:38Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:38Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:00:38Z","lastTransitionTime":"2026-07-13T05:00:27Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:38Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Ready","status":"True","lastProbeTime":"2026-07-13T05:00:38Z","lastTransitionTime":"2026-07-13T05:00:38Z"},{"type":"ContainersReady","status":"True","lastProbeTime":"2026-07-13T05:00:38Z","lastTransitionTime":"2026-07-13T05:00:38Z"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:38Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":1,"containerState":{"running":{"startedAt":"2026-07-13T05:00:26Z"}}}} 2026-07-13T05:00:52Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:52Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:52Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:52Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:52Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:00:26Z"}}} 2026-07-13T05:00:52Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:52Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:00:52Z","lastTransitionTime":"2026-07-13T05:00:27Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:52Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Ready","status":"True","lastProbeTime":"2026-07-13T05:00:52Z","lastTransitionTime":"2026-07-13T05:00:38Z"},{"type":"ContainersReady","status":"True","lastProbeTime":"2026-07-13T05:00:52Z","lastTransitionTime":"2026-07-13T05:00:38Z"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:52Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":1,"containerState":{"running":{"startedAt":"2026-07-13T05:00:26Z"}}}} 2026-07-13T05:00:52Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:52Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:52Z ERROR controllers.Notebook unable to update Statefulset {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "error": "Operation cannot be fulfilled on statefulsets.apps \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\": the object has been modified; please apply your changes to the latest version and try again"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:201 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:00:52Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "7cd2f878-9af9-4f05-bbc0-f6cb7ed55373", "error": "Operation cannot be fulfilled on statefulsets.apps \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\": the object has been modified; please apply your changes to the latest version and try again"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:00:52Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser.18c1c0beb6a80119","namespace":"rhods-notebooks"}} 2026-07-13T05:00:52Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser.18c1c0beb6a80119","namespace":"rhods-notebooks"}} 2026-07-13T05:00:52Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser.18c1c0beb6a80119","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser.18c1c0beb6a80119 rhods-notebooks 1c5d74a2-89c0-4d40-bd2c-515b5d3b636a 213437954 0 2026-07-13 05:00:52 +0000 UTC map[] map[] [] [] [{kube-controller-manager Update v1 2026-07-13 05:00:52 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:StatefulSet,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser,UID:69e41d5c-57b3-441c-a1d1-5498f224a72c,APIVersion:apps/v1,ResourceVersion:213437949,FieldPath:,},Reason:SuccessfulDelete,Message:delete Pod jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0 in StatefulSet jupyter-nb-htpasswd-2dcluster-2dadmin-2duser successful,Source:EventSource{Component:statefulset-controller,Host:,},FirstTimestamp:2026-07-13 05:00:52 +0000 UTC,LastTimestamp:2026-07-13 05:00:52 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:statefulset-controller,ReportingInstance:,}"} 2026-07-13T05:00:52Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:52Z DEBUG events Reissued from statefulset/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser: delete Pod jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0 in StatefulSet jupyter-nb-htpasswd-2dcluster-2dadmin-2duser successful {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"20a72e69-c816-49c9-a650-b9ce45586736","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213437952"}, "reason": "SuccessfulDelete"} 2026-07-13T05:00:52Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:52Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:52Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:52Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:00:26Z"}}} 2026-07-13T05:00:52Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:52Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:00:52Z","lastTransitionTime":"2026-07-13T05:00:27Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:52Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Ready","status":"True","lastProbeTime":"2026-07-13T05:00:52Z","lastTransitionTime":"2026-07-13T05:00:38Z"},{"type":"ContainersReady","status":"True","lastProbeTime":"2026-07-13T05:00:52Z","lastTransitionTime":"2026-07-13T05:00:38Z"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:52Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":1,"containerState":{"running":{"startedAt":"2026-07-13T05:00:26Z"}}}} 2026-07-13T05:00:52Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0beb74750b8","namespace":"rhods-notebooks"}} 2026-07-13T05:00:52Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0beb74750b8","namespace":"rhods-notebooks"}} 2026-07-13T05:00:52Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0beb74750b8","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0beb74750b8 rhods-notebooks de6dccce-3bc6-4f22-8f4a-22166dae8647 213437959 0 2026-07-13 05:00:52 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:00:52 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:674754b3-7073-4cb7-a03b-a8f53759cf23,APIVersion:v1,ResourceVersion:213437267,FieldPath:spec.containers{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser},},Reason:Killing,Message:Stopping container jupyter-nb-htpasswd-2dcluster-2dadmin-2duser,Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:00:52 +0000 UTC,LastTimestamp:2026-07-13 05:00:52 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:00:52Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Stopping container jupyter-nb-htpasswd-2dcluster-2dadmin-2duser {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"20a72e69-c816-49c9-a650-b9ce45586736","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213437952"}, "reason": "Killing"} 2026-07-13T05:00:52Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0beb747cf11","namespace":"rhods-notebooks"}} 2026-07-13T05:00:52Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0beb747cf11","namespace":"rhods-notebooks"}} 2026-07-13T05:00:52Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0beb747cf11","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0beb747cf11 rhods-notebooks b7b015b1-dd8d-432d-8474-39fd3344280d 213437960 0 2026-07-13 05:00:52 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:00:52 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:674754b3-7073-4cb7-a03b-a8f53759cf23,APIVersion:v1,ResourceVersion:213437267,FieldPath:spec.containers{kube-rbac-proxy},},Reason:Killing,Message:Stopping container kube-rbac-proxy,Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:00:52 +0000 UTC,LastTimestamp:2026-07-13 05:00:52 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:00:52Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:52Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Stopping container kube-rbac-proxy {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"20a72e69-c816-49c9-a650-b9ce45586736","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213437952"}, "reason": "Killing"} 2026-07-13T05:00:52Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:52Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:52Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:52Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:00:26Z"}}} 2026-07-13T05:00:52Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:52Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:00:52Z","lastTransitionTime":"2026-07-13T05:00:27Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:52Z","lastTransitionTime":"2026-07-13T05:00:18Z"},{"type":"Ready","status":"True","lastProbeTime":"2026-07-13T05:00:52Z","lastTransitionTime":"2026-07-13T05:00:38Z"},{"type":"ContainersReady","status":"True","lastProbeTime":"2026-07-13T05:00:52Z","lastTransitionTime":"2026-07-13T05:00:38Z"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:52Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":1,"containerState":{"running":{"startedAt":"2026-07-13T05:00:26Z"}}}} 2026-07-13T05:00:53Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:53Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2026-07-13T05:00:26Z","finishedAt":"2026-07-13T05:00:52Z","containerID":"cri-o://a77fdbb2bd6b5b8817d4756a8ce3fdd051d5a0158f18ba8229bbf29d50089af2"}}} 2026-07-13T05:00:53Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"False","lastProbeTime":"2026-07-13T05:00:53Z","lastTransitionTime":"2026-07-13T05:00:53Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:53Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"PodCompleted"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:00:53Z","lastTransitionTime":"2026-07-13T05:00:53Z","reason":"PodCompleted"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:00:53Z","lastTransitionTime":"2026-07-13T05:00:53Z","reason":"PodCompleted"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:53Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":1,"containerState":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2026-07-13T05:00:26Z","finishedAt":"2026-07-13T05:00:52Z","containerID":"cri-o://a77fdbb2bd6b5b8817d4756a8ce3fdd051d5a0158f18ba8229bbf29d50089af2"}}}} 2026-07-13T05:00:53Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:53Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2026-07-13T05:00:26Z","finishedAt":"2026-07-13T05:00:52Z","containerID":"cri-o://a77fdbb2bd6b5b8817d4756a8ce3fdd051d5a0158f18ba8229bbf29d50089af2"}}} 2026-07-13T05:00:53Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"False","lastProbeTime":"2026-07-13T05:00:53Z","lastTransitionTime":"2026-07-13T05:00:53Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:53Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"PodCompleted"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:00:53Z","lastTransitionTime":"2026-07-13T05:00:53Z","reason":"PodCompleted"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:00:53Z","lastTransitionTime":"2026-07-13T05:00:53Z","reason":"PodCompleted"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:53Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":0,"containerState":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2026-07-13T05:00:26Z","finishedAt":"2026-07-13T05:00:52Z","containerID":"cri-o://a77fdbb2bd6b5b8817d4756a8ce3fdd051d5a0158f18ba8229bbf29d50089af2"}}}} 2026-07-13T05:00:53Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "8c767f64-511c-415b-960f-05521f335bc3", "error": "Operation cannot be fulfilled on notebooks.kubeflow.org \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\": the object has been modified; please apply your changes to the latest version and try again"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:00:53Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:53Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2026-07-13T05:00:26Z","finishedAt":"2026-07-13T05:00:52Z","containerID":"cri-o://a77fdbb2bd6b5b8817d4756a8ce3fdd051d5a0158f18ba8229bbf29d50089af2"}}} 2026-07-13T05:00:53Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"False","lastProbeTime":"2026-07-13T05:00:53Z","lastTransitionTime":"2026-07-13T05:00:53Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:53Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"PodCompleted"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:00:53Z","lastTransitionTime":"2026-07-13T05:00:53Z","reason":"PodCompleted"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:00:53Z","lastTransitionTime":"2026-07-13T05:00:53Z","reason":"PodCompleted"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:53Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":0,"containerState":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2026-07-13T05:00:26Z","finishedAt":"2026-07-13T05:00:52Z","containerID":"cri-o://a77fdbb2bd6b5b8817d4756a8ce3fdd051d5a0158f18ba8229bbf29d50089af2"}}}} 2026-07-13T05:00:53Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:53Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2026-07-13T05:00:26Z","finishedAt":"2026-07-13T05:00:52Z","containerID":"cri-o://a77fdbb2bd6b5b8817d4756a8ce3fdd051d5a0158f18ba8229bbf29d50089af2"}}} 2026-07-13T05:00:53Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"False","lastProbeTime":"2026-07-13T05:00:53Z","lastTransitionTime":"2026-07-13T05:00:53Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:00:53Z","lastTransitionTime":"2026-07-13T05:00:18Z","reason":"PodCompleted"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:00:53Z","lastTransitionTime":"2026-07-13T05:00:53Z","reason":"PodCompleted"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:00:53Z","lastTransitionTime":"2026-07-13T05:00:53Z","reason":"PodCompleted"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:00:53Z","lastTransitionTime":"2026-07-13T05:00:18Z"}],"readyReplicas":0,"containerState":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2026-07-13T05:00:26Z","finishedAt":"2026-07-13T05:00:52Z","containerID":"cri-o://a77fdbb2bd6b5b8817d4756a8ce3fdd051d5a0158f18ba8229bbf29d50089af2"}}}} 2026-07-13T05:00:53Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:53Z INFO controllers.Notebook No Pods are currently running for Notebook Server: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser in namespace: rhods-notebooks. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:00:53Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:53Z INFO controllers.Notebook No Pods are currently running for Notebook Server: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser in namespace: rhods-notebooks. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:00:53Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "dee20d9f-c923-4fda-81ba-d824a2908048", "error": "Operation cannot be fulfilled on notebooks.kubeflow.org \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\": the object has been modified; please apply your changes to the latest version and try again"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:00:53Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:00:53Z INFO controllers.Notebook No Pods are currently running for Notebook Server: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser in namespace: rhods-notebooks. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:00:53Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:04:43Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:43Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:43Z ERROR controllers.Notebook unable to fetch Notebook {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "error": "Notebook.kubeflow.org \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\" not found"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:130 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:04:43Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:43Z ERROR controllers.Notebook unable to fetch Notebook {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "error": "Notebook.kubeflow.org \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\" not found"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:130 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:04:43Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:43Z ERROR controllers.Notebook unable to fetch Notebook {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "error": "Notebook.kubeflow.org \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\" not found"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:130 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:04:43Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:43Z ERROR controllers.Notebook unable to fetch Notebook {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "error": "Notebook.kubeflow.org \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\" not found"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:130 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:04:55Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:55Z INFO controllers.Notebook Creating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:04:55Z INFO controllers.Notebook Creating Service {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:04:55Z INFO controllers.Notebook No Pods are currently running for Notebook Server: wb-rwo-test in namespace: test-workbench-storage-preset-167984. {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:55Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:55Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:55Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:04:55Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:55Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:04:55Z INFO controllers.Notebook No Pods are currently running for Notebook Server: wb-rwo-test in namespace: test-workbench-storage-preset-167984. {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:55Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:55Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:55Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:04:55Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:55Z INFO controllers.Notebook Creating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:04:55Z INFO controllers.Notebook Creating Service {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:04:55Z INFO controllers.Notebook No Pods are currently running for Notebook Server: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser in namespace: rhods-notebooks. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:55Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:55Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:55Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:04:56Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:04:56Z INFO controllers.Notebook No Pods are currently running for Notebook Server: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser in namespace: rhods-notebooks. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:56Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:04:56Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:04:56Z INFO controllers.Notebook No Pods are currently running for Notebook Server: wb-rwo-test in namespace: test-workbench-storage-preset-167984. {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:04:56Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:04:56Z INFO controllers.Notebook No Pods are currently running for Notebook Server: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser in namespace: rhods-notebooks. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:56Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:04:56Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:04:56Z INFO controllers.Notebook No Pods are currently running for Notebook Server: wb-rwo-test in namespace: test-workbench-storage-preset-167984. {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:04:56Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:04:56Z INFO controllers.Notebook No Pods are currently running for Notebook Server: wb-rwo-test in namespace: test-workbench-storage-preset-167984. {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:04:56Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:04:56Z INFO controllers.Notebook No Pods are currently running for Notebook Server: wb-rwo-test in namespace: test-workbench-storage-preset-167984. {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:04:56Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:04:56Z ERROR controllers.Notebook unable to update Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "Operation cannot be fulfilled on statefulsets.apps \"wb-rwo-test\": the object has been modified; please apply your changes to the latest version and try again"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:201 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:04:56Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "fe712aab-c571-4ded-8767-4fefc08b590d", "error": "Operation cannot be fulfilled on statefulsets.apps \"wb-rwo-test\": the object has been modified; please apply your changes to the latest version and try again"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:04:56Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test-0.18c1c0f7866072ba","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"wb-rwo-test-0.18c1c0f7866072ba","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"wb-rwo-test-0.18c1c0f7866072ba","namespace":"test-workbench-storage-preset-167984"}, "Event": "&Event{ObjectMeta:{wb-rwo-test-0.18c1c0f7866072ba test-workbench-storage-preset-167984 78a3f57f-2c16-4b8a-b8b7-ada1ef56594e 213442962 0 2026-07-13 05:04:56 +0000 UTC map[] map[] [] [] [{kube-scheduler Update events.k8s.io/v1 2026-07-13 05:04:56 +0000 UTC FieldsV1 {\"f:action\":{},\"f:eventTime\":{},\"f:note\":{},\"f:reason\":{},\"f:regarding\":{},\"f:reportingController\":{},\"f:reportingInstance\":{},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:test-workbench-storage-preset-167984,Name:wb-rwo-test-0,UID:4c83c460-cc9d-48c4-9282-d58407a22fc4,APIVersion:v1,ResourceVersion:213442959,FieldPath:,},Reason:FailedScheduling,Message:0/3 nodes are available: 3 Insufficient cpu. preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.,Source:EventSource{Component:,Host:,},FirstTimestamp:0001-01-01 00:00:00 +0000 UTC,LastTimestamp:0001-01-01 00:00:00 +0000 UTC,Count:0,Type:Warning,EventTime:2026-07-13 05:04:56.759345 +0000 UTC,Series:nil,Action:Scheduling,Related:nil,ReportingController:default-scheduler,ReportingInstance:default-scheduler-kube-scheduler-5c68c9c546-8jt75,}"} 2026-07-13T05:04:56Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test.18c1c0f7865a1e40","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"wb-rwo-test.18c1c0f7865a1e40","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z DEBUG events Reissued from pod/wb-rwo-test-0: 0/3 nodes are available: 3 Insufficient cpu. preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. {"type": "Warning", "object": {"kind":"Notebook","namespace":"test-workbench-storage-preset-167984","name":"wb-rwo-test","uid":"6d0f7337-868a-4d86-b9ff-f655cd163bba","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213442952"}, "reason": "FailedScheduling"} 2026-07-13T05:04:56Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"wb-rwo-test.18c1c0f7865a1e40","namespace":"test-workbench-storage-preset-167984"}, "Event": "&Event{ObjectMeta:{wb-rwo-test.18c1c0f7865a1e40 test-workbench-storage-preset-167984 5472ddbe-a7e8-4505-ae93-c3a21cd78aa6 213442963 0 2026-07-13 05:04:56 +0000 UTC map[] map[] [] [] [{kube-controller-manager Update v1 2026-07-13 05:04:56 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:StatefulSet,Namespace:test-workbench-storage-preset-167984,Name:wb-rwo-test,UID:ba7ffbb2-6e8d-4661-8e6a-08d6ca67afbd,APIVersion:apps/v1,ResourceVersion:213442953,FieldPath:,},Reason:SuccessfulCreate,Message:create Pod wb-rwo-test-0 in StatefulSet wb-rwo-test successful,Source:EventSource{Component:statefulset-controller,Host:,},FirstTimestamp:2026-07-13 05:04:56 +0000 UTC,LastTimestamp:2026-07-13 05:04:56 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:statefulset-controller,ReportingInstance:,}"} 2026-07-13T05:04:56Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:04:56Z DEBUG events Reissued from statefulset/wb-rwo-test: create Pod wb-rwo-test-0 in StatefulSet wb-rwo-test successful {"type": "Normal", "object": {"kind":"Notebook","namespace":"test-workbench-storage-preset-167984","name":"wb-rwo-test","uid":"6d0f7337-868a-4d86-b9ff-f655cd163bba","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213442952"}, "reason": "SuccessfulCreate"} 2026-07-13T05:04:56Z ERROR controllers.Notebook unable to update Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "Operation cannot be fulfilled on statefulsets.apps \"wb-rwo-test\": the object has been modified; please apply your changes to the latest version and try again"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:201 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:04:56Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "685934cd-2efb-4e73-adc2-e04c7cf8ea00", "error": "Operation cannot be fulfilled on statefulsets.apps \"wb-rwo-test\": the object has been modified; please apply your changes to the latest version and try again"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:04:56Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:04:56Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z ERROR controllers.Notebook Could not find container with the same name as Notebook in containerStates of Pod. Will not update notebook's status.containerState {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.createNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:358 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.updateNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:305 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:254 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:04:56Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "status": {"conditions":[{"type":"PodScheduled","status":"False","lastProbeTime":"2026-07-13T05:04:56Z","lastTransitionTime":"2026-07-13T05:04:56Z","reason":"Unschedulable","message":"0/3 nodes are available: 3 Insufficient cpu. preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod."}],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:04:56Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:04:56Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z ERROR controllers.Notebook Could not find container with the same name as Notebook in containerStates of Pod. Will not update notebook's status.containerState {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.createNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:358 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.updateNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:305 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:254 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:04:56Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "status": {"conditions":[{"type":"PodScheduled","status":"False","lastProbeTime":"2026-07-13T05:04:56Z","lastTransitionTime":"2026-07-13T05:04:56Z","reason":"Unschedulable","message":"0/3 nodes are available: 3 Insufficient cpu. preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod."}],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:04:56Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:04:56Z INFO controllers.Notebook No Pods are currently running for Notebook Server: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser in namespace: rhods-notebooks. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:56Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:04:56Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:04:56Z INFO controllers.Notebook No Pods are currently running for Notebook Server: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser in namespace: rhods-notebooks. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:56Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:56Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:04:57Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:04:57Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:57Z ERROR controllers.Notebook Could not find container with the same name as Notebook in containerStates of Pod. Will not update notebook's status.containerState {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.createNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:358 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.updateNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:305 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:254 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:04:57Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "status": {"conditions":[{"type":"PodScheduled","status":"False","lastProbeTime":"2026-07-13T05:04:57Z","lastTransitionTime":"2026-07-13T05:04:56Z","reason":"Unschedulable","message":"0/3 nodes are available: 3 Insufficient cpu. preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod."}],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:04:57Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:04:57Z INFO controllers.Notebook No Pods are currently running for Notebook Server: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser in namespace: rhods-notebooks. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:04:57Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:04:57Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:57Z ERROR controllers.Notebook Could not find container with the same name as Notebook in containerStates of Pod. Will not update notebook's status.containerState {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.createNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:358 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.updateNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:305 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:254 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:04:57Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "status": {"conditions":[{"type":"PodScheduled","status":"False","lastProbeTime":"2026-07-13T05:04:57Z","lastTransitionTime":"2026-07-13T05:04:56Z","reason":"Unschedulable","message":"0/3 nodes are available: 3 Insufficient cpu. preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod."}],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:04:57Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:04:57Z INFO controllers.Notebook No Pods are currently running for Notebook Server: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser in namespace: rhods-notebooks. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:04:57Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:04:57Z ERROR controllers.Notebook unable to update Statefulset {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "error": "Operation cannot be fulfilled on statefulsets.apps \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\": the object has been modified; please apply your changes to the latest version and try again"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:201 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:04:57Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "ae0c4744-e0aa-49d0-a8fb-04f7334ae578", "error": "Operation cannot be fulfilled on statefulsets.apps \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\": the object has been modified; please apply your changes to the latest version and try again"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:04:57Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser.18c1c0f7a2d030d6","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser.18c1c0f7a2d030d6","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser.18c1c0f7a2d030d6","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser.18c1c0f7a2d030d6 rhods-notebooks 8643ad28-d593-43c3-8003-3cce56361a94 213443003 0 2026-07-13 05:04:57 +0000 UTC map[] map[] [] [] [{kube-controller-manager Update v1 2026-07-13 05:04:57 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:StatefulSet,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser,UID:62c35986-11bd-4cdc-8b22-31357ea9ca15,APIVersion:apps/v1,ResourceVersion:213442996,FieldPath:,},Reason:SuccessfulCreate,Message:create Pod jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0 in StatefulSet jupyter-nb-htpasswd-2dcluster-2dadmin-2duser successful,Source:EventSource{Component:statefulset-controller,Host:,},FirstTimestamp:2026-07-13 05:04:57 +0000 UTC,LastTimestamp:2026-07-13 05:04:57 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:statefulset-controller,ReportingInstance:,}"} 2026-07-13T05:04:57Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0f7a2b85297","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z DEBUG events Reissued from statefulset/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser: create Pod jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0 in StatefulSet jupyter-nb-htpasswd-2dcluster-2dadmin-2duser successful {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"039e42b9-cd66-44e1-8fe0-03fadc7ac76b","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213442991"}, "reason": "SuccessfulCreate"} 2026-07-13T05:04:57Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0f7a2b85297","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0f7a2b85297","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0f7a2b85297 rhods-notebooks 2bc087f7-f2ee-45ac-970c-9dfa4a49f6a9 213443005 0 2026-07-13 05:04:57 +0000 UTC map[] map[] [] [] [{kube-scheduler Update events.k8s.io/v1 2026-07-13 05:04:57 +0000 UTC FieldsV1 {\"f:action\":{},\"f:eventTime\":{},\"f:note\":{},\"f:reason\":{},\"f:regarding\":{},\"f:reportingController\":{},\"f:reportingInstance\":{},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:42c2cf57-0b43-449b-8354-1641c3c131db,APIVersion:v1,ResourceVersion:213443002,FieldPath:,},Reason:FailedScheduling,Message:0/3 nodes are available: 3 Insufficient cpu. preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.,Source:EventSource{Component:,Host:,},FirstTimestamp:0001-01-01 00:00:00 +0000 UTC,LastTimestamp:0001-01-01 00:00:00 +0000 UTC,Count:0,Type:Warning,EventTime:2026-07-13 05:04:57.234865 +0000 UTC,Series:nil,Action:Scheduling,Related:nil,ReportingController:default-scheduler,ReportingInstance:default-scheduler-kube-scheduler-5c68c9c546-8jt75,}"} 2026-07-13T05:04:57Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: 0/3 nodes are available: 3 Insufficient cpu. preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. {"type": "Warning", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"039e42b9-cd66-44e1-8fe0-03fadc7ac76b","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213442991"}, "reason": "FailedScheduling"} 2026-07-13T05:04:57Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:04:57Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z ERROR controllers.Notebook Could not find container with the same name as Notebook in containerStates of Pod. Will not update notebook's status.containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.createNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:358 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.updateNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:305 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:254 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:04:57Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodScheduled","status":"False","lastProbeTime":"2026-07-13T05:04:57Z","lastTransitionTime":"2026-07-13T05:04:57Z","reason":"Unschedulable","message":"0/3 nodes are available: 3 Insufficient cpu. preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod."}],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:04:57Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:04:57Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z ERROR controllers.Notebook Could not find container with the same name as Notebook in containerStates of Pod. Will not update notebook's status.containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.createNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:358 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.updateNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:305 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:254 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:04:57Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:04:57Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodScheduled","status":"False","lastProbeTime":"2026-07-13T05:04:57Z","lastTransitionTime":"2026-07-13T05:04:57Z","reason":"Unschedulable","message":"0/3 nodes are available: 3 Insufficient cpu. preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod."}],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:05:02Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0f8de231056","namespace":"rhods-notebooks"}} 2026-07-13T05:05:02Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0f8de231056","namespace":"rhods-notebooks"}} 2026-07-13T05:05:02Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0f8de231056","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0f8de231056 rhods-notebooks e7234768-5cad-4c70-b24e-0ee9753fb547 213443105 0 2026-07-13 05:05:02 +0000 UTC map[] map[] [] [] [{kube-scheduler Update events.k8s.io/v1 2026-07-13 05:05:02 +0000 UTC FieldsV1 {\"f:action\":{},\"f:eventTime\":{},\"f:note\":{},\"f:reason\":{},\"f:regarding\":{},\"f:reportingController\":{},\"f:reportingInstance\":{},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:42c2cf57-0b43-449b-8354-1641c3c131db,APIVersion:v1,ResourceVersion:213443007,FieldPath:,},Reason:FailedScheduling,Message:0/3 nodes are available: 3 Insufficient cpu. preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.,Source:EventSource{Component:,Host:,},FirstTimestamp:0001-01-01 00:00:00 +0000 UTC,LastTimestamp:0001-01-01 00:00:00 +0000 UTC,Count:0,Type:Warning,EventTime:2026-07-13 05:05:02.526686 +0000 UTC,Series:nil,Action:Scheduling,Related:nil,ReportingController:default-scheduler,ReportingInstance:default-scheduler-kube-scheduler-5c68c9c546-8jt75,}"} 2026-07-13T05:05:02Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: 0/3 nodes are available: 3 Insufficient cpu. preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. {"type": "Warning", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"039e42b9-cd66-44e1-8fe0-03fadc7ac76b","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213443011"}, "reason": "FailedScheduling"} 2026-07-13T05:05:20Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:20Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:20Z ERROR controllers.Notebook unable to update Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "Operation cannot be fulfilled on statefulsets.apps \"wb-rwo-test\": the object has been modified; please apply your changes to the latest version and try again"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:201 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:20Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "54f44015-408d-4594-99ed-d923feeb4b9e", "error": "Operation cannot be fulfilled on statefulsets.apps \"wb-rwo-test\": the object has been modified; please apply your changes to the latest version and try again"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:20Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:20Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:20Z ERROR controllers.Notebook unable to update Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "Operation cannot be fulfilled on statefulsets.apps \"wb-rwo-test\": the object has been modified; please apply your changes to the latest version and try again"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:201 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:20Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "5856a521-cb46-45d0-98aa-f7113b21d4c2", "error": "Operation cannot be fulfilled on statefulsets.apps \"wb-rwo-test\": the object has been modified; please apply your changes to the latest version and try again"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:20Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:20Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:20Z INFO controllers.Notebook No Pods are currently running for Notebook Server: wb-rwo-test in namespace: test-workbench-storage-preset-167984. {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:20Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:20Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:20Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:05:20Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:20Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:20Z INFO controllers.Notebook No Pods are currently running for Notebook Server: wb-rwo-test in namespace: test-workbench-storage-preset-167984. {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:20Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:20Z INFO controllers.Notebook No pod.Status found. Won't update notebook conditions and containerState {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:20Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "status": {"conditions":[],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:05:21Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:05:21Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z ERROR controllers.Notebook Could not find container with the same name as Notebook in containerStates of Pod. Will not update notebook's status.containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.createNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:358 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.updateNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:305 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:254 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:21Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:05:21Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:05:21Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0fd4c8ef630","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0fd4c8ef630","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0fd4c8ef630","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0fd4c8ef630 rhods-notebooks 43258dae-3d44-41da-98e0-f8ed168672b4 213443478 0 2026-07-13 05:05:21 +0000 UTC map[] map[] [] [] [{kube-scheduler Update events.k8s.io/v1 2026-07-13 05:05:21 +0000 UTC FieldsV1 {\"f:action\":{},\"f:eventTime\":{},\"f:note\":{},\"f:reason\":{},\"f:regarding\":{},\"f:reportingController\":{},\"f:reportingInstance\":{},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:42c2cf57-0b43-449b-8354-1641c3c131db,APIVersion:v1,ResourceVersion:213443007,FieldPath:,},Reason:Scheduled,Message:Successfully assigned rhods-notebooks/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0 to ip-10-0-1-132.us-east-2.compute.internal,Source:EventSource{Component:,Host:,},FirstTimestamp:0001-01-01 00:00:00 +0000 UTC,LastTimestamp:0001-01-01 00:00:00 +0000 UTC,Count:0,Type:Normal,EventTime:2026-07-13 05:05:21.559113 +0000 UTC,Series:nil,Action:Binding,Related:nil,ReportingController:default-scheduler,ReportingInstance:default-scheduler-kube-scheduler-5c68c9c546-8jt75,}"} 2026-07-13T05:05:21Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Successfully assigned rhods-notebooks/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0 to ip-10-0-1-132.us-east-2.compute.internal {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"039e42b9-cd66-44e1-8fe0-03fadc7ac76b","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213443011"}, "reason": "Scheduled"} 2026-07-13T05:05:21Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:05:21Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z ERROR controllers.Notebook Could not find container with the same name as Notebook in containerStates of Pod. Will not update notebook's status.containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.createNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:358 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.updateNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:305 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:254 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:21Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:05:21Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:05:21Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "9ad205fe-2d65-4615-a1c8-7f07ea49ddfd", "error": "Operation cannot be fulfilled on notebooks.kubeflow.org \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\": the object has been modified; please apply your changes to the latest version and try again"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:21Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:05:21Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z ERROR controllers.Notebook Could not find container with the same name as Notebook in containerStates of Pod. Will not update notebook's status.containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.createNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:358 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.updateNotebookStatus /opt/rhods/notebook-controller/controllers/notebook_controller.go:305 github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:254 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:21Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:05:21Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":0,"containerState":{}}} 2026-07-13T05:05:21Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:05:21Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"waiting":{"reason":"ContainerCreating"}}} 2026-07-13T05:05:21Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"False","lastProbeTime":"2026-07-13T05:05:21Z","lastTransitionTime":"2026-07-13T05:05:21Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:05:21Z","lastTransitionTime":"2026-07-13T05:05:21Z"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:05:21Z","lastTransitionTime":"2026-07-13T05:05:21Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:05:21Z","lastTransitionTime":"2026-07-13T05:05:21Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:05:21Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":0,"containerState":{"waiting":{"reason":"ContainerCreating"}}}} 2026-07-13T05:05:21Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:05:21Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"waiting":{"reason":"ContainerCreating"}}} 2026-07-13T05:05:21Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:21Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"False","lastProbeTime":"2026-07-13T05:05:21Z","lastTransitionTime":"2026-07-13T05:05:21Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:05:21Z","lastTransitionTime":"2026-07-13T05:05:21Z"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:05:21Z","lastTransitionTime":"2026-07-13T05:05:21Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:05:21Z","lastTransitionTime":"2026-07-13T05:05:21Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:05:21Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":0,"containerState":{"waiting":{"reason":"ContainerCreating"}}}} 2026-07-13T05:05:23Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:23Z INFO controllers.Notebook Creating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:23Z ERROR controllers.Notebook unable to create Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:179 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:23Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "59d48704-1e96-45c0-9b58-a6618d07195b", "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:23Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:23Z INFO controllers.Notebook Creating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:23Z ERROR controllers.Notebook unable to create Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:179 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:23Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "4c10a75d-b92c-412d-a394-842f7669519d", "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:23Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:23Z INFO controllers.Notebook Creating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:23Z ERROR controllers.Notebook unable to create Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:179 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:23Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "793904e5-9e39-49e4-9bc1-a25548207f5b", "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:23Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:23Z INFO controllers.Notebook Creating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:23Z ERROR controllers.Notebook unable to create Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:179 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:23Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "abd53d7a-2fb4-4476-a3cd-3e5c0f645129", "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:23Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:23Z INFO controllers.Notebook Creating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:23Z ERROR controllers.Notebook unable to create Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:179 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:23Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "3476166e-f295-4ba6-bf1c-0250a898c309", "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:23Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:23Z INFO controllers.Notebook Creating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:23Z ERROR controllers.Notebook unable to create Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:179 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:23Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "03f04598-a412-410e-925b-6362ed9c44ab", "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:23Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:23Z INFO controllers.Notebook Creating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:23Z ERROR controllers.Notebook unable to create Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:179 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:23Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "1a8340a9-3b3a-4daf-8f28-3e6b1b894cb4", "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:23Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0fdd4f97d28","namespace":"rhods-notebooks"}} 2026-07-13T05:05:23Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0fdd4f97d28","namespace":"rhods-notebooks"}} 2026-07-13T05:05:23Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0fdd4f97d28","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0fdd4f97d28 rhods-notebooks 1b6d9b0e-e29a-45b7-9a31-f6c776e8cd13 213443600 0 2026-07-13 05:05:23 +0000 UTC map[] map[] [] [] [{kube-controller-manager Update v1 2026-07-13 05:05:23 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:42c2cf57-0b43-449b-8354-1641c3c131db,APIVersion:v1,ResourceVersion:213443477,FieldPath:,},Reason:SuccessfulAttachVolume,Message:AttachVolume.Attach succeeded for volume \"pvc-dcd84cb9-4197-48d3-b3ed-92090a01fee2\" ,Source:EventSource{Component:attachdetach-controller,Host:,},FirstTimestamp:2026-07-13 05:05:23 +0000 UTC,LastTimestamp:2026-07-13 05:05:23 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:attachdetach-controller,ReportingInstance:,}"} 2026-07-13T05:05:23Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: AttachVolume.Attach succeeded for volume "pvc-dcd84cb9-4197-48d3-b3ed-92090a01fee2" {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"039e42b9-cd66-44e1-8fe0-03fadc7ac76b","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213443485"}, "reason": "SuccessfulAttachVolume"} 2026-07-13T05:05:24Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:24Z INFO controllers.Notebook Creating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:24Z ERROR controllers.Notebook unable to create Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:179 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:24Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "8d18836a-b65f-4094-b3e1-0ea91e128412", "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:24Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:24Z INFO controllers.Notebook Creating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:24Z ERROR controllers.Notebook unable to create Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:179 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:24Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "71cf61d2-cd16-4561-a6a6-ebe55c6a2ed0", "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:24Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:24Z INFO controllers.Notebook Creating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:24Z ERROR controllers.Notebook unable to create Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:179 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:24Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "66867e89-2d13-49e4-a758-fce8b16c5d3c", "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:24Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:24Z INFO controllers.Notebook Creating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:24Z ERROR controllers.Notebook unable to create Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:179 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:24Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "c2b7f99a-f957-461d-9348-a1e3d17d18ce", "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:24Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:24Z INFO controllers.Notebook Creating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:24Z ERROR controllers.Notebook unable to create Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:179 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:24Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "da11bf6a-5ddb-408e-8568-de2107318028", "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:25Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:25Z INFO controllers.Notebook Creating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:25Z ERROR controllers.Notebook unable to create Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:179 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:25Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "291c965e-e6b4-4105-9556-84ee4be80fb3", "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:25Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:25Z INFO controllers.Notebook Creating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:25Z ERROR controllers.Notebook unable to create Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:179 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:25Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "78bc47e3-aff1-43ea-b791-b338823fc875", "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:25Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:25Z INFO controllers.Notebook Creating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:25Z ERROR controllers.Notebook unable to create Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:179 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:25Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "00ab5353-3ceb-4efe-81d0-197576350ca1", "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:25Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:25Z INFO controllers.Notebook Creating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:25Z ERROR controllers.Notebook unable to create Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:179 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:25Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "1cfba5f2-4a6c-4691-9e39-b044cc238a7a", "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:26Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:26Z INFO controllers.Notebook Creating StatefulSet {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test"} 2026-07-13T05:05:26Z ERROR controllers.Notebook unable to create Statefulset {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:179 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:26Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "namespace": "test-workbench-storage-preset-167984", "name": "wb-rwo-test", "reconcileID": "56569a1e-2d4d-443b-a7b6-cbbc511c558d", "error": "statefulsets.apps \"wb-rwo-test\" is forbidden: unable to create new content in namespace test-workbench-storage-preset-167984 because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:26Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:26Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:26Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:26Z ERROR controllers.Notebook unable to fetch Notebook {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "Notebook.kubeflow.org \"wb-rwo-test\" not found"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:130 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:26Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:26Z ERROR controllers.Notebook unable to fetch Notebook {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "Notebook.kubeflow.org \"wb-rwo-test\" not found"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:130 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:26Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}} 2026-07-13T05:05:26Z ERROR controllers.Notebook unable to fetch Notebook {"notebook": {"name":"wb-rwo-test","namespace":"test-workbench-storage-preset-167984"}, "error": "Notebook.kubeflow.org \"wb-rwo-test\" not found"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:130 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:32Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffc9343c97","namespace":"rhods-notebooks"}} 2026-07-13T05:05:32Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffc9343c97","namespace":"rhods-notebooks"}} 2026-07-13T05:05:32Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffc9343c97","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffc9343c97 rhods-notebooks 3f22696e-9086-4e3c-befc-9c041bb4af30 213443988 0 2026-07-13 05:05:32 +0000 UTC map[] map[] [] [] [{multus-daemon Update v1 2026-07-13 05:05:32 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:42c2cf57-0b43-449b-8354-1641c3c131db,APIVersion:v1,ResourceVersion:213443484,FieldPath:,},Reason:AddedInterface,Message:Add eth0 [10.129.71.138/23] from ovn-kubernetes,Source:EventSource{Component:multus,Host:,},FirstTimestamp:2026-07-13 05:05:32 +0000 UTC,LastTimestamp:2026-07-13 05:05:32 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:multus,ReportingInstance:,}"} 2026-07-13T05:05:32Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Add eth0 [10.129.71.138/23] from ovn-kubernetes {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"039e42b9-cd66-44e1-8fe0-03fadc7ac76b","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213443485"}, "reason": "AddedInterface"} 2026-07-13T05:05:32Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:32Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:05:32Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:32Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:32Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"waiting":{"reason":"ContainerCreating"}}} 2026-07-13T05:05:32Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:32Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"False","lastProbeTime":"2026-07-13T05:05:32Z","lastTransitionTime":"2026-07-13T05:05:21Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:05:32Z","lastTransitionTime":"2026-07-13T05:05:21Z"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:05:32Z","lastTransitionTime":"2026-07-13T05:05:21Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:05:32Z","lastTransitionTime":"2026-07-13T05:05:21Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:05:32Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":0,"containerState":{"waiting":{"reason":"ContainerCreating"}}}} 2026-07-13T05:05:32Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffcb665ca7","namespace":"rhods-notebooks"}} 2026-07-13T05:05:32Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffcb665ca7","namespace":"rhods-notebooks"}} 2026-07-13T05:05:32Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffcb665ca7","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffcb665ca7 rhods-notebooks f5fb6529-b3f1-42e4-8b88-d04dca7cdcb3 213443991 0 2026-07-13 05:05:32 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:05:32 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:42c2cf57-0b43-449b-8354-1641c3c131db,APIVersion:v1,ResourceVersion:213443477,FieldPath:spec.containers{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser},},Reason:Pulling,Message:Pulling image \"image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/code-server-notebook:3.5\",Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:05:32 +0000 UTC,LastTimestamp:2026-07-13 05:05:32 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:05:32Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:32Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Pulling image "image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/code-server-notebook:3.5" {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"039e42b9-cd66-44e1-8fe0-03fadc7ac76b","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213443485"}, "reason": "Pulling"} 2026-07-13T05:05:32Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:05:32Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:32Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:32Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"waiting":{"reason":"ContainerCreating"}}} 2026-07-13T05:05:32Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:32Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"False","lastProbeTime":"2026-07-13T05:05:32Z","lastTransitionTime":"2026-07-13T05:05:21Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:05:32Z","lastTransitionTime":"2026-07-13T05:05:21Z"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:05:32Z","lastTransitionTime":"2026-07-13T05:05:21Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:05:32Z","lastTransitionTime":"2026-07-13T05:05:21Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:05:32Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":0,"containerState":{"waiting":{"reason":"ContainerCreating"}}}} 2026-07-13T05:05:32Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffe1d27d01","namespace":"rhods-notebooks"}} 2026-07-13T05:05:32Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffe1d27d01","namespace":"rhods-notebooks"}} 2026-07-13T05:05:32Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffe1d27d01","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffe1d27d01 rhods-notebooks ef7184df-e490-424a-8ea5-346c6ca47095 213444000 0 2026-07-13 05:05:32 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:05:32 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:42c2cf57-0b43-449b-8354-1641c3c131db,APIVersion:v1,ResourceVersion:213443477,FieldPath:spec.containers{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser},},Reason:Pulled,Message:Successfully pulled image \"image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/code-server-notebook:3.5\" in 376ms (376ms including waiting). Image size: 4164572550 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:05:32 +0000 UTC,LastTimestamp:2026-07-13 05:05:32 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:05:32Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Successfully pulled image "image-registry.openshift-image-registry.svc:5000/redhat-ods-applications/code-server-notebook:3.5" in 376ms (376ms including waiting). Image size: 4164572550 bytes. {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"039e42b9-cd66-44e1-8fe0-03fadc7ac76b","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213443992"}, "reason": "Pulled"} 2026-07-13T05:05:32Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffe72e945b","namespace":"rhods-notebooks"}} 2026-07-13T05:05:32Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffe72e945b","namespace":"rhods-notebooks"}} 2026-07-13T05:05:32Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffe72e945b","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffe72e945b rhods-notebooks 1b8077f7-0fc7-4e49-8eb1-fe259dfac247 213444003 0 2026-07-13 05:05:32 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:05:32 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:42c2cf57-0b43-449b-8354-1641c3c131db,APIVersion:v1,ResourceVersion:213443477,FieldPath:spec.containers{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser},},Reason:Created,Message:Created container: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser,Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:05:32 +0000 UTC,LastTimestamp:2026-07-13 05:05:32 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:05:32Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Created container: jupyter-nb-htpasswd-2dcluster-2dadmin-2duser {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"039e42b9-cd66-44e1-8fe0-03fadc7ac76b","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213443992"}, "reason": "Created"} 2026-07-13T05:05:32Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffe7b6df7c","namespace":"rhods-notebooks"}} 2026-07-13T05:05:32Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffe7b6df7c","namespace":"rhods-notebooks"}} 2026-07-13T05:05:32Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffe7b6df7c","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffe7b6df7c rhods-notebooks b587213d-638f-48dd-8289-e10971733e41 213444004 0 2026-07-13 05:05:32 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:05:32 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:42c2cf57-0b43-449b-8354-1641c3c131db,APIVersion:v1,ResourceVersion:213443477,FieldPath:spec.containers{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser},},Reason:Started,Message:Started container jupyter-nb-htpasswd-2dcluster-2dadmin-2duser,Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:05:32 +0000 UTC,LastTimestamp:2026-07-13 05:05:32 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:05:32Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Started container jupyter-nb-htpasswd-2dcluster-2dadmin-2duser {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"039e42b9-cd66-44e1-8fe0-03fadc7ac76b","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213443992"}, "reason": "Started"} 2026-07-13T05:05:32Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffe7cf9998","namespace":"rhods-notebooks"}} 2026-07-13T05:05:32Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffe7cf9998","namespace":"rhods-notebooks"}} 2026-07-13T05:05:32Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffe7cf9998","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c0ffe7cf9998 rhods-notebooks 052be156-cb36-4ac5-a7da-44d91d1629d2 213444006 0 2026-07-13 05:05:32 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:05:32 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:42c2cf57-0b43-449b-8354-1641c3c131db,APIVersion:v1,ResourceVersion:213443477,FieldPath:spec.containers{kube-rbac-proxy},},Reason:Pulling,Message:Pulling image \"quay.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:1e614e46799fd020ac18d95c06a463421154ce86e59ccb3fa6007e66fed9910e\",Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:05:32 +0000 UTC,LastTimestamp:2026-07-13 05:05:32 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:05:32Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Pulling image "quay.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:1e614e46799fd020ac18d95c06a463421154ce86e59ccb3fa6007e66fed9910e" {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"039e42b9-cd66-44e1-8fe0-03fadc7ac76b","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213443992"}, "reason": "Pulling"} 2026-07-13T05:05:33Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c1001959008a","namespace":"rhods-notebooks"}} 2026-07-13T05:05:33Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c1001959008a","namespace":"rhods-notebooks"}} 2026-07-13T05:05:33Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c1001959008a","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c1001959008a rhods-notebooks 735b3e10-986b-4e2d-80d1-d47362dbba43 213444027 0 2026-07-13 05:05:33 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:05:33 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:42c2cf57-0b43-449b-8354-1641c3c131db,APIVersion:v1,ResourceVersion:213443477,FieldPath:spec.containers{kube-rbac-proxy},},Reason:Pulled,Message:Successfully pulled image \"quay.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:1e614e46799fd020ac18d95c06a463421154ce86e59ccb3fa6007e66fed9910e\" in 831ms (831ms including waiting). Image size: 184260462 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:05:33 +0000 UTC,LastTimestamp:2026-07-13 05:05:33 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:05:33Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Successfully pulled image "quay.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:1e614e46799fd020ac18d95c06a463421154ce86e59ccb3fa6007e66fed9910e" in 831ms (831ms including waiting). Image size: 184260462 bytes. {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"039e42b9-cd66-44e1-8fe0-03fadc7ac76b","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213443992"}, "reason": "Pulled"} 2026-07-13T05:05:33Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c1001e2f0d4b","namespace":"rhods-notebooks"}} 2026-07-13T05:05:33Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c1001e2f0d4b","namespace":"rhods-notebooks"}} 2026-07-13T05:05:33Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c1001e2f0d4b","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c1001e2f0d4b rhods-notebooks 0ef8ffc5-f80e-4228-ab26-5c0a3b229c6e 213444029 0 2026-07-13 05:05:33 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:05:33 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:42c2cf57-0b43-449b-8354-1641c3c131db,APIVersion:v1,ResourceVersion:213443477,FieldPath:spec.containers{kube-rbac-proxy},},Reason:Created,Message:Created container: kube-rbac-proxy,Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:05:33 +0000 UTC,LastTimestamp:2026-07-13 05:05:33 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:05:33Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Created container: kube-rbac-proxy {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"039e42b9-cd66-44e1-8fe0-03fadc7ac76b","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213443992"}, "reason": "Created"} 2026-07-13T05:05:33Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c1001eb0c11e","namespace":"rhods-notebooks"}} 2026-07-13T05:05:33Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c1001eb0c11e","namespace":"rhods-notebooks"}} 2026-07-13T05:05:33Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c1001eb0c11e","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c1001eb0c11e rhods-notebooks 59dcc33d-bdc2-405c-be55-ef76700fa9eb 213444031 0 2026-07-13 05:05:33 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:05:33 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:42c2cf57-0b43-449b-8354-1641c3c131db,APIVersion:v1,ResourceVersion:213443477,FieldPath:spec.containers{kube-rbac-proxy},},Reason:Started,Message:Started container kube-rbac-proxy,Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:05:33 +0000 UTC,LastTimestamp:2026-07-13 05:05:33 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:05:33Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Started container kube-rbac-proxy {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"039e42b9-cd66-44e1-8fe0-03fadc7ac76b","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213443992"}, "reason": "Started"} 2026-07-13T05:05:34Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:34Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:05:34Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:34Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:34Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:05:32Z"}}} 2026-07-13T05:05:34Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:34Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:05:34Z","lastTransitionTime":"2026-07-13T05:05:34Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:05:34Z","lastTransitionTime":"2026-07-13T05:05:21Z"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:05:34Z","lastTransitionTime":"2026-07-13T05:05:21Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:05:34Z","lastTransitionTime":"2026-07-13T05:05:21Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:05:34Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":0,"containerState":{"running":{"startedAt":"2026-07-13T05:05:32Z"}}}} 2026-07-13T05:05:34Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:34Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:05:34Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:34Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:34Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:05:32Z"}}} 2026-07-13T05:05:34Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:34Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:05:34Z","lastTransitionTime":"2026-07-13T05:05:34Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:05:34Z","lastTransitionTime":"2026-07-13T05:05:21Z"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:05:34Z","lastTransitionTime":"2026-07-13T05:05:21Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:05:34Z","lastTransitionTime":"2026-07-13T05:05:21Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser kube-rbac-proxy]"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:05:34Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":0,"containerState":{"running":{"startedAt":"2026-07-13T05:05:32Z"}}}} 2026-07-13T05:05:41Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:41Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:05:41Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:41Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:41Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:05:32Z"}}} 2026-07-13T05:05:41Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:41Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:05:41Z","lastTransitionTime":"2026-07-13T05:05:34Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:05:41Z","lastTransitionTime":"2026-07-13T05:05:21Z"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:05:41Z","lastTransitionTime":"2026-07-13T05:05:21Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser]"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:05:41Z","lastTransitionTime":"2026-07-13T05:05:21Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser]"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:05:41Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":0,"containerState":{"running":{"startedAt":"2026-07-13T05:05:32Z"}}}} 2026-07-13T05:05:41Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:41Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:05:41Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:41Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:41Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:05:32Z"}}} 2026-07-13T05:05:41Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:41Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:05:41Z","lastTransitionTime":"2026-07-13T05:05:34Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:05:41Z","lastTransitionTime":"2026-07-13T05:05:21Z"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:05:41Z","lastTransitionTime":"2026-07-13T05:05:21Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser]"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:05:41Z","lastTransitionTime":"2026-07-13T05:05:21Z","reason":"ContainersNotReady","message":"containers with unready status: [jupyter-nb-htpasswd-2dcluster-2dadmin-2duser]"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:05:41Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":0,"containerState":{"running":{"startedAt":"2026-07-13T05:05:32Z"}}}} 2026-07-13T05:05:46Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:46Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:05:46Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:46Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:46Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:05:32Z"}}} 2026-07-13T05:05:46Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:46Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:05:46Z","lastTransitionTime":"2026-07-13T05:05:34Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:05:46Z","lastTransitionTime":"2026-07-13T05:05:21Z"},{"type":"Ready","status":"True","lastProbeTime":"2026-07-13T05:05:46Z","lastTransitionTime":"2026-07-13T05:05:46Z"},{"type":"ContainersReady","status":"True","lastProbeTime":"2026-07-13T05:05:46Z","lastTransitionTime":"2026-07-13T05:05:46Z"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:05:46Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":0,"containerState":{"running":{"startedAt":"2026-07-13T05:05:32Z"}}}} 2026-07-13T05:05:46Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:46Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:05:46Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:46Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:46Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:05:32Z"}}} 2026-07-13T05:05:46Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:46Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:05:46Z","lastTransitionTime":"2026-07-13T05:05:34Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:05:46Z","lastTransitionTime":"2026-07-13T05:05:21Z"},{"type":"Ready","status":"True","lastProbeTime":"2026-07-13T05:05:46Z","lastTransitionTime":"2026-07-13T05:05:46Z"},{"type":"ContainersReady","status":"True","lastProbeTime":"2026-07-13T05:05:46Z","lastTransitionTime":"2026-07-13T05:05:46Z"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:05:46Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":1,"containerState":{"running":{"startedAt":"2026-07-13T05:05:32Z"}}}} 2026-07-13T05:05:46Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "2b1b99c4-01e7-4a40-8e6a-94e7be93ac7e", "error": "Operation cannot be fulfilled on notebooks.kubeflow.org \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\": the object has been modified; please apply your changes to the latest version and try again"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:05:46Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:46Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:05:46Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:46Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:46Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:05:32Z"}}} 2026-07-13T05:05:46Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:46Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:05:46Z","lastTransitionTime":"2026-07-13T05:05:34Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:05:46Z","lastTransitionTime":"2026-07-13T05:05:21Z"},{"type":"Ready","status":"True","lastProbeTime":"2026-07-13T05:05:46Z","lastTransitionTime":"2026-07-13T05:05:46Z"},{"type":"ContainersReady","status":"True","lastProbeTime":"2026-07-13T05:05:46Z","lastTransitionTime":"2026-07-13T05:05:46Z"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:05:46Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":1,"containerState":{"running":{"startedAt":"2026-07-13T05:05:32Z"}}}} 2026-07-13T05:05:46Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:46Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:05:46Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:46Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:46Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:05:32Z"}}} 2026-07-13T05:05:46Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:05:46Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:05:46Z","lastTransitionTime":"2026-07-13T05:05:34Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:05:46Z","lastTransitionTime":"2026-07-13T05:05:21Z"},{"type":"Ready","status":"True","lastProbeTime":"2026-07-13T05:05:46Z","lastTransitionTime":"2026-07-13T05:05:46Z"},{"type":"ContainersReady","status":"True","lastProbeTime":"2026-07-13T05:05:46Z","lastTransitionTime":"2026-07-13T05:05:46Z"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:05:46Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":1,"containerState":{"running":{"startedAt":"2026-07-13T05:05:32Z"}}}} 2026-07-13T05:06:02Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:06:02Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:05:32Z"}}} 2026-07-13T05:06:02Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:34Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:21Z"},{"type":"Ready","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:46Z"},{"type":"ContainersReady","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:46Z"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":1,"containerState":{"running":{"startedAt":"2026-07-13T05:05:32Z"}}}} 2026-07-13T05:06:02Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:06:02Z ERROR controllers.Notebook unable to update Statefulset {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "error": "Operation cannot be fulfilled on statefulsets.apps \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\": the object has been modified; please apply your changes to the latest version and try again"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:201 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:06:02Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "0c41f20d-c9f3-4a2b-930c-d062a661ec48", "error": "Operation cannot be fulfilled on statefulsets.apps \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\": the object has been modified; please apply your changes to the latest version and try again"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:06:02Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser.18c1c106bb536780","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser.18c1c106bb536780","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser.18c1c106bb536780","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser.18c1c106bb536780 rhods-notebooks ed262f98-067b-4351-a574-ebc1514f9f1a 213444511 0 2026-07-13 05:06:02 +0000 UTC map[] map[] [] [] [{kube-controller-manager Update v1 2026-07-13 05:06:02 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:StatefulSet,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser,UID:62c35986-11bd-4cdc-8b22-31357ea9ca15,APIVersion:apps/v1,ResourceVersion:213444506,FieldPath:,},Reason:SuccessfulDelete,Message:delete Pod jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0 in StatefulSet jupyter-nb-htpasswd-2dcluster-2dadmin-2duser successful,Source:EventSource{Component:statefulset-controller,Host:,},FirstTimestamp:2026-07-13 05:06:02 +0000 UTC,LastTimestamp:2026-07-13 05:06:02 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:statefulset-controller,ReportingInstance:,}"} 2026-07-13T05:06:02Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c106bbef11f6","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c106bbef11f6","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z DEBUG events Reissued from statefulset/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser: delete Pod jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0 in StatefulSet jupyter-nb-htpasswd-2dcluster-2dadmin-2duser successful {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"039e42b9-cd66-44e1-8fe0-03fadc7ac76b","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213444508"}, "reason": "SuccessfulDelete"} 2026-07-13T05:06:02Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c106bbef11f6","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c106bbef11f6 rhods-notebooks 9e847153-bc23-479a-abc7-551f99e8df76 213444516 0 2026-07-13 05:06:02 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:06:02 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:42c2cf57-0b43-449b-8354-1641c3c131db,APIVersion:v1,ResourceVersion:213443477,FieldPath:spec.containers{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser},},Reason:Killing,Message:Stopping container jupyter-nb-htpasswd-2dcluster-2dadmin-2duser,Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:06:02 +0000 UTC,LastTimestamp:2026-07-13 05:06:02 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:06:02Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:06:02Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Stopping container jupyter-nb-htpasswd-2dcluster-2dadmin-2duser {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"039e42b9-cd66-44e1-8fe0-03fadc7ac76b","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213444508"}, "reason": "Killing"} 2026-07-13T05:06:02Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:05:32Z"}}} 2026-07-13T05:06:02Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:34Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:21Z"},{"type":"Ready","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:46Z"},{"type":"ContainersReady","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:46Z"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":1,"containerState":{"running":{"startedAt":"2026-07-13T05:05:32Z"}}}} 2026-07-13T05:06:02Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c106bbef71d1","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Found event for Notebook. Re-emitting... {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c106bbef71d1","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Emitting Notebook Event. {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c106bbef71d1","namespace":"rhods-notebooks"}, "Event": "&Event{ObjectMeta:{jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0.18c1c106bbef71d1 rhods-notebooks 0123d527-e916-495d-9345-b84c49ee2458 213444517 0 2026-07-13 05:06:02 +0000 UTC map[] map[] [] [] [{kubelet Update v1 2026-07-13 05:06:02 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:reportingComponent\":{},\"f:reportingInstance\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]},InvolvedObject:ObjectReference{Kind:Pod,Namespace:rhods-notebooks,Name:jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0,UID:42c2cf57-0b43-449b-8354-1641c3c131db,APIVersion:v1,ResourceVersion:213443477,FieldPath:spec.containers{kube-rbac-proxy},},Reason:Killing,Message:Stopping container kube-rbac-proxy,Source:EventSource{Component:kubelet,Host:ip-10-0-1-132.us-east-2.compute.internal,},FirstTimestamp:2026-07-13 05:06:02 +0000 UTC,LastTimestamp:2026-07-13 05:06:02 +0000 UTC,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-1-132.us-east-2.compute.internal,}"} 2026-07-13T05:06:02Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z DEBUG events Reissued from pod/jupyter-nb-htpasswd-2dcluster-2dadmin-2duser-0: Stopping container kube-rbac-proxy {"type": "Normal", "object": {"kind":"Notebook","namespace":"rhods-notebooks","name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","uid":"039e42b9-cd66-44e1-8fe0-03fadc7ac76b","apiVersion":"kubeflow.org/v1beta1","resourceVersion":"213444508"}, "reason": "Killing"} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:06:02Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"running":{"startedAt":"2026-07-13T05:05:32Z"}}} 2026-07-13T05:06:02Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:34Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:21Z"},{"type":"Ready","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:46Z"},{"type":"ContainersReady","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:46Z"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":1,"containerState":{"running":{"startedAt":"2026-07-13T05:05:32Z"}}}} 2026-07-13T05:06:02Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:06:02Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2026-07-13T05:05:32Z","finishedAt":"2026-07-13T05:06:02Z","containerID":"cri-o://f09e9935207aa0167ad8432982288eb293ea53574137333039ce35d18b767580"}}} 2026-07-13T05:06:02Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"False","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:06:02Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:21Z","reason":"PodCompleted"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:06:02Z","reason":"PodCompleted"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:06:02Z","reason":"PodCompleted"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":1,"containerState":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2026-07-13T05:05:32Z","finishedAt":"2026-07-13T05:06:02Z","containerID":"cri-o://f09e9935207aa0167ad8432982288eb293ea53574137333039ce35d18b767580"}}}} 2026-07-13T05:06:02Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:06:02Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2026-07-13T05:05:32Z","finishedAt":"2026-07-13T05:06:02Z","containerID":"cri-o://f09e9935207aa0167ad8432982288eb293ea53574137333039ce35d18b767580"}}} 2026-07-13T05:06:02Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"False","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:06:02Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:21Z","reason":"PodCompleted"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:06:02Z","reason":"PodCompleted"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:06:02Z","reason":"PodCompleted"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":0,"containerState":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2026-07-13T05:05:32Z","finishedAt":"2026-07-13T05:06:02Z","containerID":"cri-o://f09e9935207aa0167ad8432982288eb293ea53574137333039ce35d18b767580"}}}} 2026-07-13T05:06:02Z ERROR Reconciler error {"controller": "notebook", "controllerGroup": "kubeflow.org", "controllerKind": "Notebook", "Notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser", "reconcileID": "7c3c3e6d-34da-4caf-a1f0-3bf68d7ebbe2", "error": "Operation cannot be fulfilled on notebooks.kubeflow.org \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\": the object has been modified; please apply your changes to the latest version and try again"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:06:02Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:06:02Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2026-07-13T05:05:32Z","finishedAt":"2026-07-13T05:06:02Z","containerID":"cri-o://f09e9935207aa0167ad8432982288eb293ea53574137333039ce35d18b767580"}}} 2026-07-13T05:06:02Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"False","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:06:02Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:21Z","reason":"PodCompleted"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:06:02Z","reason":"PodCompleted"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:06:02Z","reason":"PodCompleted"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":0,"containerState":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2026-07-13T05:05:32Z","finishedAt":"2026-07-13T05:06:02Z","containerID":"cri-o://f09e9935207aa0167ad8432982288eb293ea53574137333039ce35d18b767580"}}}} 2026-07-13T05:06:02Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating StatefulSet {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "namespace": "rhods-notebooks", "name": "jupyter-nb-htpasswd-2dcluster-2dadmin-2duser"} 2026-07-13T05:06:02Z INFO controllers.Notebook Initializing Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Calculating Notebook's containerState {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating Notebook CR state: {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "state": {"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2026-07-13T05:05:32Z","finishedAt":"2026-07-13T05:06:02Z","containerID":"cri-o://f09e9935207aa0167ad8432982288eb293ea53574137333039ce35d18b767580"}}} 2026-07-13T05:06:02Z INFO controllers.Notebook Calculating Notebook's Conditions {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:02Z INFO controllers.Notebook Updating Notebook CR Status {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "status": {"conditions":[{"type":"PodReadyToStartContainers","status":"False","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:06:02Z"},{"type":"Initialized","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:21Z","reason":"PodCompleted"},{"type":"Ready","status":"False","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:06:02Z","reason":"PodCompleted"},{"type":"ContainersReady","status":"False","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:06:02Z","reason":"PodCompleted"},{"type":"PodScheduled","status":"True","lastProbeTime":"2026-07-13T05:06:02Z","lastTransitionTime":"2026-07-13T05:05:21Z"}],"readyReplicas":0,"containerState":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2026-07-13T05:05:32Z","finishedAt":"2026-07-13T05:06:02Z","containerID":"cri-o://f09e9935207aa0167ad8432982288eb293ea53574137333039ce35d18b767580"}}}} 2026-07-13T05:06:03Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:03Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:03Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:03Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:03Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:03Z ERROR controllers.Notebook unable to fetch Notebook {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "error": "Notebook.kubeflow.org \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\" not found"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:130 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:06:03Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:03Z ERROR controllers.Notebook unable to fetch Notebook {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "error": "Notebook.kubeflow.org \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\" not found"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:130 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:06:03Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:03Z ERROR controllers.Notebook unable to fetch Notebook {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "error": "Notebook.kubeflow.org \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\" not found"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:130 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 2026-07-13T05:06:03Z INFO controllers.Notebook Reconciliation loop started {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}} 2026-07-13T05:06:03Z ERROR controllers.Notebook unable to fetch Notebook {"notebook": {"name":"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser","namespace":"rhods-notebooks"}, "error": "Notebook.kubeflow.org \"jupyter-nb-htpasswd-2dcluster-2dadmin-2duser\" not found"} github.com/kubeflow/kubeflow/components/notebook-controller/controllers.(*NotebookReconciler).Reconcile /opt/rhods/notebook-controller/controllers/notebook_controller.go:130 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313 ==================== WORKLOAD POD LOG: rhoai-model-registries/model-catalog-8455675f7d-55qzw.log ==================== 2026/07/13 04:45:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:56854 - 200 55B in 55.047µs 2026/07/13 04:46:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:56876 - 200 55B in 37.374µs 2026/07/13 04:46:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:41796 - 200 55B in 41.375µs 2026/07/13 04:46:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:41820 - 200 55B in 36.279µs 2026/07/13 04:46:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:58084 - 200 55B in 36.442µs 2026/07/13 04:46:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:58108 - 200 55B in 40.465µs 2026/07/13 04:46:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:35322 - 200 55B in 36.527µs 2026/07/13 04:46:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:35328 - 200 55B in 36.141µs 2026/07/13 04:46:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:33442 - 200 55B in 37.699µs 2026/07/13 04:46:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:33468 - 200 55B in 37.746µs 2026/07/13 04:46:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:46508 - 200 55B in 37.296µs 2026/07/13 04:46:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:46520 - 200 55B in 36.996µs 2026/07/13 04:46:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:45828 - 200 55B in 35.156µs 2026/07/13 04:47:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:45846 - 200 55B in 40.411µs 2026/07/13 04:47:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:35042 - 200 55B in 39.92µs 2026/07/13 04:47:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:35072 - 200 55B in 23.91µs 2026/07/13 04:47:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:40580 - 200 55B in 41.916µs 2026/07/13 04:47:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:40586 - 200 55B in 38.566µs 2026/07/13 04:47:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:41158 - 200 55B in 37.621µs 2026/07/13 04:47:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:41176 - 200 55B in 36.246µs 2026/07/13 04:47:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:34222 - 200 55B in 36.653µs 2026/07/13 04:47:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:34240 - 200 55B in 35.256µs 2026/07/13 04:47:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:48130 - 200 55B in 48.663µs 2026/07/13 04:47:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:48148 - 200 55B in 36.079µs 2026/07/13 04:47:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:56462 - 200 55B in 20.189µs 2026/07/13 04:48:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:56476 - 200 55B in 36.093µs 2026/07/13 04:48:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:45672 - 200 55B in 35.382µs 2026/07/13 04:48:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:45692 - 200 55B in 38.834µs 2026/07/13 04:48:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:36446 - 200 55B in 41.459µs 2026/07/13 04:48:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:36478 - 200 55B in 37.038µs 2026/07/13 04:48:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:33962 - 200 55B in 70.121µs 2026/07/13 04:48:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:33982 - 200 55B in 35.911µs 2026/07/13 04:48:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:51868 - 200 55B in 35.034µs 2026/07/13 04:48:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:51886 - 200 55B in 36.133µs 2026/07/13 04:48:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:48210 - 200 55B in 45.517µs 2026/07/13 04:48:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:48222 - 200 55B in 65.336µs 2026/07/13 04:48:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:50714 - 200 55B in 44.727µs 2026/07/13 04:49:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:50728 - 200 55B in 65.121µs 2026/07/13 04:49:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:38826 - 200 55B in 40.609µs 2026/07/13 04:49:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:38840 - 200 55B in 39.421µs 2026/07/13 04:49:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:37936 - 200 55B in 38.217µs 2026/07/13 04:49:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:37956 - 200 55B in 36.911µs 2026/07/13 04:49:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:56254 - 200 55B in 37.827µs 2026/07/13 04:49:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:56276 - 200 55B in 36.362µs 2026/07/13 04:49:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:35474 - 200 55B in 36.294µs 2026/07/13 04:49:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:35492 - 200 55B in 35.745µs 2026/07/13 04:49:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:34858 - 200 55B in 39.589µs 2026/07/13 04:49:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:34884 - 200 55B in 37.446µs 2026/07/13 04:49:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:47116 - 200 55B in 38.348µs 2026/07/13 04:50:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:47134 - 200 55B in 34.968µs 2026/07/13 04:50:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:47874 - 200 55B in 36.568µs 2026/07/13 04:50:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:47894 - 200 55B in 36µs 2026/07/13 04:50:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:39420 - 200 55B in 45.719µs 2026/07/13 04:50:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:39438 - 200 55B in 36.084µs 2026/07/13 04:50:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:55222 - 200 55B in 39.432µs 2026/07/13 04:50:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:55238 - 200 55B in 38.47µs 2026/07/13 04:50:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:39932 - 200 55B in 39.598µs 2026/07/13 04:50:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:39954 - 200 55B in 36.032µs 2026/07/13 04:50:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:43282 - 200 55B in 36.101µs 2026/07/13 04:50:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:43292 - 200 55B in 34.505µs 2026/07/13 04:50:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:46098 - 200 55B in 51.59µs 2026/07/13 04:51:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:46124 - 200 55B in 35.885µs 2026/07/13 04:51:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:51316 - 200 55B in 20.069µs 2026/07/13 04:51:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:51338 - 200 55B in 48.127µs 2026/07/13 04:51:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:58164 - 200 55B in 21.03µs 2026/07/13 04:51:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:58174 - 200 55B in 21.03µs 2026/07/13 04:51:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:39690 - 200 55B in 39.98µs 2026/07/13 04:51:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:39708 - 200 55B in 36.5µs 2026/07/13 04:51:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:43708 - 200 55B in 36.232µs 2026/07/13 04:51:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:43724 - 200 55B in 36.831µs 2026/07/13 04:51:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:56500 - 200 55B in 36.168µs 2026/07/13 04:51:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:56518 - 200 55B in 40.524µs 2026/07/13 04:51:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:39930 - 200 55B in 35.462µs 2026/07/13 04:52:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:39948 - 200 55B in 39.677µs 2026/07/13 04:52:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:48770 - 200 55B in 36.024µs 2026/07/13 04:52:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:48784 - 200 55B in 37.546µs 2026/07/13 04:52:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:41430 - 200 55B in 36.618µs 2026/07/13 04:52:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:41446 - 200 55B in 39.387µs 2026/07/13 04:52:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:56012 - 200 55B in 36.227µs 2026/07/13 04:52:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:56022 - 200 55B in 37.077µs 2026/07/13 04:52:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:53396 - 200 55B in 36.673µs 2026/07/13 04:52:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:53420 - 200 55B in 54.562µs 2026/07/13 04:52:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:36096 - 200 55B in 37.684µs 2026/07/13 04:52:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:36106 - 200 55B in 36.134µs 2026/07/13 04:52:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:51994 - 200 55B in 39.595µs 2026/07/13 04:53:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:52006 - 200 55B in 35.381µs 2026/07/13 04:53:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:49576 - 200 55B in 37.979µs 2026/07/13 04:53:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:49592 - 200 55B in 36.777µs 2026/07/13 04:53:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:45736 - 200 55B in 37.932µs 2026/07/13 04:53:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:45748 - 200 55B in 20.72µs 2026/07/13 04:53:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:42292 - 200 55B in 34.799µs 2026/07/13 04:53:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:42300 - 200 55B in 36.327µs 2026/07/13 04:53:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:50656 - 200 55B in 36.538µs 2026/07/13 04:53:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:50670 - 200 55B in 37.06µs 2026/07/13 04:53:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:44824 - 200 55B in 36.815µs 2026/07/13 04:53:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:44844 - 200 55B in 36.886µs 2026/07/13 04:53:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:40292 - 200 55B in 38.939µs 2026/07/13 04:54:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:40314 - 200 55B in 35.838µs 2026/07/13 04:54:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:36070 - 200 55B in 38.812µs 2026/07/13 04:54:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:36078 - 200 55B in 37.663µs 2026/07/13 04:54:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:44884 - 200 55B in 37.377µs 2026/07/13 04:54:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:44898 - 200 55B in 37.334µs 2026/07/13 04:54:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:58822 - 200 55B in 41.891µs 2026/07/13 04:54:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:58840 - 200 55B in 45.039µs 2026/07/13 04:54:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:54162 - 200 55B in 35.849µs 2026/07/13 04:54:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:54170 - 200 55B in 36.258µs 2026/07/13 04:54:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:48190 - 200 55B in 38.357µs 2026/07/13 04:54:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:48220 - 200 55B in 36.103µs 2026/07/13 04:54:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:58410 - 200 55B in 35.821µs 2026/07/13 04:55:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:58430 - 200 55B in 35.988µs 2026/07/13 04:55:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:41316 - 200 55B in 20.891µs 2026/07/13 04:55:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:41342 - 200 55B in 40.204µs 2026/07/13 04:55:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:45170 - 200 55B in 20.895µs 2026/07/13 04:55:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:45190 - 200 55B in 20.618µs 2026/07/13 04:55:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:57662 - 200 55B in 38.648µs 2026/07/13 04:55:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:57688 - 200 55B in 36.193µs 2026/07/13 04:55:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:39802 - 200 55B in 36.363µs 2026/07/13 04:55:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:39822 - 200 55B in 35.674µs 2026/07/13 04:55:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:33914 - 200 55B in 41.23µs 2026/07/13 04:55:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:33926 - 200 55B in 38.8µs 2026/07/13 04:55:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:37566 - 200 55B in 39.877µs 2026/07/13 04:56:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:37580 - 200 55B in 34.859µs 2026/07/13 04:56:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:46506 - 200 55B in 38.355µs 2026/07/13 04:56:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:46524 - 200 55B in 38.08µs 2026/07/13 04:56:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:59950 - 200 55B in 34.718µs 2026/07/13 04:56:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:59970 - 200 55B in 45.194µs 2026/07/13 04:56:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:58486 - 200 55B in 36.256µs 2026/07/13 04:56:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:58518 - 200 55B in 41.054µs 2026/07/13 04:56:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:47222 - 200 55B in 37.271µs 2026/07/13 04:56:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:47238 - 200 55B in 36.54µs 2026/07/13 04:56:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:36204 - 200 55B in 43.859µs 2026/07/13 04:56:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:36212 - 200 55B in 36.403µs 2026/07/13 04:56:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:52540 - 200 55B in 35.981µs 2026/07/13 04:57:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:52562 - 200 55B in 39.564µs 2026/07/13 04:57:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:43980 - 200 55B in 37.866µs 2026/07/13 04:57:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:44002 - 200 55B in 40.112µs 2026/07/13 04:57:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:33544 - 200 55B in 37.277µs 2026/07/13 04:57:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:33562 - 200 55B in 39.067µs 2026/07/13 04:57:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:47618 - 200 55B in 41.056µs 2026/07/13 04:57:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:47630 - 200 55B in 36.7µs 2026/07/13 04:57:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:56126 - 200 55B in 39.299µs 2026/07/13 04:57:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:56136 - 200 55B in 43.643µs 2026/07/13 04:57:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:46608 - 200 55B in 36.644µs 2026/07/13 04:57:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:46626 - 200 55B in 38.268µs 2026/07/13 04:57:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:33682 - 200 55B in 36.638µs 2026/07/13 04:58:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:33698 - 200 55B in 64.741µs 2026/07/13 04:58:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:49670 - 200 55B in 37.489µs 2026/07/13 04:58:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:49692 - 200 55B in 36.673µs 2026/07/13 04:58:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:39686 - 200 55B in 42.752µs 2026/07/13 04:58:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:39702 - 200 55B in 37.785µs 2026/07/13 04:58:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:55018 - 200 55B in 36.661µs 2026/07/13 04:58:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:55038 - 200 55B in 41.446µs 2026/07/13 04:58:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:49900 - 200 55B in 37.111µs 2026/07/13 04:58:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:49926 - 200 55B in 35.699µs 2026/07/13 04:58:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:57006 - 200 55B in 37.704µs 2026/07/13 04:58:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:57028 - 200 55B in 35.009µs 2026/07/13 04:58:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:40310 - 200 55B in 44.836µs 2026/07/13 04:59:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:40324 - 200 55B in 35.944µs 2026/07/13 04:59:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:46882 - 200 55B in 44.954µs 2026/07/13 04:59:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:46896 - 200 55B in 35.501µs 2026/07/13 04:59:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:34356 - 200 55B in 41.503µs 2026/07/13 04:59:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:34380 - 200 55B in 21.314µs 2026/07/13 04:59:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:59354 - 200 55B in 40.257µs 2026/07/13 04:59:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:59386 - 200 55B in 36.487µs 2026/07/13 04:59:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:50126 - 200 55B in 59.102µs 2026/07/13 04:59:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:50146 - 200 55B in 65.061µs 2026/07/13 04:59:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:59376 - 200 55B in 40.436µs 2026/07/13 04:59:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:59396 - 200 55B in 37.487µs 2026/07/13 04:59:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:57362 - 200 55B in 39.018µs 2026/07/13 05:00:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:57372 - 200 55B in 40.845µs 2026/07/13 05:00:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:34532 - 200 55B in 39.701µs 2026/07/13 05:00:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:34564 - 200 55B in 36.893µs 2026/07/13 05:00:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:53988 - 200 55B in 38.169µs 2026/07/13 05:00:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:54018 - 200 55B in 35.197µs 2026/07/13 05:00:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:34596 - 200 55B in 40.735µs 2026/07/13 05:00:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:34616 - 200 55B in 36.321µs 2026/07/13 05:00:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:48364 - 200 55B in 38.335µs 2026/07/13 05:00:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:48390 - 200 55B in 38.589µs 2026/07/13 05:00:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:49482 - 200 55B in 37.116µs 2026/07/13 05:00:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:49490 - 200 55B in 49.687µs 2026/07/13 05:00:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:37832 - 200 55B in 35.488µs 2026/07/13 05:01:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:37856 - 200 55B in 35.577µs 2026/07/13 05:01:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:57182 - 200 55B in 36.96µs 2026/07/13 05:01:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:57204 - 200 55B in 41.62µs 2026/07/13 05:01:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:58602 - 200 55B in 38.219µs 2026/07/13 05:01:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:58628 - 200 55B in 36.877µs 2026/07/13 05:01:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:41460 - 200 55B in 45.081µs 2026/07/13 05:01:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:41484 - 200 55B in 34.924µs 2026/07/13 05:01:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:36934 - 200 55B in 37.455µs 2026/07/13 05:01:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:36952 - 200 55B in 36.635µs 2026/07/13 05:01:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:58450 - 200 55B in 38.432µs 2026/07/13 05:01:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:58474 - 200 55B in 36.79µs 2026/07/13 05:01:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:59018 - 200 55B in 36.073µs 2026/07/13 05:02:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:59034 - 200 55B in 35.04µs 2026/07/13 05:02:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:57050 - 200 55B in 36.805µs 2026/07/13 05:02:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:57070 - 200 55B in 36.426µs 2026/07/13 05:02:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:44154 - 200 55B in 36.952µs 2026/07/13 05:02:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:44174 - 200 55B in 44.887µs 2026/07/13 05:02:27 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/sources HTTP/1.1" from 127.0.0.1:46026 - 200 420B in 1.683199ms 2026/07/13 05:02:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:35218 - 200 55B in 36.068µs 2026/07/13 05:02:30 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/sources HTTP/1.1" from 127.0.0.1:46026 - 200 420B in 854.87µs 2026/07/13 05:02:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:35226 - 200 55B in 36.356µs 2026/07/13 05:02:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:53484 - 200 55B in 39.156µs 2026/07/13 05:02:44 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/sources HTTP/1.1" from 127.0.0.1:46026 - 200 420B in 807.638µs 2026/07/13 05:02:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:53498 - 200 55B in 49.016µs 2026/07/13 05:02:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:35040 - 200 55B in 37.063µs 2026/07/13 05:02:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:35062 - 200 55B in 35.092µs 2026/07/13 05:02:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:33810 - 200 55B in 49.904µs 2026/07/13 05:03:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:33842 - 200 55B in 33.825µs 2026/07/13 05:03:06 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/labels HTTP/1.1" from 127.0.0.1:32816 - 200 620B in 123.782µs 2026/07/13 05:03:06 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/sources HTTP/1.1" from 127.0.0.1:32806 - 200 420B in 2.62409ms 2026/07/13 05:03:06 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/models/filter_options HTTP/1.1" from 127.0.0.1:46026 - 200 9882B in 3.683572ms 2026/07/13 05:03:06 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/models?pageSize=4&sourceLabel=null HTTP/1.1" from 127.0.0.1:32816 - 200 105023B in 5.898549ms 2026/07/13 05:03:06 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/models?pageSize=4&sourceLabel=Red+Hat+AI+validated HTTP/1.1" from 127.0.0.1:32806 - 200 142061B in 11.432052ms 2026/07/13 05:03:06 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/models?pageSize=4&sourceLabel=Red+Hat+AI HTTP/1.1" from 127.0.0.1:32806 - 200 47545B in 2.572247ms 2026/07/13 05:03:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:57652 - 200 55B in 20.86µs 2026/07/13 05:03:11 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/sources/redhat_ai_validated_models/models/RedHatAI%2Fgemma-2-9b-it/artifacts/performance?filterQuery=use_case.string_value%3D%27chatbot%27+AND+ttft_p90.double_value+%3C%3D+2231.15348815918+OR+performance_sub_type.string_value%3D%27cold-start%27&latencyProperty=ttft_p90&orderBy=ttft_p90.double_value&pageSize=999&recommendations=true&sortOrder=ASC&targetRPS=1 HTTP/1.1" from 127.0.0.1:32862 - 200 56B in 81.133081ms 2026/07/13 05:03:11 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/sources/redhat_ai_validated_models/models/RedHatAI%2FDeepSeek-R1-0528-quantized.w4a16/artifacts/performance?filterQuery=use_case.string_value%3D%27chatbot%27+AND+ttft_p90.double_value+%3C%3D+2231.15348815918+OR+performance_sub_type.string_value%3D%27cold-start%27&latencyProperty=ttft_p90&orderBy=ttft_p90.double_value&pageSize=999&recommendations=true&sortOrder=ASC&targetRPS=1 HTTP/1.1" from 127.0.0.1:32806 - 200 20726B in 95.986346ms 2026/07/13 05:03:11 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/sources/redhat_ai_validated_models/models/RedHatAI%2FApertus-8B-Instruct-2509-FP8-dynamic/artifacts/performance?filterQuery=use_case.string_value%3D%27chatbot%27+AND+ttft_p90.double_value+%3C%3D+2231.15348815918+OR+performance_sub_type.string_value%3D%27cold-start%27&latencyProperty=ttft_p90&orderBy=ttft_p90.double_value&pageSize=999&recommendations=true&sortOrder=ASC&targetRPS=1 HTTP/1.1" from 127.0.0.1:32816 - 200 41125B in 99.842026ms 2026/07/13 05:03:11 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/sources/redhat_ai_validated_models/models/RedHatAI%2FDevstral-Small-2-24B-Instruct-2512/artifacts/performance?filterQuery=use_case.string_value%3D%27chatbot%27+AND+ttft_p90.double_value+%3C%3D+2231.15348815918+OR+performance_sub_type.string_value%3D%27cold-start%27&latencyProperty=ttft_p90&orderBy=ttft_p90.double_value&pageSize=999&recommendations=true&sortOrder=ASC&targetRPS=1 HTTP/1.1" from 127.0.0.1:32856 - 200 62309B in 110.722745ms 2026/07/13 05:03:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:57670 - 200 55B in 40.023µs 2026/07/13 05:03:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:43366 - 200 55B in 44.653µs 2026/07/13 05:03:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:43388 - 200 55B in 19.875µs 2026/07/13 05:03:26 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/labels HTTP/1.1" from 127.0.0.1:32862 - 200 620B in 80.992µs 2026/07/13 05:03:26 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/sources HTTP/1.1" from 127.0.0.1:53202 - 200 420B in 1.195078ms 2026/07/13 05:03:26 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/models/filter_options HTTP/1.1" from 127.0.0.1:32806 - 200 9882B in 3.134521ms 2026/07/13 05:03:26 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/models?pageSize=4&sourceLabel=Red+Hat+AI HTTP/1.1" from 127.0.0.1:53202 - 200 47545B in 3.005788ms 2026/07/13 05:03:26 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/models?pageSize=4&sourceLabel=Red+Hat+AI+validated HTTP/1.1" from 127.0.0.1:32862 - 200 142061B in 5.177767ms 2026/07/13 05:03:26 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/models?pageSize=4&sourceLabel=null HTTP/1.1" from 127.0.0.1:32862 - 200 105023B in 4.715295ms 2026/07/13 05:03:27 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/sources/redhat_ai_validated_models/models/RedHatAI%2Fgemma-2-9b-it/artifacts/performance?filterQuery=use_case.string_value%3D%27chatbot%27+AND+ttft_p90.double_value+%3C%3D+2231.15348815918+OR+performance_sub_type.string_value%3D%27cold-start%27&latencyProperty=ttft_p90&orderBy=ttft_p90.double_value&pageSize=999&recommendations=true&sortOrder=ASC&targetRPS=1 HTTP/1.1" from 127.0.0.1:32862 - 200 56B in 3.064873ms 2026/07/13 05:03:27 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/sources/redhat_ai_validated_models/models/RedHatAI%2FDeepSeek-R1-0528-quantized.w4a16/artifacts/performance?filterQuery=use_case.string_value%3D%27chatbot%27+AND+ttft_p90.double_value+%3C%3D+2231.15348815918+OR+performance_sub_type.string_value%3D%27cold-start%27&latencyProperty=ttft_p90&orderBy=ttft_p90.double_value&pageSize=999&recommendations=true&sortOrder=ASC&targetRPS=1 HTTP/1.1" from 127.0.0.1:53202 - 200 20726B in 30.418635ms 2026/07/13 05:03:27 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/sources/redhat_ai_validated_models/models/RedHatAI%2FApertus-8B-Instruct-2509-FP8-dynamic/artifacts/performance?filterQuery=use_case.string_value%3D%27chatbot%27+AND+ttft_p90.double_value+%3C%3D+2231.15348815918+OR+performance_sub_type.string_value%3D%27cold-start%27&latencyProperty=ttft_p90&orderBy=ttft_p90.double_value&pageSize=999&recommendations=true&sortOrder=ASC&targetRPS=1 HTTP/1.1" from 127.0.0.1:32862 - 200 41125B in 34.967464ms 2026/07/13 05:03:27 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/sources/redhat_ai_validated_models/models/RedHatAI%2FDevstral-Small-2-24B-Instruct-2512/artifacts/performance?filterQuery=use_case.string_value%3D%27chatbot%27+AND+ttft_p90.double_value+%3C%3D+2231.15348815918+OR+performance_sub_type.string_value%3D%27cold-start%27&latencyProperty=ttft_p90&orderBy=ttft_p90.double_value&pageSize=999&recommendations=true&sortOrder=ASC&targetRPS=1 HTTP/1.1" from 127.0.0.1:53208 - 200 62309B in 104.277066ms 2026/07/13 05:03:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:41138 - 200 55B in 37.901µs 2026/07/13 05:03:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:41150 - 200 55B in 39.2µs 2026/07/13 05:03:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:37636 - 200 55B in 37.113µs 2026/07/13 05:03:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:37664 - 200 55B in 39.81µs 2026/07/13 05:03:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:53112 - 200 55B in 44.825µs 2026/07/13 05:03:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:53138 - 200 55B in 48.734µs 2026/07/13 05:03:55 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/labels HTTP/1.1" from 127.0.0.1:53202 - 200 620B in 64.091µs 2026/07/13 05:03:55 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/sources HTTP/1.1" from 127.0.0.1:32862 - 200 420B in 1.005587ms 2026/07/13 05:03:55 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/models/filter_options HTTP/1.1" from 127.0.0.1:50476 - 200 9882B in 1.699056ms 2026/07/13 05:03:56 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/models?pageSize=4&sourceLabel=Red+Hat+AI+validated HTTP/1.1" from 127.0.0.1:32862 - 200 142061B in 7.777636ms 2026/07/13 05:03:56 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/models?pageSize=4&sourceLabel=Red+Hat+AI HTTP/1.1" from 127.0.0.1:32862 - 200 47545B in 2.818876ms 2026/07/13 05:03:56 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/models?pageSize=4&sourceLabel=null HTTP/1.1" from 127.0.0.1:32862 - 200 105023B in 4.044075ms 2026/07/13 05:03:56 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/sources/redhat_ai_validated_models/models/RedHatAI%2Fgemma-2-9b-it/artifacts/performance?filterQuery=use_case.string_value%3D%27chatbot%27+AND+ttft_p90.double_value+%3C%3D+2231.15348815918+OR+performance_sub_type.string_value%3D%27cold-start%27&latencyProperty=ttft_p90&orderBy=ttft_p90.double_value&pageSize=999&recommendations=true&sortOrder=ASC&targetRPS=1 HTTP/1.1" from 127.0.0.1:53202 - 200 56B in 3.708908ms 2026/07/13 05:03:56 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/sources/redhat_ai_validated_models/models/RedHatAI%2FDeepSeek-R1-0528-quantized.w4a16/artifacts/performance?filterQuery=use_case.string_value%3D%27chatbot%27+AND+ttft_p90.double_value+%3C%3D+2231.15348815918+OR+performance_sub_type.string_value%3D%27cold-start%27&latencyProperty=ttft_p90&orderBy=ttft_p90.double_value&pageSize=999&recommendations=true&sortOrder=ASC&targetRPS=1 HTTP/1.1" from 127.0.0.1:32862 - 200 20726B in 27.641026ms 2026/07/13 05:03:56 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/sources/redhat_ai_validated_models/models/RedHatAI%2FApertus-8B-Instruct-2509-FP8-dynamic/artifacts/performance?filterQuery=use_case.string_value%3D%27chatbot%27+AND+ttft_p90.double_value+%3C%3D+2231.15348815918+OR+performance_sub_type.string_value%3D%27cold-start%27&latencyProperty=ttft_p90&orderBy=ttft_p90.double_value&pageSize=999&recommendations=true&sortOrder=ASC&targetRPS=1 HTTP/1.1" from 127.0.0.1:50506 - 200 41125B in 39.695395ms 2026/07/13 05:03:56 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/sources/redhat_ai_validated_models/models/RedHatAI%2FDevstral-Small-2-24B-Instruct-2512/artifacts/performance?filterQuery=use_case.string_value%3D%27chatbot%27+AND+ttft_p90.double_value+%3C%3D+2231.15348815918+OR+performance_sub_type.string_value%3D%27cold-start%27&latencyProperty=ttft_p90&orderBy=ttft_p90.double_value&pageSize=999&recommendations=true&sortOrder=ASC&targetRPS=1 HTTP/1.1" from 127.0.0.1:50508 - 200 62309B in 164.08271ms 2026/07/13 05:03:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:37286 - 200 55B in 45.812µs 2026/07/13 05:04:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:37300 - 200 55B in 42.482µs 2026/07/13 05:04:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:56522 - 200 55B in 38.11µs 2026/07/13 05:04:12 "GET http://rh-ai.apps.rosa.rh-nightly-pm.nuth.p3.openshiftapps.com/api/model_catalog/v1alpha1/models?filterQuery=artifacts.use_case.string_value%3D%27chatbot%27+AND+artifacts.ttft_p90.double_value+%3C%3D+2231.15348815918+OR+artifacts.performance_sub_type.string_value%3D%27cold-start%27&latencyProperty=ttft_p90&orderBy=artifacts.ttft_p90.double_value&pageSize=10&recommendations=true&sortOrder=ASC&targetRPS=1 HTTP/1.1" from 127.0.0.1:32862 - 200 303399B in 881.067423ms 2026/07/13 05:04:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:56530 - 200 55B in 21.345µs 2026/07/13 05:04:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:40890 - 200 55B in 37.493µs 2026/07/13 05:04:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:40910 - 200 55B in 36.99µs 2026/07/13 05:04:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:42484 - 200 55B in 40.326µs 2026/07/13 05:04:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:42498 - 200 55B in 35.911µs 2026/07/13 05:04:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:41448 - 200 55B in 39.438µs 2026/07/13 05:04:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:41458 - 200 55B in 37.841µs 2026/07/13 05:04:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:37990 - 200 55B in 35.609µs 2026/07/13 05:04:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:38004 - 200 55B in 37.285µs 2026/07/13 05:04:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:42654 - 200 55B in 39.596µs 2026/07/13 05:05:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:42672 - 200 55B in 39.588µs 2026/07/13 05:05:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:58062 - 200 55B in 19.557µs 2026/07/13 05:05:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:58078 - 200 55B in 39.626µs 2026/07/13 05:05:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:46002 - 200 55B in 52.894µs 2026/07/13 05:05:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:46026 - 200 55B in 38.766µs 2026/07/13 05:05:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:46020 - 200 55B in 40.584µs 2026/07/13 05:05:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:46028 - 200 55B in 39.473µs 2026/07/13 05:05:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:60032 - 200 55B in 36.557µs 2026/07/13 05:05:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:60038 - 200 55B in 37.292µs 2026/07/13 05:05:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:46032 - 200 55B in 43.881µs 2026/07/13 05:05:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:46056 - 200 55B in 40.051µs 2026/07/13 05:05:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:49758 - 200 55B in 37.141µs 2026/07/13 05:06:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:49770 - 200 55B in 41.865µs 2026/07/13 05:06:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:45484 - 200 55B in 38.249µs 2026/07/13 05:06:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:45500 - 200 55B in 61.087µs 2026/07/13 05:06:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:34616 - 200 55B in 37.067µs 2026/07/13 05:06:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:34648 - 200 55B in 41.084µs 2026/07/13 05:06:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:59036 - 200 55B in 20.217µs 2026/07/13 05:06:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:59058 - 200 55B in 41.338µs 2026/07/13 05:06:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:47794 - 200 55B in 36.992µs 2026/07/13 05:06:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:47806 - 200 55B in 36.955µs 2026/07/13 05:06:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:49450 - 200 55B in 58.2µs 2026/07/13 05:06:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:49458 - 200 55B in 36.523µs 2026/07/13 05:06:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:58264 - 200 55B in 37.792µs 2026/07/13 05:07:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:58280 - 200 55B in 35.965µs 2026/07/13 05:07:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:54314 - 200 55B in 20.677µs 2026/07/13 05:07:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:54336 - 200 55B in 39.505µs 2026/07/13 05:07:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:51192 - 200 55B in 37.069µs 2026/07/13 05:07:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:51204 - 200 55B in 36.164µs 2026/07/13 05:07:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:56288 - 200 55B in 37.749µs 2026/07/13 05:07:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:56300 - 200 55B in 37.999µs 2026/07/13 05:07:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:46910 - 200 55B in 55.064µs 2026/07/13 05:07:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:46918 - 200 55B in 39.279µs 2026/07/13 05:07:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:40672 - 200 55B in 39.42µs 2026/07/13 05:07:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:40702 - 200 55B in 39.229µs 2026/07/13 05:07:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:48462 - 200 55B in 39.77µs 2026/07/13 05:08:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:48488 - 200 55B in 42.245µs 2026/07/13 05:08:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:39552 - 200 55B in 37.374µs 2026/07/13 05:08:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:39570 - 200 55B in 48.312µs 2026/07/13 05:08:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:58822 - 200 55B in 21.532µs 2026/07/13 05:08:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:58840 - 200 55B in 21.197µs 2026/07/13 05:08:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:57810 - 200 55B in 41.087µs 2026/07/13 05:08:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:57828 - 200 55B in 36.577µs 2026/07/13 05:08:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:36660 - 200 55B in 22.057µs 2026/07/13 05:08:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:36678 - 200 55B in 41.135µs 2026/07/13 05:08:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:39936 - 200 55B in 37.624µs 2026/07/13 05:08:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:39966 - 200 55B in 38.987µs 2026/07/13 05:08:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:53740 - 200 55B in 37.273µs 2026/07/13 05:09:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:53744 - 200 55B in 37.74µs 2026/07/13 05:09:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:38582 - 200 55B in 36.829µs 2026/07/13 05:09:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:38592 - 200 55B in 39.371µs 2026/07/13 05:09:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:45660 - 200 55B in 37.898µs 2026/07/13 05:09:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:45672 - 200 55B in 37.863µs 2026/07/13 05:09:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:51614 - 200 55B in 51.603µs 2026/07/13 05:09:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:51630 - 200 55B in 36.445µs 2026/07/13 05:09:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:45638 - 200 55B in 38.34µs 2026/07/13 05:09:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:45660 - 200 55B in 37.193µs 2026/07/13 05:09:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:43022 - 200 55B in 36.629µs 2026/07/13 05:09:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:43036 - 200 55B in 46.053µs 2026/07/13 05:09:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:55906 - 200 55B in 37.815µs 2026/07/13 05:10:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:55924 - 200 55B in 35.775µs 2026/07/13 05:10:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:54694 - 200 55B in 44.424µs 2026/07/13 05:10:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:54702 - 200 55B in 47.286µs 2026/07/13 05:10:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:49480 - 200 55B in 40.247µs 2026/07/13 05:10:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:49496 - 200 55B in 38.094µs 2026/07/13 05:10:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:53914 - 200 55B in 45.427µs 2026/07/13 05:10:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:53936 - 200 55B in 37.786µs 2026/07/13 05:10:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:44140 - 200 55B in 42.774µs 2026/07/13 05:10:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:44150 - 200 55B in 41.018µs 2026/07/13 05:10:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:54966 - 200 55B in 42.416µs 2026/07/13 05:10:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:54996 - 200 55B in 37.525µs 2026/07/13 05:10:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:52622 - 200 55B in 38.754µs 2026/07/13 05:11:04 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:52650 - 200 55B in 51.804µs 2026/07/13 05:11:09 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:36848 - 200 55B in 50.451µs 2026/07/13 05:11:14 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:36874 - 200 55B in 39.653µs 2026/07/13 05:11:19 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:51392 - 200 55B in 36.48µs 2026/07/13 05:11:24 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:51418 - 200 55B in 43.056µs 2026/07/13 05:11:29 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:60722 - 200 55B in 37.186µs 2026/07/13 05:11:34 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:60736 - 200 55B in 37.197µs 2026/07/13 05:11:39 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:52334 - 200 55B in 39.182µs 2026/07/13 05:11:44 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:52352 - 200 55B in 36.675µs 2026/07/13 05:11:49 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:49184 - 200 55B in 44.732µs 2026/07/13 05:11:54 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:49200 - 200 55B in 36.835µs 2026/07/13 05:11:59 "GET http://10.129.71.38:8080/readyz HTTP/1.1" from 10.129.70.2:54874 - 200 55B in 53.048µs ==================== WORKLOAD POD LOG: rhoai-model-registries/model-catalog-postgres-d7fd6d8d5-hwffz.log ==================== ==================== WORKLOAD POD LOG: rhoai-model-registries/mysql-db-registry-1783885261142-74f95d664f-tchlh.log ==================== 2026-07-13T04:46:00.609728Z 6541 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:46:08.420752Z 6542 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:46:10.611141Z 6543 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:46:18.420995Z 6544 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:46:20.610283Z 6545 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:46:28.420755Z 6546 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:46:30.609552Z 6547 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:46:38.421372Z 6548 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:46:40.609461Z 6549 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:46:48.421376Z 6550 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:46:50.610343Z 6551 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:46:58.420809Z 6552 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:47:00.609337Z 6553 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:47:08.420828Z 6554 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:47:10.609851Z 6555 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:47:18.420905Z 6556 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:47:20.609206Z 6557 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:47:28.420785Z 6558 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:47:30.609782Z 6559 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:47:38.420588Z 6560 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:47:40.610513Z 6561 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:47:48.420386Z 6562 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:47:50.609627Z 6563 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:47:58.421015Z 6564 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:48:00.609063Z 6565 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:48:08.420887Z 6566 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:48:10.609343Z 6567 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:48:18.420569Z 6568 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:48:20.611019Z 6569 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:48:28.421579Z 6570 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:48:30.609056Z 6571 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:48:38.421092Z 6572 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:48:40.610354Z 6573 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:48:48.419985Z 6574 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:48:50.609340Z 6575 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:48:58.420476Z 6576 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:49:00.609950Z 6577 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:49:08.420191Z 6578 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:49:10.610136Z 6579 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:49:18.420326Z 6580 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:49:20.609333Z 6581 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:49:28.420220Z 6582 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:49:30.610069Z 6583 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:49:38.420365Z 6584 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:49:40.609807Z 6585 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:49:48.420404Z 6586 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:49:50.609541Z 6587 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:49:58.420785Z 6588 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:50:00.609126Z 6589 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:50:08.420416Z 6590 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:50:10.609952Z 6591 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:50:18.421089Z 6592 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:50:20.610310Z 6593 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:50:28.420931Z 6594 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:50:30.609649Z 6595 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:50:38.420644Z 6596 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:50:40.617010Z 6597 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:50:48.420743Z 6598 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:50:50.608903Z 6599 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:50:58.420374Z 6600 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:51:00.609388Z 6601 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:51:08.420573Z 6602 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:51:10.609708Z 6603 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:51:18.420330Z 6604 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:51:20.609765Z 6605 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:51:28.420656Z 6606 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:51:30.608964Z 6607 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:51:38.422286Z 6608 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:51:40.608658Z 6609 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:51:48.420718Z 6610 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:51:50.609113Z 6611 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:51:58.421111Z 6612 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:52:00.610020Z 6613 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:52:08.420620Z 6614 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:52:10.608963Z 6615 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:52:18.420047Z 6616 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:52:20.609973Z 6617 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:52:28.420033Z 6618 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:52:30.609611Z 6619 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:52:38.420800Z 6620 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:52:40.609794Z 6621 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:52:48.420437Z 6622 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:52:50.609484Z 6623 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:52:58.420888Z 6624 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:53:00.610135Z 6625 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:53:08.420036Z 6626 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:53:10.609218Z 6627 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:53:18.420738Z 6628 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:53:20.609222Z 6629 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:53:28.427343Z 6630 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:53:30.609298Z 6631 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:53:38.419980Z 6632 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:53:40.609307Z 6633 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:53:48.420589Z 6634 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:53:50.609123Z 6635 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:53:58.420704Z 6636 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:54:00.609456Z 6637 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:54:08.420560Z 6638 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:54:10.609600Z 6639 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:54:18.421109Z 6640 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:54:20.609717Z 6641 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:54:28.421052Z 6642 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:54:30.610420Z 6643 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:54:38.421999Z 6644 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:54:40.608694Z 6645 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:54:48.422007Z 6646 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:54:50.609026Z 6647 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:54:58.422715Z 6648 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:55:00.609360Z 6649 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:55:08.424048Z 6650 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:55:10.614102Z 6651 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:55:18.423935Z 6652 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:55:20.608821Z 6653 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:55:28.424843Z 6654 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:55:30.609978Z 6655 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:55:38.427041Z 6656 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:55:40.610106Z 6657 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:55:48.423774Z 6658 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:55:50.609460Z 6659 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:55:58.424247Z 6660 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:56:00.609822Z 6661 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:56:08.424020Z 6662 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:56:10.610175Z 6663 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:56:18.423604Z 6664 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:56:20.609274Z 6665 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:56:28.424395Z 6666 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:56:30.609287Z 6667 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:56:38.422310Z 6668 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:56:40.609984Z 6669 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:56:48.421118Z 6670 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:56:50.609820Z 6671 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:56:58.421438Z 6672 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:57:00.609015Z 6673 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:57:08.420257Z 6674 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:57:10.610017Z 6675 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:57:18.420780Z 6676 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:57:20.608899Z 6677 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:57:28.420355Z 6678 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:57:30.609127Z 6679 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:57:38.420116Z 6680 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:57:40.608987Z 6681 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:57:48.420339Z 6682 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:57:50.608917Z 6683 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:57:58.420459Z 6684 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:58:00.608907Z 6685 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:58:08.420933Z 6686 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:58:10.609655Z 6687 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:58:18.420740Z 6688 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:58:20.609135Z 6689 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:58:28.421908Z 6690 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:58:30.609211Z 6691 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:58:38.420704Z 6692 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:58:40.608810Z 6693 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:58:48.421072Z 6694 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:58:50.609171Z 6695 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:58:58.420375Z 6696 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:59:00.609452Z 6697 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:59:08.421235Z 6698 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:59:10.609919Z 6699 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:59:18.420038Z 6700 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:59:20.609806Z 6701 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:59:28.420311Z 6702 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:59:30.609312Z 6703 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:59:38.420466Z 6704 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:59:40.609264Z 6705 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:59:48.421267Z 6706 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:59:50.610280Z 6707 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T04:59:58.421299Z 6708 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:00:00.610943Z 6709 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:00:08.422219Z 6710 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:00:10.609621Z 6711 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:00:18.421940Z 6712 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:00:20.609215Z 6713 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:00:28.420978Z 6714 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:00:30.609820Z 6715 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:00:38.422187Z 6716 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:00:40.610174Z 6717 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:00:48.421034Z 6718 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:00:50.609794Z 6719 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:00:58.420525Z 6720 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:01:00.608945Z 6721 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:01:08.420628Z 6722 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:01:10.609514Z 6723 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:01:18.421072Z 6724 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:01:20.609551Z 6725 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:01:28.421151Z 6726 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:01:30.609695Z 6727 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:01:38.421068Z 6728 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:01:40.610426Z 6729 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:01:48.421084Z 6730 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:01:50.609944Z 6731 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:01:58.421485Z 6732 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:02:00.609778Z 6733 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:02:08.421181Z 6734 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:02:10.609588Z 6735 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:02:18.422351Z 6736 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:02:20.610529Z 6737 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:02:28.420582Z 6738 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:02:30.608778Z 6739 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:02:38.420804Z 6740 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:02:40.609126Z 6741 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:02:48.420676Z 6742 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:02:50.610339Z 6743 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:02:58.421042Z 6744 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:03:00.609394Z 6745 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:03:08.420594Z 6746 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:03:10.609368Z 6747 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:03:18.421152Z 6748 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:03:20.610017Z 6749 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:03:28.421210Z 6750 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:03:30.610409Z 6751 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:03:38.423645Z 6752 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:03:40.609891Z 6753 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:03:48.421257Z 6754 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:03:50.611477Z 6755 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:03:58.421710Z 6756 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:04:00.609611Z 6757 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:04:08.421233Z 6758 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:04:10.610005Z 6759 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:04:18.421082Z 6760 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:04:20.609672Z 6761 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:04:28.420816Z 6762 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:04:30.609623Z 6763 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:04:38.422009Z 6764 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:04:40.610057Z 6765 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:04:48.421299Z 6766 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:04:50.610474Z 6767 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:04:58.421164Z 6768 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:05:00.609928Z 6769 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:05:08.420188Z 6770 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:05:10.609899Z 6771 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:05:18.421135Z 6772 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:05:20.609610Z 6773 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:05:28.421398Z 6774 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:05:30.610397Z 6775 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:05:38.421067Z 6776 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:05:40.609195Z 6777 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:05:48.420759Z 6778 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:05:50.610047Z 6779 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:05:58.420553Z 6780 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:06:00.609729Z 6781 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:06:08.420823Z 6782 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:06:10.609703Z 6783 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:06:18.421477Z 6784 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:06:20.610441Z 6785 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:06:28.420175Z 6786 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:06:30.609070Z 6787 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:06:38.420657Z 6788 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:06:40.609493Z 6789 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:06:48.421327Z 6790 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:06:50.609262Z 6791 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:06:58.421710Z 6792 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:07:00.608636Z 6793 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:07:08.421097Z 6794 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:07:10.609658Z 6795 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:07:18.421443Z 6796 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:07:20.609106Z 6797 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:07:28.421355Z 6798 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:07:30.612091Z 6799 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:07:38.439599Z 6800 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:07:40.628641Z 6801 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:07:48.421385Z 6802 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:07:50.609655Z 6803 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:07:58.421603Z 6804 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:08:00.609143Z 6805 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:08:08.420874Z 6806 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:08:10.609304Z 6807 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:08:18.421012Z 6808 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:08:20.609745Z 6809 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:08:28.420634Z 6810 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:08:30.609207Z 6811 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:08:38.420410Z 6812 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:08:40.610027Z 6813 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:08:48.420943Z 6814 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:08:50.610125Z 6815 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:08:58.420566Z 6816 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:09:00.609213Z 6817 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:09:08.421039Z 6818 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:09:10.609589Z 6819 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:09:18.420720Z 6820 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:09:20.609284Z 6821 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:09:28.421062Z 6822 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:09:30.608699Z 6823 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:09:38.420047Z 6824 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:09:40.609112Z 6825 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:09:48.420703Z 6826 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:09:50.609365Z 6827 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:09:58.420772Z 6828 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:10:00.609779Z 6829 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:10:08.421154Z 6830 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:10:10.608962Z 6831 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:10:18.421016Z 6832 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:10:20.609273Z 6833 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:10:28.421323Z 6834 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:10:30.609248Z 6835 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:10:38.420840Z 6836 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:10:40.609299Z 6837 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:10:48.420670Z 6838 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:10:50.609448Z 6839 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:10:58.420954Z 6840 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:11:00.609401Z 6841 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:11:08.420686Z 6842 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:11:10.608800Z 6843 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:11:18.421127Z 6844 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:11:20.610450Z 6845 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:11:28.420713Z 6846 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:11:30.609499Z 6847 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:11:38.420803Z 6848 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:11:40.611242Z 6849 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:11:48.420143Z 6850 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:11:50.609404Z 6851 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' 2026-07-13T05:11:58.420176Z 6852 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' ==================== WORKLOAD POD LOG: rhoai-model-registries/postgres-db-registry-1783885261142-5566666f49-4vjr6.log ====================